Evaluate AUC on a subset of items

[federico-fabiani]

Hi everyone,

As from the title, I need to evaluate AUC for categories of items, in other words, I need to understand for a category (i.e. meat) if items with positive interactions score generally higher than negative ones. However, built-in auc metric requires the whole test set at once.

Is there a handy way to achieve what I need?