u/Tasty_Pressure_5618

What deepfake detection models can I test my validation dataset on?
▲ 4 r/datasets+1 crossposts

What deepfake detection models can I test my validation dataset on?

Hello, I built a validation dataset of real and generated images (with a vanilla SDXL+InstantID architecture). I'm running low on AWS credits/have a low budget, but I want to benchmark the performance detection models against it. Can anyone recommend open-source detection models that I can test?

I know there is a mix of ones created by universities and made by members of the open source community, but any opinions on which 4-5 I should test would be greatly appreciated.

u/Tasty_Pressure_5618 — 3 days ago

How are people evaluating demographic fairness of deepfake/synthetic-face detectors?

I keep finding that FF++, DFDC, and GenImage aren't balanced enough by skin tone/gender to get stable per-group accuracy numbers. Is there a balanced eval benchmark I'm missing, or does everyone just report aggregate AUC?

reddit.com
u/Tasty_Pressure_5618 — 4 days ago