benchmark

Can Foundation Models Moderate Online Content? Evaluating Instruction- vs. Example-Driven Policy Operationalization
The growing complexity of content moderation policies presents a critical challenge for their consistent operationalization. While …
Ayan Majumdar, Shounak Paul, Pushpdeep Singh, Ines Abdelaziz, Sayeh Jarollahi, Seungeon Lee, Krishna P. Gummadi, Ingmar Weber, Abhisek Dash
PDF Cite Code Project
Can Foundation Models Moderate Online Content? Evaluating Instruction- vs. Example-Driven Policy Operationalization
Evaluating LLMs for Detecting Demographic-Targeted Social Bias: A Comprehensive Benchmark Study
Large-scale web-scraped text corpora used to train general-purpose AI models often contain harmful demographic-targeted social biases, …
Ayan Majumdar, Feihao Chen, Jinghui Li, Xiaozhen Wang
PDF Cite
Evaluating LLMs for Detecting Demographic-Targeted Social Bias: A Comprehensive Benchmark Study