A new dataset called the Indian Financial Automated Advice Bias (IFAAB) benchmark has been developed to audit socioeconomic and demographic disparities in financial advice generated by large language models in India. The dataset includes 31,734 responses from GPT-4o for synthetic Indian personas, varying across gender, caste, education, and other factors. Initial findings reveal significant biases, with male-identified profiles receiving substantially more resources post-advice compared to female-identified profiles, and caste also playing a role in resource allocation. Geographic location was found to significantly influence these gender-based disparities. AI
IMPACT Highlights the need for intersectional evaluation of AI systems in high-stakes economic domains, particularly in the Global South.
RANK_REASON The cluster contains an academic paper introducing a new dataset and benchmark for evaluating AI bias. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →