A new taxonomy classifies programming languages based on their resource availability for natural language processing (NLP) tasks, particularly for code generation by large language models (LLMs). The research categorizes 646 languages into four tiers, revealing that a small percentage of high-resource languages account for a disproportionately large share of code data. This classification provides a framework for curating datasets and evaluating multilingual LLMs in a tier-aware manner. AI
IMPACT Provides a framework for dataset curation and tier-aware evaluation of multilingual LLMs for code generation.
RANK_REASON The cluster contains an academic paper detailing a new taxonomy for programming languages related to code generation.
- Bash
- codex
- GitHub Copilot
- GPT-4
- Javascript
- OpenAI
- Python
- SQL
- alphaXiv
- arXiv
- CatalyzeX
- DagsHub
- Gotit.pub
- Hugging Face
- Joshi et al.
- Md Nishat Raihan
- ScienceCast
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →