Researchers have developed Data Turnstile, an open-source framework designed to generate high-quality synthetic training data for function-calling tasks, specifically targeting small language models (SLMs). This framework addresses the scarcity and noise in existing data by using user-defined API specifications and incorporating constrained, stepwise generation with validation and error-feedback loops. Experiments show that SLMs fine-tuned with Data Turnstile data achieve significantly improved accuracy on function-calling benchmarks, even outperforming much larger models on certain tasks. AI
IMPACT Enables smaller, more efficient models to perform complex tool-use tasks, potentially lowering the barrier for agentic AI deployment.
RANK_REASON The cluster contains an academic paper detailing a new framework and benchmark results. [lever_c_demoted from research: ic=1 ai=1.0]
- BFCL
- Data Turnstile
- Goutham Ramakrishnan
- Qwen2.5-32B-Instruct
- Qwen3 0.6B
- Qwen3 1.7B
- Qwen3-4B
- tau^2-Bench
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →