Best small model right now (~4B params) that is good with agentic tasks for personal assistant?
A user on the r/LocalLLaMA subreddit is seeking recommendations for a small language model, specifically around 4 billion parameters, that excels at agentic tasks for personal assistant functions. They have experimented with Google's Gemma models but found their tool-calling capabilities lacking for tasks like calendar updates or sending scheduled messages. The user shared their server parameters, indicating they are running a quantized version of a Gemma model with a large context window and flash attention enabled. AI
IMPACT Identifies a user need for efficient, small-scale AI models capable of performing agentic tasks, potentially guiding future model development.