PulseAugur
EN
LIVE 00:57:15

LLMs tested as coding agents with simple "vibey" prompts

A user on Mastodon tested several large language models to see how they perform as coding agents. The user provided a simple, "vibey" prompt, asking the models to generate code for a basic console program. The results were then examined for code quality and the models' assumptions. AI

IMPACT Provides insights into the practical coding capabilities of current LLMs when given informal prompts.

RANK_REASON User-generated commentary and testing of existing LLMs.

Read on Mastodon — fosstodon.org →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

LLMs tested as coding agents with simple "vibey" prompts

COVERAGE [1]

  1. Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] ·

    Following on from my previous post [ https:// mastodon.social/@arsalan_zaidi /116945759256450237/embed ], here's a simple test of these models as coding agents.

    Following on from my previous post [ https:// mastodon.social/@arsalan_zaidi /116945759256450237/embed ], here's a simple test of these models as coding agents. I had them vibe code a very simple console based program and then run the output and examined it for code quality. I've…