PulseAugur
EN
LIVE 03:30:55
ไทย(TH) สิบเอ็ดวันหลัง Google เปิดซอร์ส Harness สองชั้น ชุมชนส่ง pull request เข้ามา 38 ชิ้น แต่ไม่มีสักชิ้นถูกปิดหรือรวมเลย นักพัฒนาอ่านโค้ดเองแล้วเจอว่า ledger ไม่นับ

AI agents face scrutiny over 'Evidence Contract' and open-source contribution issues

A new 'Evidence Contract' framework is proposed for evaluating AI agents, suggesting that consumers should not purchase these agents until they meet specific evidence-based criteria. This comes as developers are scrutinizing open-source projects, with one instance highlighting community contributions to Google's Harness.io project that have gone unaddressed, revealing discrepancies between documentation and code. AI

IMPACT The proposed 'Evidence Contract' could influence how AI agents are evaluated and adopted by users, while the Harness.io issue highlights ongoing challenges in open-source project management and community engagement.

RANK_REASON The cluster discusses a proposed framework for evaluating AI agents and a separate issue regarding community contributions to an open-source project, neither of which constitutes a primary release, significant event, or research paper.

Read on Mastodon — fosstodon.org →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

AI agents face scrutiny over 'Evidence Contract' and open-source contribution issues

How we ranked this

Signal score
2 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Commentary
The cluster discusses a proposed framework for evaluating AI agents and a separate issue regarding community contributions to an open-source project, neither of which constitutes a primary release,…
Source corroboration
2 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
product, other
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Breaking (< 6h)
Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

Full methodology in our editorial standards.

COVERAGE [2]

  1. Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] ·

    Do Not Buy an AI Agent Until It Passes This Evidence Contract Most AI-agent comparisons... # ai # business # security # productivity # software # coding # devel

    Do Not Buy an AI Agent Until It Passes This Evidence Contract Most AI-agent comparisons... # ai # business # security # productivity # software # coding # development # engineering # inclusive # community Do Not Buy an AI Agent Until It Passes This Evidence Contract

  2. Mastodon — fosstodon.org TIER_1 ไทย(TH) · [email protected] ·

    Eleven days after Google open-sourced Harness, the community submitted 38 pull requests, but not a single one was closed or merged. Developers read the code themselves and found that the ledger was not counting.

    สิบเอ็ดวันหลัง Google เปิดซอร์ส Harness สองชั้น ชุมชนส่ง pull request เข้ามา 38 ชิ้น แต่ไม่มีสักชิ้นถูกปิดหรือรวมเลย นักพัฒนาอ่านโค้ดเองแล้วเจอว่า ledger ไม่นับเงินของ executor และเอกสารกับโค้ดพูดไม่ตรงกัน # ai # opensource # github # productivity # software # coding # developmen…