FundingTechCrunch AI · Oct 19, 2026
Embedded AI evaluators won’t be an easy solution, Hugging Face’s policy chief says
AI labs have staked their reputations on model benchmarking — the supposedly neutral and accurate system of evaluations that are designed to measure whether one AI product is better than another. However, the methods behind these evaluations are complicated and still maturing,...
Related stories
Open Source · Hacker News (MCP) · Oct 19, 2026
Hi HN, we’re Robert and Din from Laminar ( https://laminar.sh ). We’ve been building open-source observability for AI agents since 2024. Recently, we released flow-1, a model trained with RL to find errors in agent traces. On our benchmark ( https://laminar.sh/blog/flow-1 ), i...
Funding · Hacker News · Oct 18, 2026
Funding · OpenAI Blog · Oct 16, 2026
Anant Kumar builds tools to compare loan valuations and analyze credit agreements, using Codex for code review and faster follow-ups.
Open Source · Hacker News (MCP) · Oct 13, 2026
Existing benchmarks measure solve rate and token output/cost, but don't punish excess code, which makes a codebase harder to work with in the long term. I wanted to measure this since it matters most for long-term projects. Method: it takes the patches that benchmarks already ...