The Benchmarking Broom: How Vals Is Sweeping Up the Flaws in AI Evaluation The tech industry's Achilles' heel has long been its tendency to fudge numbers. In artificial intelligence, this flaw is particularly egregious.
Companies have relied on outdated benchmarking systems that provide a veneer of legitimacy for their models. But in AI, where failure can be catastrophic, such shortcuts won't suffice.
Enter Vals, a startup founded two years ago by Rayan Krishnan to revolutionize AI evaluation.