Artificial Analysis released Intelligence Index v5, its largest update since January, which now relies on private test sets for 60% of its evaluations. The company also introduced the Progress Index v1 to track model capabilities over time on a continuous scale.
Intelligence Index v5 is the biggest upgrade since the v4 launch in January.
Sixty percent of the new index uses private test sets or held-out answers.
The new Progress Index v1 tracks model capability over time on one continuous scale.
Summarised automatically by AI from the original article by Hacker News. AI can make mistakes, so check the original for details.
The Artificial Analysis Intelligence Index is our composite measure of model capabilities across tasks reflecting real-world usage today. v5 is our biggest upgrade since v4 launched in January. With v5, 60% of the Index is now based on evaluations with private test sets or held-out answers.
Alongside Intelligence Index v5, we’re launching the Artificial Analysis Progress Index v1, which tracks model capability over time on one continuous scale.
Read the full story on Hacker NewsThat's the opening of the story. The full piece is published by Hacker News.
AI summary Artificial Analysis Intelligence Index v5.0 evaluates language models across reasoning, knowledge, math, and programming with a weighted average score.
Just over two weeks after their unveiling, CMF has announced that its new Speaker S and Speaker M are now available for pre-order in Malaysia. They are priced at RM259 and RM459…