Opus 4.5 is disgustingly good
| Umber boltzmann | 11/29/25 | | Sienna bipolar gas station | 11/29/25 | | Umber boltzmann | 11/29/25 | | frozen partner | 11/29/25 | | Arousing locus pocket flask | 11/29/25 | | Umber boltzmann | 11/29/25 | | Orchid dilemma | 11/29/25 | | Curious lemon ceo | 12/07/25 | | spruce multi-billionaire | 12/07/25 | | Orchid dilemma | 11/30/25 | | Curious lemon ceo | 12/07/25 | | Galvanic harsh mood | 12/07/25 | | mustard hominid | 12/07/25 | | Olive 180 giraffe | 12/07/25 | | Sienna bipolar gas station | 12/21/25 | | mint factory reset button stock car | 12/21/25 | | frozen partner | 12/21/25 |
Poast new message in this thread
Date: December 21st, 2025 12:59 PM Author: Sienna bipolar gas station
Opus 4.5 is up to 4 hours and 49 minutes on the METR time horizon task. this benchmark measures the task length (in terms of human work time) that models can do with SWE/AI research type projects. big increase over 5.1 max, which was 2 hours 53 minutes and faster than the overall trend of doubling every 7 months. with any luck, models will be capable of substantially automating AI research before 2030 and set off an intelligence explosion.
https://metr.org/blog/2025-03-19-measuring-ai-ability-to-complete-long-tasks/
(http://www.autoadmit.com/thread.php?thread_id=5804093&forum_id=2)#49527643) |
|
|