\
  The most prestigious law school admissions discussion board in the world.
BackRefresh Options Airdrop

they still can't fix the 65k token barrier, we've made no progress since 2021

yeah I run 232k+ context windows, but only to catch overruns...
tan out-of-control ceo crackhouse
  09/13/26


Poast new message in this thread



Reply

Date: September 13th, 2026 5:42 PM
Author: tan out-of-control ceo crackhouse

yeah I run 232k+ context windows, but only to catch overruns. I set compression threshold to 50% so that I don't blow past 128k tokens under normal use. At 65k tokens it starts to slow down, and by 128k it's forgetting important details. There's no model that has ever solved this problem.

(http://www.autoadmit.com/thread.php?thread_id=5903592&forum_id=2#50134007)