opencode-dynamic-context-pruning

running local models, now with Qwen3.8-Flash-Next, they have 256k, but when they get up there their speed is just too slow. So i've taken https://github.com/Tarquinen/opencode-dynamic-context-prunin... and started improving it. It already worked well to get a lot of mileage out of just taking tool calls, code modifications, etc, and dumping them in favor of a summary. But they'd still inevitably get to long in the tooth, and context poisoning meant they'd just eventually not be able to stay in the preferred context size, which for me is 64k-128k. So, I extended it with an eviction command and required a ratio. So instead of a summary of work, it now just places a waypoint. The waypoint basically means the context has a semi-coherent context but without all the baggage. I'm on like day 3 of a single session with 3m tokens removed and still

this is what I use: https://github.com/Opencode-DCP/opencode-dynamic-context-pru... ; this and openviking appear to be all I need to get a proper 'do anything' setup.

I recommend that Opencode users try Dynamic Context Pruning as well: https://github.com/Opencode-DCP/opencode-dynamic-context-pru... It works great for long-horizon tasks, and feels like it saves a boatload of tokens.

I don't really think you're making reasonable decisions at that size; but I suppose if you're not allowed to refactor it, maybe. I think the way these models work excludes sane behaviors the larger the context gets as each token introduces potential ambiguities between "USER" and "SYSTEM" messages leading to all the catastrophic behaviors. Anyway, with AMD395+ I'm finding ~100k is both speed and context usefulness unless it's scoped tightly. with opencode, I manage it with dynamic context pruning: https://github.com/Opencode-DCP/opencode-dynamic-context-pru... ; then anything I touch ends up being refactored so context doesn't get bloated with unecessary functions, etc. Obviously, this isn't compatible with certain business codebases, so I can see why bloat meets bloat.

opencode has a plugin for similar work: https://github.com/Opencode-DCP/opencode-dynamic-context-pru... It allows the model to remove context pollution.

I've done some very long sessions on OpenCode with Dynamic Context Pruning. Highly recommend it. https://github.com/Opencode-DCP/opencode-dynamic-context-pru...

I've been running https://github.com/rtk-ai/rtk for a week seems to be a good balance between culling out of context and not just killing everything. I've been running https://github.com/Opencode-DCP/opencode-dynamic-context-pru... in opencode as well. It seems more aggressive.