PokemonRedExperiments

You're thinking of https://www.youtube.com/watch?v=DcYLT37ImBY and https://github.com/PWhiddy/PokemonRedExperiments. > It also almost always runs from battles instead of changing Pokemon or fighting. I believe this is because all of its Pokemon are on the verge of fainting, so it's trying to conserve them while it tries to find its way out. > It keeps forgetting where it has been. I'm wondering if this could be solved with a better harness; on one hand, that hurts the elegance of having one model dedicated to playing the game, but their existing harness is already cheating a little (they have a second LLM for verification). They're frequently compacting what's in context, which means its visual memory is quite poor - that could potentially be a point of improvement?

I agree that's ambigiously worded. For example, I'm not sure if Claude could identify "MT MOON B1F" from the RAM data alone since internally world map areas are only known by IDs, while AI Plays Pokemon did annotate the corresponding area with a human-readable name. https://github.com/PWhiddy/PokemonRedExperiments/blob/master... Though this RAM data could be in Claude's training data.

See also: the AI Plays Pokemon project that went megaviral a year or so ago, using CNNs and RL instead of LLMs: https://github.com/PWhiddy/PokemonRedExperiments > I believe that Claude Plays Pokemon isn't doing any of the memory parsing I spent a ton of time, they are just streaming the memory directly to Claude 3.7 and it is figuring it out It is implied they are using structured Pokemon data from the LLM and saving it as a knowledge base. That is the only way they can get live Pokemon party data to display in the UI: https://www.twitch.tv/claudeplayspokemon The AI Plays Pokemon project above does note some of the memory addresses where that data is contained, since it used that data to calculate the reward for the PPO.

To save people clicking around: they're using PPO for training and the gym is here https://github.com/PWhiddy/PokemonRedExperiments/blob/master...

Over the last couple years, I've been training an AI to play Pokemon Red. I put together a video that tells the story of the AI's learning and discusses lots of technical details. You can also download and play with the model yourself! https://github.com/PWhiddy/PokemonRedExperiments Enjoy!