ViZDoom

Doom system requirements: - 4 MB RAM - 12 MB disk space Stable diffusion v1 > 860M UNet and CLIP ViT-L/14 (540M) Checkpoint size: 4.27 Gb 7.7 GB (full EMA) Running on a TPU-v5e Peak compute per chip (bf16) 197 TFLOPs Peak compute per chip (Int8) 393 TFLOPs HBM2 capacity and bandwidth 16 GB, 819 GBps Interchip Interconnect BW 1600 Gbps This is quite impressive, especially considering the speed. But there's still a ton of room for improvement. It seems it didn't even memorize the game despite having the capacity to do so hundreds of times over. So we definitely have lots of room for optimization methods. Though who knows how such things would affect existing tech since the goal here is to memorize. What's also interesting about this work is it's basically saying you can rip a game if you're willing

VizDoom provides access to the depth buffer. https://github.com/Marqt/ViZDoom

> The doom maps are almost all completely dull looking and gray I will fight you ;-) But seriously: The project uses a source port of Doom[1] based on ZDoom[2] which supports high screen and texture resolutions, mouse look, colored lights etc. Although I think that since Doom has less visual clutter (bloom, shadows, ambient occlusion, screen distortion) than a modern AAA game its display should be easier to read. [1] https://github.com/Marqt/ViZDoom [2] http://zdoom.org/About