fly

I made a fruit fly connectome that Google and Janelia published last week play Super Mario Bros World 1-1 from 1985. It uses simulated 166,700 neurons and 25.6 million synapses from the MaleCNS v1.0 dataset. I fed the game pixels as input to the fly's actual photoreceptor neurons and collected NES command outputs from four of its motor neurons. It uses zero training or reward. I credit inspiration to github.com/ornata/fly, who did this for Mario 64. The GitHub page is a recorded 60-second clip running in a loop. The game emulator and the network run in a single CPU thread at NES speed ~60 fps and about 6-7 ms per frame on an M3 Max (no GPU). The source code is not public yet, but happy to open-source it if there's interest and/or answer any questions.

Google / HHMI Janelia MaleCNS Connectome Dataset: https://male-cns.janelia.org/download/ Alex Wormuth's DOOMFLY project: https://github.com/nftechie/doomfly Jessica Paquette's Super Mario 64 project: https://github.com/ornata/fly FlyWire Main Project Homepage: https://flywire.ai