DeOldify

I think the novel and interesting tech is still happening, its just that without the colorful ads for it on TV, and without the software being packaged up and sold with pretty box art that you can physically hold, it doesn't feel as much like a capital-E Experience. It's probably the Internet's fault that we don't do things like that anymore, but the upside is that we now have access to so many ideas and applications from all over, even ones that aren't commercially viable. Some that look exciting to me are: an AI that lets you animate still photos realistically [1], a simple website that guides you to discover new parks, eateries, and other places near you [2], an AI that colorizes old black-and-white photos/video [3], a Street View style map of the game world from "The Legend of Zelda: Breath of the Wild", with some 1st person 360 degre

Also see [1] and for a live demo see [2] [1] - https://github.com/jantic/DeOldify [2] - https://deepai.org/machine-learning-model/colorizer

I wrote a quick script the other day to colorize directories of family photos. I realized it would be cool to colorize these photos, too. Here's the album: https://imgur.com/a/aJbpMjf The script uses the Image Colorization API from DeepAi. Here's the repo for the colorizing model itself: https://github.com/jantic/DeOldify I don't think the DeepAi API allows you to adjust the model parameters, but you definitely can if you run it yourself from the repo above or a colab instance (e.g. https://colab.research.google.com/github/jantic/DeOldify/blo...). MyHeritage also offers this API as a service with tunable parameters. If you want some quick results on your own BW images, just set your own DeepAi API key as an env var and run this script: https://github.com/skzv/colorize-photos

The same site (MyHeritage) has a colorizer for old photos. An open source version is available as DeOldify https://github.com/jantic/DeOldify

Built this interface using the Gradio[1] library. Forked the DeOldify[2] model on github. [1]: https://github.com/gradio-app/gradio [2]: https://github.com/jantic/DeOldify

DeOldify is going quite good job on old photos: https://github.com/jantic/DeOldify

DeOldify [1] by Jason Antic got really good results with old photos and movies colorization. [1] https://github.com/jantic/DeOldify

The flicker would be a challenge but you can use something like DeOldify [1] or super resolution [2] on the frame sequence to improve the colour and resolution... although you may get some weird artifacts between frames using image models rather than models built for video. Generally video models are quite far behind image models because they're so much higher dimensional (much more computationally expensive and expensive to annotate) but I'm sure it's a matter of time before someone releases a DeOldify type model for video (if one doesn't exist already). [1] https://github.com/jantic/DeOldify [2] https://github.com/idealo/image-super-resolution

GANs are an interesting frontier. Videos are much more engaging than photos. The next logical step is to make a real-time GAN, like a videogame you can walk around in. Imagine using a Vive to explore a GAN interactively. You'd be able to control the GAN using vive controllers and by walking around your room. Right now it takes 163ms to render a 1024x1024 frame on a K80 GPU. That's 6 FPS, which is within an order of magnitude of 60FPS. I haven't timed a 256x256 GAN, but presumably it would be 16x faster to generate. If so, then you'd be able to achieve 98FPS. The above timings are based on the 1024x1024 FFHQ GAN model, which generates portraits of humans. https://github.com/pbaylies/stylegan-encoder And indeed, it looks like the author uploaded an FFHQ music video 14 minutes ago! https://www.youtube.com/watch?v=3TLEfOMBbMw It looks cool.

Open source implementation: https://github.com/jantic/DeOldify/blob/master/README.md

As we learned yesterday colorized movies from the past could be a commodity soon. https://github.com/jantic/DeOldify