zoekt

For the grepping aspect, https://github.com/google/zoekt is a powerful one-stop-shop. For the navigating, I don't know. SourceGraph maybe, but the linking is somewhat heuristic I assume, not compilation-graph powered. But maybe that changes or depends per language.

Given the shoutouts to Burntsushi and Lemire this is almost certainly a bitmap trigram index based engine similar to https://github.com/google/zoekt The index is likely based on Roaring bitmaps, presumably https://github.com/RoaringBitmap/roaring-rs in this case. Nice architecture, exactly how I would have done it also.

If anyone else but me wonders where the name comes from, Zoekt means Seek. Context: "Zoekt, en gij zult spinazie eten" - Jan Eertink ("seek, and ye shall eat spinach" - My primary school teacher) https://github.com/google/zoekt

Looks like https://github.com/google/zoekt

cs.opensource.google runs on Google's search infrastructure, so it's unlikely to be open sourced. https://github.com/google/zoekt is open source, but lacks cross-referencing, and has a more spartan UI.

There's this https://github.com/google/zoekt. It's pretty light on features, but dang if it isn't fast and precise.

I'm running https://zerosearch.io on a single 16gb standard instance with 6 vcpus on Digital Ocean with the "Ubuntu Docker 5:19.03.1~3 on 18.04" image. The memory is important to keep an index for the top 1000 github repositories. It could probably do just as well with only one or two CPUs. The app is made up of two Docker containers: the indexer and the webserver. I'm using Cloudflare, which makes the site a lot faster and greatly reduces load on the webserver. For now there is no database. The code is a fork of https://github.com/google/zoekt, written in Go. The stack is simple and easy to work with, locally and in prod.

There's https://github.com/google/zoekt which provides a pretty straight-forward and memory-efficient implementation. Their design document goes a bit into what makes it fast: https://github.com/google/zoekt/blob/master/doc/design.md

For people interested in searching code using an open source solution, you might be interested in Zoekt too, github.com/google/zoekt. There is a demo site where you can search 30G of source code (including the Linux kernel, Android and Chrome) supporting regular expressions, and file name search: https://cs.bazel.build/?q=%20 For example, https://cs.bazel.build/search?q=+r%3Atorvalds+craz%5Byi%5D&n... looks for craz[iy] across the Linux kernel.

If you want to have an open source index search, you can try out github.com/google/zoekt/ . See here for a demo site: https://cs.bazel.build/ For example: https://cs.bazel.build/search?q=r%3Atorvalds+meltdown&num=50 searches the Linux kernel for "meltdown"