test-infra

The trickiest part of decoding protobufs blind is how embedded messages and strings have the same tag type, but that's pretty easy to handle. You can write a simple protobuf decoder in a couple hundred lines of code if you don't want to pull in the full protoc dependency: https://github.com/kubernetes/test-infra/blob/master/guberna... https://github.com/kubernetes/test-infra/blob/master/guberna...

Here's a minimal Python protobuf parser that can extract basic information in about 50 LOC. https://github.com/kubernetes/test-infra/blob/master/guberna...

Previous pun on Kubernetes->Gubernator : https://github.com/kubernetes/test-infra/tree/master/guberna... Etymology of Latin "guberno": From a non-Indo-European Mediterranean language; akin to Ancient Greek κυβερνάω (kubernáō).

There's a nice middle ground between this and a one-at-a-time submit queue: have a speculative batch running on the side. This gives nice speedups (approaching N times more commits, where N is the batch size) with minimal complexity. One useful metric is the ratio between test time and the number of commits per day. If your tests run in a minute, you can test submissions one at a time and still have a thousand successful commits each day. If your tests take an hour, you can have at most 24 changes per day under a one-at-a-time scheme. I worked on Kubernetes, where test runs can take more than an hour-- spinning up VMs to test things is expensive! The submit queue tests both the top of the queue and a batch of a few (up to 5) changes that can be merged without a git merge conflict. If either one passes, the changes are merged. Batch tests

Disclosure: I work at Google on Kubernetes CI / Infra etc. The tooling, configs, etc are all open source [1] (and largely run on Kubernetes!), but the actual deployments have been Google operated. This is about opening up access to operation of the deployments. I'm not about to stop working on the automation etc. :-) [1] https://github.com/kubernetes/test-infra Edit: if anyone is interested in more, we have a post out on the Kubernetes blog today about some of the infrastructure: https://kubernetes.io/blog/2018/08/29/the-machines-can-do-th...