ironfan

There are many of these tools out there. When I was working for Technicolor Virdata some years ago, we’ve been heavily invested in https://github.com/infochimps-labs/ironfan. It was extensible, we had support for SoftLayer and IBM SCE, we had some patches to make the bootstrap and the kick command perform faster. But it was still slow and people didn’t like Ruby (I don’t mind it). Even back then I wasn’t a fan of doing a proactive ssh connection to the node. I always leaned towards the machine pulling artefacts and deploying them. Like Flux CD does.

One of the oldest examples of this: https://github.com/infochimps-labs/ironfan. But yeah, Chef. Examples: https://github.com/infochimps-labs/ironfan-pantry/blob/maste.... I used to use this heavily back in 2013, 2014. Infochimps got picked up by eBay, afair. Hence why this was never developed further.

INFOCHIMPS FULL-TIME, AUSTIN, TX (remote is a possibility for the right candidate) DATA ENGINEER and OPERATIONS ENGINEER (Data Architect/ DevOps are also apt descriptions here) Infochimps is a world-class big data shop, with a unique approach and philosophy that you won’t be able to find anywhere else. We’re the authors of Ironfan, the premiere way to manage clusters in the cloud (http://github.com/infochimps-labs/ironfan). Our data pipeline uses technologies such as HBase, Elastic Search, Flume, Pig, and Hadoop. We’ve also developed tools of our own to make the ingestion pipeline run more smoothly, like a Ruby-based interface to Hadoop and a bulk loader for Elastic Search, that you can check out at http://github.com/infochimps-labs. You can read more about our culture and openings here: http://www.infochimps.com/careers email us: career

By the way, the majority of the code that powers our platform is open-source: check out Ironfan at http://github.com/infochimps-labs/ironfan and the full suite at http://infochimps.com/labs Would love any early feedback on the documentation and install experience -- hit me as @mrflip on github or flip at infochimps.com