ZWzwischenzug·Dec 8, 2014
Thanks! I may use those as templates to improve this:
https://github.com/ianmiell/shutit/blob/master/library/ansib...
In Docker at Lystianmiell
shutit
Python2014–2019
ianmiell / shutit
shutit
Automation framework for programmers
4Distinct people
23Mentions
0Explicit recommenders
2.1KGitHub stars
What to know before exploring
What it is
Automation framework for programmers
GitHub
Where it is used
No documented product use has been verified yet.
What people are saying
No recommendation phrase was found in the indexed comments.
No classified warning is attached to this page. Read the discussions before treating silence as approval.
Also in these discussions
No other repository is repeatedly linked in the same discussions.
This week on Hacker News
Nov 8–Nov 15 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/15/2026, 11:34:28 AM UTC.
No direct repository links were found in the indexed HN discussions over the past seven days. Older discussions are available below.
Mentions over time
HN mentions by year23 dated mentions
Observed mentions: 2014-06-28 19:57:37 UTC to 2019-04-12 17:40:26 UTC.
Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.
View mention counts and date ranges
| Period | Start (UTC) | End (exclusive, UTC) | Mentions | Submissions | Comments |
|---|---|---|---|---|---|
| 2014 | 2014-01-01 00:00:00 UTC | 2015-01-01 00:00:00 UTC | 15 | 0 | 15 |
| 2015 | 2015-01-01 00:00:00 UTC | 2016-01-01 00:00:00 UTC | 3 | 2 | 1 |
| 2016 | 2016-01-01 00:00:00 UTC | 2017-01-01 00:00:00 UTC | 2 | 0 | 2 |
| 2017 | 2017-01-01 00:00:00 UTC | 2018-01-01 00:00:00 UTC | 2 | 0 | 2 |
| 2018 | 2018-01-01 00:00:00 UTC | 2019-01-01 00:00:00 UTC | 0 | 0 | 0 |
| 2019 | 2019-01-01 00:00:00 UTC | 2020-01-01 00:00:00 UTC | 1 | 0 | 1 |
What Hacker News says
15 sourcesDockerfiles are deliberately dumb to let other tools take over as necessary, is my understanding.
My experience (over the last year) is that they're so limited as to be pretty useless. They don't even do what they're advertised to do, ie give you a reliable way to reproduce a build, and they're inflexible for my idea of real-world work with Docker. Where they're good is in giving everyone a point of reference.
I had a discussion with the maintainers last year about this:
https://groups.google.com/forum/#!topic/docker-user/3pcVXU4h...
I have a problem with most CM tools in that they're for moving target systems, not immutable ones. Ansible is the closest, but our experience has been that development on it is slow relative to the tool we use (see below). It's saved us a ton of money.
I blog on this and similar topics here:
http://zwischenzu
Read the rest
gs.wordpress.com/
The "tool for building and maintaining complex Docker deployments" is here:
http://ianmiell.github.io/shutit/
https://github.com/ianmiell/shutit
I also talk about this here:
https://www.youtube.com/watch?v=zVUPmmUU3yY
Have a look at this:
http://ianmiell.github.io/shutit/
which is a means of capturing this complexity for automation purposes.
https://github.com/ianmiell/shutit
I'm working on a "shutitdist" to compile "everything" from source:
https://github.com/ianmiell/shutitdist
ShutIt can (among many other things) produce depgraphs like this:
https://raw.githubusercontent.com/ianmiell/shutitdist/master...
In Give me back my sanity: How I had to install Pandoc in a CentOS Docker containerIn terms of building LLVM and clang, I wrote this ShutIt module a while back when trying to learn it myself:
https://github.com/ianmiell/shutit/blob/master/library/llvm/...
In Samples for using LLVM and Clang as a libraryShutIt script here:
https://github.com/ianmiell/shutit/blob/master/library/osque...
There are deps on thrift and rocksdb modules defined at the bottom.
Should be useful for those looking to port to other CM tools.
cf:
http://ianmiell.github.io/shutit/
In Osquery: Expose the operating system as a relational databasedocker run -t -i imiell/osquery /bin/bash
history
for my gory details.
I'll post a shutit script with the lot in tomorrow probably.
The rocksdb dep is already done:
https://github.com/ianmiell/shutit/blob/master/library/rocks...
but bed beckons. In the meantime IYI:
https://github.com/ianmiell/shutit/blob/master/library/osque...
Thrift is another dep:
https://github.com/ianmiell/shutit/blob/master/library/thrif...
In Osquery: Expose the operating system as a relational databaseThis site:
http://themortgagemeter.com/
is completely dockerized, and rebuilds from scratch daily (phoenix deployment).
I've written a few blogs on this:
http://zwischenzugs.wordpress.com/2014/06/07/phoenix-deploym...
http://zwischenzugs.wordpress.com/2014/07/16/phoenix-deploym...
The tool I talk about there is here:
http://ianmiell.github.io/shutit/
https://github.com/ianmiell/shutit
I've also used Docker to provision AWS:
http://zwischenzugs.wordpress.com/2014/08/09/using-shutit-an...
http://zwischenzugs.wordpress.com/2014/09/15/using-shutit-an...
In Ask HN: How do you use Docker in production?OK, done:
docker pull imiell/binspector
https://registry.hub.docker.com/u/imiell/binspector/
Bit of a hack required to get it compiled; there's probably a better solution:
https://github.com/ianmiell/shutit/blob/master/library/binsp...
In Show HN: Binspector – A Binary Format Analysis ToolAttempting to dockerize this...
Build script here:
https://github.com/ianmiell/shutit/blob/master/library/binsp...
Get this error:
./smoke_test.sh: line 8: ./bin/debug/binspector: No such file or directory
anyone know why?
In Show HN: Binspector – A Binary Format Analysis ToolHey, I'm working on this atm:
https://github.com/ianmiell/shutit/blob/master/library/night...
which should help matters. Will reply when done.
In Show HN: Nightmare – Simple browser automationI've blogged about a similar exercise here:
http://zwischenzugs.wordpress.com/2014/08/09/using-shutit-an...
This deploys in a reliable way using a docker container and ShutIt, a tool we use in my corp for fast development of reliable and composable iterative steps:
http://ianmiell.github.io/shutit/
Here's more on the subject:
https://github.com/ianmiell/shutit/blob/master/README.md
https://www.youtube.com/user/ianmiell
http://zwischenzugs.wordpress.com/
In How We Use AWS, Ansible, and Packer to Make Deployment AwesomeA similar project designed for complex docker builds designed by me :)
http://ianmiell.github.io/shutit/
https://github.com/ianmiell/shutit
Used extensively within our corp for container builds, but easily repurposed for straightforward shell provisioning. Bash within a build-friendly python framework.
I talk about it more here:
https://www.youtube.com/watch?v=zVUPmmUU3yY
tho slightly out of date.
Some blogging on it here:
http://zwischenzugs.wordpress.com/
In BashBooster – simple provisioning, bash only, requires nothingI posted this on the site, thought some might be interested here (disclaimer: I'm the creator of ShutIt):
We had similar requirements in our company and ended up building our own tool for building containers in docker and shipping those. So far it's working out really well, particularly in the "ease of learning" department.
http://ianmiell.github.io/shutit/.
https://github.com/ianmiell/shutit
https://github.com/ianmiell/shutit/blob/master/README.md
http://shutit.tk
To take each of your requirements in turn wrt ShutIt:
- No masters.
ShutIt builds containers for shipping, so there is no concept of a master.
- Code should be as simple as possible.
What could be simpler than "pure bash", wrapped in a transparent and simple python framework? eg here's the mysql module:
https://github.com/ianmiell/shutit/blob/master/library/mysql...
Read the rest
- No optimizations that would make the code read in an illogical order.
ShutIt is "pure ordered". Each module has an ordering and code is strictly sequential. It even outputs the commands into a "black box" recorder on the container which can then be used to port to other CM tools if desired.
- Code must be split into two parts: base and service-specific, where each would reside in separate repositories.
https://github.com/ianmiell/shutit/tree/master/library
These are shared infra, while custom modules can be cut and kept private.
You can also build "meta-modules" which simply require other modules and do nothing else. These then form the base layer of our dev builds.
- The code must work for multiple environments (development, staging, production).
ShutIt's highly configurable, so you can code whatever you want wrt different environments.
- The code should read and run in sequential order.
ShutIt demands sequential ordering.
Any questions, please mail me: ian.miell@gmail.com
A means of building complex docker containers.
http://ianmiell.github.io/shutit/
https://github.com/ianmiell/shutit
I got frustrated with Dockerfiles and wanted a similar means of building complex deployments without the declarative complexity of puppet and chef. It's taken off a fair amount in my company since the syntax is so easy to learn and the module level so quick to grasp. There's also a UI :)
http://shutit.tk:8080/
In Ask HN: What projects are you working on?