node-chimera

Also see https://github.com/deanmao/node-chimera

Author here (spikebrehm). Good question. Yep, you could accomplish something similar by booting up PhantomJS or node-chimera [0] and scraping yourself, but that seems hacky and hard to scale. Justin Tulloss of Rdio talked about this approach in his Airbnb Tech Talk [1], saying that the tricky part is determining when the page is actually done rendering, especially if you have a bunch of JavaScript that's performing DOM manipulation. [0] https://github.com/deanmao/node-chimera [1] https://www.youtube.com/watch?v=TB-l2nF67iU

The github project does have examples in standard javascript as well: https://github.com/deanmao/node-chimera/blob/master/example....

Great project. The biggest question for me when I'm using phantomjs is why phantomjs is trying to replicate nodejs infrastructure. For example, phantomjs has an HTTP server feature for processing incoming requests. This doesn't make sense to me because a browser shouldn't be a server. If you need to get information out of the worker, you should POST it somewhere. The proclivity of phantomjs users to prefer stdout is astounding. It's definitely the #1 question or issue that I get fielded in #phantomjs on freenode. For example, for POSTing and reading from redis/resque I wrote this (proof of concept, not what's in production): https://gist.github.com/000037f472b72d9490a6 A few thoughts.. > There are similar "glues" like phantomjs-node that integrate phantomjs by > spawning a process, and processing the stdout stream, but it is limit