references

dataflow -- Reference Sources for design of Dataflow and Workflow system

Rake
- Rake Docs
- Rake Tutorial by Jason Seifer -- 2010, with a good overview of why Rake is useful
- Rake Tutorial by Martin Fowler -- from 2005, so may lack some modernities
- Rake Tutorial -- from 2005, so may lack some modernities
Rake Examples
- resque's redis.rake and resque/tasks
- rails' Rails Ties
Thor
- Thor Wiki
Chef
- Chef Wiki
- specifically, Chef Resources
Other
- Gradle -- a modern take on ant + maven. The Gradle overview states its case.

Esper
- Must read: StreamSQL Event Processing with Esper
- Esper docs
- Esper EPL Reference
Storm
- A Storm is coming: more details and plans for release
- Storm: distributed and fault-tolerant realtime computation -- slideshare presentation
- Storm: the Hadoop of Realtime Processing
Kafka: LinkedIn's high-throughput messaging queue
- Kafka's Design: Why we built this
ZeroMQ: tcp sockets like you think they should work
- ZeroMQ: A Modern & Fast Networking Stack
- ZeroMQ Guide
- ZeroMQ: An Introduction
- Routing with Ruby & ZeroMQ Devices
- Ruby bindings for ZeroMQ and the Ruby-FFI bindings
- Learn ruby ZeroMQ by @andrewvc
Other
- Infopipes: An abstraction for multimedia streamin Black et al 2002
- Yahoo Pipes
- Yahoo Pipes wikipedia page
- Streambase -- Why is is so goddamn hard to find out anything real about a project once it gets an enterprise version? Seriously, the consistent fundamental brokenness of enterprise product is astonishing. It's like they take inspiration from shitty major-label band websites but layer a whiteout of web jargon bullshit in place of inessential flash animation. Anyway I think Streambase is kinda similar but who the hell can tell.
- Scribe
- Splunk Case Study

DripDrop - a message passing library with a unified API abstracting HTTP, zeroMQ and websockets.