wukong old wiki front page

wukong -- old wiki front page

Documentation for wukong lives at "http://mrflip.github.com/wukong":http://mrflip.github.com/wukong and in the repo itself, within the "gh-pages branch.":http://github.com/mrflip/wukong/tree/gh-pages

If you'd like to contribute documentation here, please ping me and I'll integrate it with the gh-pages; or (easier yet) just fork the repo and edit the gh-pages branch.

Go To the Hadoop Documentation

Index (possibly out of date)

• "Install and set up wukong":http://mrflip.github.com/wukong/INSTALL.html

• "Get the code":http://mrflip.github.com/wukong/INSTALL.html#getcode
• "Setup":http://mrflip.github.com/wukong/INSTALL.html#setup
• "Installing and Running Wukong with Hadoop":http://mrflip.github.com/wukong/INSTALL.html#gethadoop
• "Installing and Running Wukong with Datamapper, ActiveRecord, the command-line and more":http://mrflip.github.com/wukong/INSTALL.html#others

• "Tutorial":http://mrflip.github.com/wukong/tutorial.html

• "Count Words":http://mrflip.github.com/wukong/tutorial.html#wordcount
• "Structured data":http://mrflip.github.com/wukong/tutorial.html#structstream
• "Accumulators":http://mrflip.github.com/wukong/tutorial.html#accumulators including a UniqByLastReducer and a GroupBy reducer.

• "Usage notes":http://mrflip.github.com/wukong/usage.html

• "How to run a Wukong script":http://mrflip.github.com/wukong/usage.html#running
• "How to test your scripts":http://mrflip.github.com/wukong/usage.html#testing
• "Wukong Plays nicely with others":http://mrflip.github.com/wukong/usage.html#playnice
• "Schema export":http://mrflip.github.com/wukong/usage.html#schema_export to Pig and SQL
• "Using wukong with internal streaming":http://mrflip.github.com/wukong/usage.html#stayinruby
• "Using wukong to Batch-Process ActiveRecord Objects":http://mrflip.github.com/wukong/usage.html#activerecord

• "Wutils":http://mrflip.github.com/wukong/wutils.html -- command-line utilies for working with data from the command line

• "Overview of wutils":http://mrflip.github.com/wukong/wutils.html#wutils -- command listing
• "Stupid command-line tricks":http://mrflip.github.com/wukong/wutils.html#cmdlinetricks using the wutils
• "wu-lign":http://mrflip.github.com/wukong/wutils.html#wulign -- present a tab-separated file as aligned columns
• Dear Lazyweb, please build us a "tab-oriented version of the Textutils library":http://mrflip.github.com/wukong/wutils.html#wutilsinc

• Links and tips for "configuring and working with hadoop":http://mrflip.github.com/wukong/hadoop-tips.html

• Some opinionated "thoughts on working with big data,":http://mrflip.github.com/wukong/bigdata-tips.html on why you should drop acid, treat exceptions as records, and happily embrace variable-length strings as primary keys.

• Wukong is licensed under the "Apache License":http://mrflip.github.com/wukong/LICENSE.html (same as Hadoop)

• "More info":http://mrflip.github.com/wukong/moreinfo.html

• "Why is it called Wukong?":http://mrflip.github.com/wukong/moreinfo.html#name
• "Don't Use Wukong, use this instead":http://mrflip.github.com/wukong/moreinfo.html#whateverdude
• "Further Reading and useful links":http://mrflip.github.com/wukong/moreinfo.html#links
• "Note on Patches/Pull Requests":http://mrflip.github.com/wukong/moreinfo.html#patches
• "What's up with Wukong::AndPig?":http://mrflip.github.com/wukong/moreinfo.html#andpig
• "Map/Reduce Algorithms":http://mrflip.github.com/wukong/moreinfo.html#algorithms
• "TODOs":http://mrflip.github.com/wukong/moreinfo.html#TODO

• Work in progress: an intro to data processing with wukong:

• "Part 1, Get Ready":http://mrflip.github.com/wukong/UsingWukong-part1-getready.html
• "Part 2, Thinking Big Data":http://mrflip.github.com/wukong/UsingWukong-part2-ThinkingBigData.html
• "Part 3, Parsing":http://mrflip.github.com/wukong/UsingWukong-part3-parsing.html