Skip to content

Scalding 0.14.0 Released!
Compare
Choose a tag to compare
@jnievelt jnievelt released this 18 May 21:06
· 1275 commits to develop since this release
0.14.0
ca905a2

ExecutionApp tutorial

A new tutorial for ExecutionApp is added in #1196. You can check out ExecutionTutorial.scala for the source.

Simple HDFS local mode REPL

#1244 adds an easy to use useHdfsLocalMode method to the REPL for running hadoop locally. useHdfsMode reverts the behavior.

TypedPipe conditional execution via #make

TypedPipe now exposes the make method for fallback computation/production of an optional store in an Execution. If the store already exists, the computation is skipped. Otherwise, the computation is performed and the store is created before proceeding with execution.

TypedPipeDiff

#1266 adds TypedPipeDiff and helper enrichments for comparing the contents of two pipes.

RichPipe#skewJoinWithSmaller now works

A data bug with the fields API method skewJoinWithSmaller was discovered and fixed. The API should be functionally equivalent to joinWithSmaller now.

See CHANGES.md for the full list of changes.

Assets 2