Scalding: Powerful & Concise MapReduce Programming

Scalding: Powerful & Concise MapReduce Programming

Photo Rob Nikzad
Digital Producer
Member since Nov 22, 2011
Stream Posts: 124
Posted on May 10, 2012 (3 years ago)
Seen 950 times.
Tagged As:
In this presentation to the San Francisco Scala User Group on April 19, 2012, Dr. Oscar Boykin and Dr. Argyris Zymnis from Twitter give us some insight on Scalding DSL and provide some example jobs for common use cases.
 
Twitter uses Scalding for data analysis and machine learning, particularly in cases where we need more than sql-like queries on the logs, for instance fitting models and matrix processing. It scales beautifully from simple, grep-like jobs all the way up to jobs with hundreds of map-reduce pairs.
 
 
Familiar with Java, but new to Scala? Check out this presentation from Marakana's Dan Rosen for a brief introduction and roadmap to the Scala universe.

Comments

You have to login to post a comment.