Brisk - Truly Peer-to-Peer Hadoop

Brisk - Truly Peer-to-Peer Hadoop

Photo Max Walker
NewCircle, Inc.
Member since Sep 29, 2010
Stream Posts: 322
Posted on Jul 14, 2011 (4 years ago)
Seen 4967 times.
Tagged As:
In this presentation given at the San Francisco Java User Group on June 14, 2011, SriSatish Ambati, Chief Java Tinkerer at DataStax is going to show you how to run Hadoop MapReduce on a truly peer-to-peer storage layer powered by Cassandra FS.

Brisk is an open-source Hadoop & Hive distribution that uses Apache Cassandra for its core services and storage. Brisk makes it possible to run Hadoop MapReduce on top of CassandraFS, an HDFS-compatible storage layer. By replacing HDFS with CassandraFS, users leverage MapReduce jobs on Cassandra's peer-to-peer, fault-tolerant and scalable architecture.

With CassandraFS all nodes are peers. Data files can be loaded through any node in the cluster and any node can serve as the JobTracker for MapReduce jobs. Hive MetaStore is stored & accessed as just another column family (table) on the distributed data store. Brisk makes Hadoop truly peer-to-peer.

We demonstrate visualization & monitoring of Brisk using OpsCenter. The operational simplicity of Cassandra's multi-datacenter & multi-region aware replication makes Brisk well-suited for a rich set of Applications and use-cases. And by being able to store and isolate HDFS & online data within the same data cluster, Brisk makes analytics possible without ETL!



Here are SriSatish's slides:


About this Event
This event was presented by the The San Francisco Java User Group on June 14, 2011. Organized by Marakana

Want to Learn More About Java?
Check out some of our training classes, or head to TechTV for more great educational videos on open source topics.








Comments

You have to login to post a comment.