NewCircle Developer Stream
Stream is a constantly updated source of free, educational content on open source development. Also, check out our bookshelf for in-depth tutorials.
In this article, I am going to show how to identify some common Spark issues the easy way: by looking at a particularly informative graphical report that is built into the Spark Web UI – the Web UI Stage Detail view.
A close look at the ways Spark ML models can be put into production, which patterns work best in which situations, and why.
Learn some key performance patterns and anti-patterns that will help you get the most out of Spark 2.0.
A hands-on tutorial using Spark SQL and DataFrames to retrieve insights and visualizations from datasets published by the City of San Francisco.
In this intermediate-level tutorial, I'll address the question of which Apache Spark APIs to use, with a series of brief technical explanations and demos that highlight best practices, latest APIs, and new features in Spark 2.0.
Watch every talk from the 6th annual Northeast Scala Symposium
In this tour from QCon SF, I’ll show you Spark's ability to rapidly process Big Data. I'll demonstrate extracting information with RDDs, querying data using DataFrames, visualizing and plotting data, and show you how to create a machine-learning pipeline with Spark-ML and MLLib. We'll also discuss the internals which make Spark 10-100 times faster than Hadoop MapReduce and Hive.
Video covering Spark Streaming from my presentation at the Philly Area Scala Meetup.
Video and slides from my full-day Apache Spark workshop training at Spark Summit 2015
Rúnar Bjarnason calls the Interpreter Pattern "a classic object-oriented design pattern that has been overlooked by far too many for far too long. At NE Scala, he gives "this unsung hero the accolades it deserves."
Erik Osheim talks about intervals, explains how algebraic type classes support arithmetic over a wide range of types, and demos how intervals can be used in the place of Ranges, Sets, and Loops.
Josh Suereth’s talk for NE Scala is about “Selfish UIs,” a concept that begins with making software for yourself, in order to improve your ability to make software for other people.
Today, according to Dean Wampler, Scala has successfully taken over the Big Data world. This is a talk about why.
In this talk for NE Scala, Neville presents how Scala Macros can be used to improve data pipeline code levering Parquet, Avro, Scalding and Spark.
Marconi Lanna explains how to define and use F-bounded types in Scala, enlisting the compiler to enforce advanced trait semantics, while greatly reducing and simplifying unit tests.
Owein Reese wants you to be more comfortable with dependent types / path-dependent types, to understand them in more detail, and to spark ideas that generally help us gain insights into our every day code.
Typically, when implementing numeric algorithms, common wisdom suggest that between speed, correctness, or simplicity, you can choose only 2. But, is it possible to have all 3?
Understanding type inference can be tricky... even for experts in Scala. Jon Pretty does his best to clear up some of the confusion and questions.
Let's understand the basics of how Hadoop, and HDFS, works with the help of one our favorite childhood toys.
Dick Wall is on a mission to make positive changes to the Scala language. This talk outlines his ideas on how to make contributing easier, more fun, and a generally better experience
A comparison of the approaches to functional error handling taken by Scalaz and Scalactic.
Service-oriented architecture looks good in theory, as boxes and lines on a whiteboard, but how does it work in practice?
A talk on Akka HTTP, which according to Mathias Doenitz, "takes reactive high-performance web interactions to the next level."
NE Scala comes to Boston, 13 incredible talks came out.