A Billion Rows per Second: Metaprogramming Python for Big Data

A Billion Rows per Second: Metaprogramming Python for Big Data

Authored By: Evan Davis 2 years ago

16837 Page Views

For many companies, understanding what is going on in your business involves lots of data. But, how do you query 10s of billions of data points? How can a company begin to make sense of so much information?

Ville Tuulos, Principle Engineer at AdRoll, a company producing tons of big data, demonstrates how AdRoll uses Python to squeeze every bit of performance out of a single high-end server. They manage it with Numba, a new NumPy aware dynamic Python compiler based on LLVM, and thanks to Python, the system can provide a very expressive and developer-friendly API. Find out more in this informative talk from the San Francisco Python Meetup Group.

If you liked this post you'll probably be interested in these:

0

Comments