Real-time monitoring of Twitter’s network infrastructure with Heron

By Julien Delange, Phd. Software Engineer, Twitter

6:30 arrive, register, pizza, network
7:00 ACM intro
7:10 Presentation
Live stream at https://www.youtube.com/watch?

Abstract:
Twitter users start and join multiple conversations every day, so monitoring and mitigating any potential network issue in real time is the key to a smooth user experience. Monitoring and analyzing a network at Twitter scale is extremely hard—and almost impossible to achieve manually. As a result, the company needed to create dedicated data pipelines to monitor network activity, detect potential issues, and generate network usage reports.

Julien will present an overview of the Heron project. Along the way, you’ll learn the challenges Twitter faced when building it and the key technologies it used to overcome those challenges and achieve its scalability, low-maintenance, and low-latency goals.

Bio:
Julien Delange is a staff software engineer at Twitter working on infrastructure services. Previously, he was a senior software engineer at Amazon Web Services, a senior member of the technical staff at Carnegie Mellon University, and a software engineer at the European Space Agency. Julien holds a PhD in computer science from Télécom ParisTec and a master’s degree in computer science from Université Pierre-et-Marie-Curie.
http://julien.gunnm.org/
https://www.linkedin.com/in/juli1/