What does a data engineer do at Facebook
A data engineer is responsible for developing and maintaining massive data pipelines to store, process, transform and analyze the billions of pieces of content uploaded to Facebook every day. The data engineer is also responsible for building an infrastructure that can scale with massive amounts of growth, and to improve the speed of data processing and analysis.
One of the most famous data engineers at Facebook is Jun Zhang, who oversees the engineering team that builds Facebook’s massive data system and infrastructure. Today, we have an interview with Jun Zhang, who started at Facebook in 2009, left in 2013 and has been back at Facebook since October 2015.
Wang: What was your primary responsibility as a data engineer at Facebook?
Zhang: My primary responsibility was to build a data infrastructure that could scale with massive amounts of growth. I was also responsible for building the data warehouse and data lake.
Wang: What did you learn at Facebook?