Senior Big Data Engineer - Scala
On-Site in Chelmsford, MA
This is a full-time role

Our Ed Tech partner is seeking an experienced Big Data Engineer with Scala and Spark experience who will lead the design, architecture, and development of our backend systems in collaboration with game, data, and devops engineers. You will be responsible for contributing to architecture, design, and development of ETLs, reports, real-time data processing and data preparation for various purposes on AWS cloud infrastructure within an Agile software development life cycle.

You’ll build scalable, efficient and high-performance pipelines/ workflows that are capable of processing large amounts of batch and real-time data.

Your mission:

• 10+ years’ experience in designing and developing enterprise level software solutions.
• Strong programming skills and experience with large volume data processing; must have Scala and/or Spark experience.
• Experience with Amazon cloud computing infrastructure.
• Strong experience with SQL and Relational databases.
• Experience working with the Agile/Scrum methodology.
• Knowledge in stream processing technologies such as the Confluent Platform and Spark Streaming.