As a Data Engineer your objective will be to assist in building out Horizon’s data platform.  Utilizing your skills with Python and AWS, you will be tasked with creating automated highly robust and performant data pipelines that will be able to scale with the ever-increasing data needs of data analysts and client teams.  These data pipelines will serve vital business operations such as client reporting, analytics/data science, activation and etc.
 
Job Duties
•          (85%) Build robust and scalable data integration (ETL) pipelines using SQL, EMR, Python and Spark
o          Design solution based on needs gathered after discussing with end users/stakeholders
o          Code/implement solution based on design adhering department best practices and processes
o          Drive solution from initial implementation, testing/QA and final delivery to end users/ stakeholders
o          Maintain delivered solutions in respect to changing requirements or unexpected failures
•          (10%) Collaborate with Software Solution team members and other staff to validate desired outcomes for code prior to, during, and post development
o          Train other technical staff to understand how to access/utilize delivered solution
o          Flesh out test cases and "edge"/outlier cases to test for
•          (5%) Help onboard new engineers
 
Job Requirements
•          Bachelor’s degree in Computer Science or related major from 4 year University is required.  A masters is preferred
•          1+ years experience building data pipelines and implementing feeds for data warehouse
•          Strong communications skills both written and verbal
o          Strong technical understanding to be able to contribute in meetings to discuss best practices and/or technical solutions to business problems
o          Able to communicate effectively with non-technical co-workers and stakeholders.  Be able to explain technical concepts and issues at a level that non-technical people can understand
o          Able to understand requirements and business needs from client teams and stake holders and translate those to technical requirements
•          Python 3
o          Experience utilizing Pandas library to explore, cleanse and standardize data
•          Advanced SQL
•          Code Repository (Github, Bitbucket)
•          Linux/Shell scripting
 
Nice to Haves
•          Experience with Snowflake
•          Experience with Airflow
•          Experience with AWS
o          S3
o          EMR
o          EC2
o          Cloudformation
o          Athena
o          Lambda