| Job Title |
Data Engineer, Digital Data Products |
| Business Segment |
Staff |
| Sub-Business |
Technology |
| Posting Category |
Technology/Engineering |
| About Us |
|
| Career Level |
Intermediate |
| Country |
United States |
| State/Province |
New York |
| City |
New York City |
| Responsibilities |
As the Lead Data Engineer for the Digital Data & Analytics Team you will be responsible for designing, building and managing data pipelines. Our team lands, profiles and stores multiple internal & external datasets and builds applications that surface this data to support our business partners’ strategic decision making. We are an AWS shop that uses open source technologies including Python, Pandas, Spark, Hive, Postgres, Redis MongoDB, Flask, as well as BI tools such as Tableau and MicroStrategy. We work in a very agile environment, where product specifications are flexible and often change rapidly over time. We are seeking people who are comfortable with ambiguity and figuring out technical solutions to business needs
- Contributor to the overall Data Product roadmap by working closely with our business partners to understand their challenges and develop analytical tools to help drive business decisions
- Lead as well as contribute individually to design, develop and maintain solutions that exploit technologies like Big Data on AWS, Tableau, Python technologies, Spark, etc.
- 2+ years experience with AWS technologies. Strong experience using Python and Pandas in an AWS Lambda framework is highly desired. Experience using EMR and/or Databricks
- Must understand basics of relational data modelling. Experience in MemSQL is desired but relevant experience in any of the following is acceptable: Snowflake, MySQL, Redshift, Athena, MSSQL Server, Oracle
- Decent understanding for the digital media business and ad serving technologies with experience working with transactional data
- Educate and inform business partners on architecture, capabilities, best practices and solutions to build out future enhancements
- Assist in analyzing business requirements, source systems, understand underlying data sources, transformation requirements, data mapping, data model and metadata for reporting solutions
- Writing easily understood documentation and architecture diagrams and keeping them up to date as code and frameworks change over time
- Draw from strong technical expertise in Big Data, BI and Database technologies to conduct project code reviews/checkpoints to ensure the quality of deliverables
|
| Qualifications / Requirements |
- Bachelor’s degree in Engineering, Computer Science, Information Systems or related field with 4+ years of relevant experience.
- Strong Computer Science/Engineering/Information Systems background
- 1+ years in Digital Media Publisher, Advertising Industry with a solid understanding of Digital Research
- 2+ Experience in Data Modelling, Data architecture, Data Quality, Metadata, ETL and Data Warehouse methodologies and technologies.
- Experience in any combination of the following: SQL, AWS, Big Data, Linux, MicroStrategy, Tableau, Python, React.js, APIs, Spark, Scala
- Strong problem-solving skills.
- Strong oral and written communication and influencing skills, with the ability to communicate new concepts and drive change in processes and behaviors and to communicate complex technical topics to management and non-technical audiences
|
| Desired Characteristics |
- Experience with various digital platforms such as Omniture, Adobe Analytics, Rentrak/comScore, Operative One, Google DoubleClick, Freewheel, Nielsen, etc
- Ability to design concise and visually appealing reports, user interfaces, mockups and documentation
- Ability to read external API documentation and write pipelines to extract data from our partners’ systems
- Ability to write and stand up internal API endpoints to share data with other internal teams.
- Strong analytical focus, results-oriented and execution driven.
- Ability to work within a cross-functional team environment with people from multiple business units, vendors, countries and cultures.
- Self-driven/self-initiator and resourceful to achieve goals independently as well as in teams and promotes an open flow of information so that all stakeholders are well informed.
- Flexibility to adjust to changing requirements, schedules and priorities.
- Ability to work independently under minimum supervision and proactive in solving issues
- Energetic, committed and solution focused with the ability to perform under pressure and meeting targets
|
