Here is what we are looking for:
- Spark, Spark Streaming, Java experience. Scala is a plus; Exposure to Python a plus as well.
- Kafka w/exposure to cloud tech like Google PubSub, AWS Kinesis, or Azure Event Hub
- Hands on big data development; we’re not looking for data engineers but individuals that have developed robust big data applications
- Database technology: PostgreSQL (Google CloudSQL), HBase, Google BigQuery (or equivalent), Google BigTable (or equivalent)
- Understanding of AVRO, Schema Registries, Schema Evolution techniques
- Experience porting existing platforms to cloud native solutions
- Experience in making improvements to applications to address performance and scalability
- Problem solvers; Ability to think ahead about the issues that they may encounter and have the ability to work contingency plans to get through them and/or address them before they become a problem; Know when they are hitting a roadblock and communicate out quickly and effectively to their team and leadership so the issue can be addressed
- Independent but able to work closely with a geographically disperse team