5+ years of experience in a Data Engineer role
- degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.
○ Experience with big data tools: Hadoop, Spark, Kafka, etc.
○ Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
○ Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
○ Experience with AWS cloud services: EC2, ECS, RDS, Redshift
○ Experience with stream-processing systems: Storm, Spark-Streaming, etc.
○ Experience with object-oriented/object function scripting languages: Python, etc