Lead Data Engineer

Job description

In-depth working experience of distributed systems Hadoop, Spark, Hive, DBT and Airflow/Dagster At least 5 years of solid production quality coding experience in data pipeline implementation in Python Experience working with public cloud platforms, preferably AWS Experience working with Databricks and/or Snowflake Experience in Git, JIRA, Jenkins, shell scripting Familiarity with Agile methodology, test-driven development, source control management and test automation Experience supporting and working with cross-functional teams in a dynamic environment You have excellent collaborative problem solving and communication skills and are empathetic to others You have a track record of building fast, reliable, and high-quality data pipelines