Data Engineer 3

Job description

Tech stack requirements : Spark, Scala, SQL, AWS, Kafka Job Description Data Engineer 3 What you'll do: - Partners with the business to have a clear understanding of how own technology stack is tied to business outcomes and our bottom line. • Successfully conducts day-to-day work and solves complex issues in own specific technical engineering area. • Advocates efforts to remove tech roadblocks for their team for long term success. • Possesses knowledge of features and facilities for integration, and communication among applications, databases and technology platforms to bring together different components and form a fully functional solution to a business problem. • Has proven ability, experience and advanced knowledge of building and operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets. • Creatively tests and maintains software applications and related programs and procedures by using a variety of software development tools following design requirements of customer. • Justifies technology choices to both technical and non-technical observers. Who you are: 5-7 years software development experience in an enterprise level engineering environment demonstrating increasing levels of technical leadership 5+ years hands-on big data engineering experience with excellent understanding of delivering BI and AI projects Experience architecting, developing, and successfully delivering complex, large-scale systems Fluent in one or more of the following languages: Python, Java, Scala and AWS or equivalent cloud technology Worked in at least in 2 multi-quarter data engineering projects. Worked in decentralized teams and projects. Formally mentored at least 3 individual contributors. Built high-performance scalable data products. Drove technical design end to end of at least 3 data engineering projects.