Data Engineer - II (FTC), DAVENGERS(Data Avengers)

Job description

As a data engineer are you looking for opportunity to be among software developers, machine learning scientists to build a data platform that not only caters to BI and reporting but also extends to machine learning applications? As a data engineer in AEE, you will: - Design, implement and support an analytical data infrastructure serving both business intelligence and machine learning applications • Managing AWS resources including EC2,Redshift,EMR-Spark etc - Collaborate with applied scientist to integrate and build data pipeline as necessary for building and training machine learning models in AEE - Collaborate with Product Managers, Financial and Business analysts to recognize and help adopt best practices in reporting and analysis: data integrity, test design, analysis, validation, and documentation - Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL and AWS big data technologies - Explore and learn the latest AWS technologies to provide new capabilities and increase efficiency - Collaborate with other tech teams to implement advanced analytics algorithms that exploit our rich datasets for statistical analysis, prediction, clustering and machine learning - Help continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers