Data Engineer

Job description

Job Description For Data Engineer • Strong understanding of data engineering and dimensional design fundamentals, good at SQL, integration (ETL), front-end analysis / data visualization, learns new technologies quickly. • Good understanding of data warehouse schema design and granularity of the data. • Good understanding of data federation techniques and aggregation of data at scale from multiple source systems. • Designing and developing ETL pipelines across multiple platforms and tools including Spark, Hadoop and AWS Data Services. • Gathering functional requirements, developing technical specifications, and project & test planning. • ake it available for analysis. • Support large data volumes and accommodate flexible provisioning of new sources. • As a key member of the team drive adoption of new technologies, tools, and process improvements to build world class analytical capabilities for web analytics, optimization, experimentation and personalization. • Experience in developing DB schemas, creating ETLs pipelines with Spark and familiar with MPP/Hadoop systems. • Must have mastery of data warehousing technologies including data modeling, ETL and reporting. Ideal candidate to have 6+ years of experience in end-to-end data warehouse implementations and at least 2 projects with 4TB+ data volume. • Demonstrated understanding of the Software design and architecture process. • Experience with unit testing and data quality automation checks • Should be results oriented, self-motivated, accountable and work under minimal supervision. • Excellent written, oral communication and presentation Skills. • Education Bachelor's or Master’s degree in Computer Science or equivalent work experience. Good to have • Knowledge of Big Data eco system like Hadoop M/R, Pig and Hive is a strong plus. • Conceptual understanding of Machine Learning / LLM / GenAI Usage is a plus. • Good understanding of any reporting tools such as Tableau, QlikSense • Experience in design, development and deployment of one or more tools - ETL (Informatica, OWB, ODI)