Data Engineer

Job description

**Job Description For Data Engineer** - Strong understanding of data engineering and dimensional design fundamentals, good at SQL, integration (ETL), front-end analysis / data visualization, learns new technologies quickly. - Good understanding of data warehouse schema design and granularity of the data. - Good understanding of data federation techniques and aggregation of data at scale from multiple source systems. - Designing and developing ETL pipelines across multiple platforms and tools including Spark, Hadoop and AWS Data Services. - Gathering functional requirements, developing technical specifications, and project & test planning. - ake it available for analysis. - Support large data volumes and accommodate flexible provisioning of new sources. - As a key member of the team drive adoption of new technologies, tools, and process improvements to build world class analytical capabilities for web analytics, optimization, experimentation and personalization. - Experience in developing DB schemas, creating ETLs pipelines with Spark and familiar with MPP/Hadoop systems. - Must have mastery of data warehousing technologies including data modeling, ETL and reporting. Ideal candidate to have 6+ years of experience in end-to-end data warehouse implementations and at least 2 projects with 4TB+ data volume. - Demonstrated understanding of the Software design and architecture process. - Experience with unit testing and data quality automation checks - Should be results oriented, self-motivated, accountable and work under minimal supervision. - Excellent written, oral communication and presentation Skills. - Education Bachelor's or Master’s degree in Computer Science or equivalent work experience. **Good to have** - Knowledge of Big Data eco system like Hadoop M/R, Pig and Hive is a strong plus. - Conceptual understanding of Machine Learning / LLM / GenAI Usage is a plus. - Good understanding of any reporting tools such as Tableau, QlikSense - Experience in design, development and deployment of one or more tools - ETL (Informatica, OWB, ODI)