Data Engineer 4

Job description

Comcast brings together the best in media and technology. We drive innovation to create the world's best entertainment and online experiences. As a Fortune 50 leader, we set the pace in a variety of innovative and fascinating businesses and create career opportunities across a wide range of locations and disciplines. We are at the forefront of change and move at an amazing pace, thanks to our remarkable people, who bring cutting-edge products and services to life for millions of customers every day. If you share in our passion for teamwork, our vision to revolutionize industries and our goal to lead the future in media and technology, we want you to fast-forward your career at Comcast. Job Summary This role concentrates on advanced data structures and pipelines development and maintenance, upholding quality and integrity in diverse storage solutions. It involves optimizing data flows, mentoring junior engineers, and contributing to internal tool development. The role serves as a key expert, providing strategic guidance and innovative solutions in data engineering. Job Description Freewheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can insert advertisements around the world.  Location: CIEC, Chennai Job Summary  Responsible for designing, building, and optimizing scalable data pipelines and platforms to support analytics, reporting, and downstream applications. Develop data structures, ingestion frameworks, and transformation logic to ensure high-quality, reliable data processing across cloud environments.  Works with large-scale data systems using technologies such as Snowflake, Databricks, and distributed processing frameworks. Ensures strong data quality, governance, and lineage for reliable insights and decision-making.  Collaborates with cross-functional teams to improve data sourcing and processing efficiency, while contributing to architectural standards and best practices. Acts as a key contributor in complex, high-impact environments, leads cross-team initiatives, mentors engineers, and drives improvements in data engineering tools and frameworks.    Job Description  Skills and Experience  • 8–10+ years of experience in Data Engineering or related roles  • Advanced SQL with strong query optimization expertise  • Proficiency in Python (preferred) or similar programming languages  • Experience with distributed computing frameworks (e.g., Apache Spark) or Snowflake  • Proficiency in cloud data warehouse management, workflow orchestration & automation (e.g., dbt, Airflow)  • Experience with at least one cloud platform (AWS, GCP, Azure)  • Experience with data pipeline design patterns, data modeling & data observability  • Experience with Snowflake/Databricks.  • Knowledge of data quality, validation, and monitoring frameworks  • Understanding of data lineage and impact analysis  • Experience with CI/CD implementation and deployment processes  • Core Transition: From Leading to Shaping. Leads cross-team initiatives and establishes best practices    Responsibilities  • Develop data structures and pipelines to standardize and transform data, ensuring insights generation and reporting requirements are met  • Ensure data quality across ingestion, processing, and loading into target tables, maintaining high standards  • Create ingestion frameworks for structured and unstructured data with quality checks and reporting mechanisms  • Establish methods for data consumption by end users and do