Senior DBT core Data engineer with Python/SQL expertise

Job description

Tredence is a global data science and AI solutions company that bridges the gap between insight delivery and value realization. We operate at the intersection of business expertise, data engineering, and AI to deliver multi-fold ROI for the world's leading retail, CPG, telecom, and healthcare companies. We are expanding our Modern Data Platform practice to design high-performance, real-time analytics layers capable of powering both cloud data warehouses and decentralized data lakehouses. Position Summary - We are looking for a highly skilled Senior DBT Core Data Engineer who excels at turning raw data into high-utility, analytics-ready structures. In this role, your core focus will be driving data transformation efficiency using **dbt Core**, crafting elite-level **SQL**, and architecting robust enterprise **Data Models**. Additionally, you will help design next-generation real-time structures utilizing cutting-edge streaming and open-source lakehouse technologies like RisingWave, Apache Iceberg, and Apache Trino. **Key Responsibilities** - **Core Analytics Engineering**: Design, build, and optimize production-grade data transformation pipelines using **dbt Core** to deliver highly testable and documented analytical models. - **Enterprise Data Modeling**: Architect scalable data models (including Star/Snowflake schemas, One Big Table layouts, and Data Vault) optimized for large-scale enterprise BI and predictive AI consumption. - **Advanced SQL Engineering**: Write, debug, and performance-tune highly complex analytical SQL queries to handle terabyte-scale analytical data sets. - **Modern Lakehouse Implementation**: Collaborate on driving our technical roadmap towards open-source lakehouse architectures using **Apache Iceberg** for transactional storage and **Apache Trino** for fast, federated query execution. - **Real-Time Data Streaming**: Assist in shifting traditional batch transformations into real-time streaming architectures using engines - **Cloud & Automation**: Write clean, modular **Python** code to build custom orchestrations, data quality checks, and utility scripts within cloud environments, primarily **AWS.** **Required Technical Stack (Must Haves)** - ****Advanced SQL**: Master-level proficiency in analytical SQL, window functions, CTE optimization, and query execution plan tuning.** - **DBT Core**: Deep, hands-on production experience writing advanced macros, implementing custom tests, managing state, and configuring complex incremental models. - **Data Modeling**: Strong conceptual and practical grounding in relational modeling, dimensional modeling, and modern lakehouse optimization strategies. - **Experience**: 3 to 9 years of specialized experience in data or analytics engineering environments. **Preferred Technical Stack (Good to Haves)** Familiarity with core cloud infrastructure components (S3, EC2, IAM, Lambda, Glue, or Athena). Streaming Engine: Knowledge of or keen interest in stream-processing databases like **RisingWave** or Apache Flink. Competency in writing script automation, API integrations, or working with data handling libraries. Exposure to modern lakehouse blueprints utilizing **Apache Iceberg** and distributed SQL query engines like **Apache Trino**. **Required Skills** **Required Skills - Python/Advanced SQL, DBT Core, Data Modeling**