Senior Data Engineer

Job description

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. The Data Engineering Team Our Data Engineering team is part of the Technology Data & Intelligence organization, on a mission to accelerate Okta’s scale and growth. We focus on building platforms and capabilities utilized across the organization by sales, marketing, engineering, finance, product, and operations. You will be part of a team performing detailed technical designs, development, and implementation of applications using cutting-edge technology stacks. The Senior Data Engineer Opportunity As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable solutions. This role involves collaborating with data engineers, analysts, scientists, and other engineers to ensure data availability, integrity, and security. You will play a critical role in preparing Okta for its AI-driven future by building stable data layers and partnering with Analytics Engineers to power our AI/ML systems. What you’ll be doing • Design and Develop Scalable Platforms: Build and maintain scalable data platforms using AWS, Snowflake, dbt, and Databricks. • Infrastructure as Code: Utilize Terraform to manage infrastructure as code, ensuring consistent and reproducible environments. • CI/CD Management: Develop and maintain CI/CD pipelines for data platform applications using GitHub and GitLab. • AI/ML Infrastructure: Engineer robust data pipelines that fuel high-performance AI and ML models by delivering reliable, feature-rich datasets. • Data Governance & Strategy: Implement comprehensive data governance frameworks to ensure data lineage, compliance, and quality across all analytical platforms. • Security & Compliance: Conduct vulnerability scans, apply necessary patches, and ensure data security meets industry standards. • Innovation: Explore cutting-edge tools like "data engineer agents" to automate routine tasks and free up time for high-leverage, custom pipelines. • Cross-Functional Collaboration: Partner with product managers, UX designers, and other developers to deliver end-to-end solutions. What you’ll bring to the role • Education: BS in Computer Science, Engineering, or another quantitative field of study. • Experience: 5+ years of professional experience in a data engineering or full-stack role. • SQL & ETL Mastery: Expert-level knowledge of SQL, ETL tools such as Airflow and dbt, and relational/columnar MPP databases like Snowflake or Redshift. • <span style="font-family: arial, helve