Data Engineer 2

Job description

JLL empowers you to shape a brighter way.   Our people at JLL are shaping the future of real estate for a better world by combining world class services, advisory and technology for our clients. We are committed to hiring the best, most talented people and empowering them to thrive, grow meaningful careers and to find a place where they belong.  Whether you’ve got deep experience in commercial real estate, skilled trades or technology, or you’re looking to apply your relevant experience to a new industry, join our team as we help shape a brighter way forward.    About the Role We are looking for a Data Engineer II with hands-on data engineering experience and a growing passion for Agentic AI to join our Azara Data & AI Engineering team at JLL Technologies. You will build and maintain data pipelines, transformation workflows, and data services that power Azara, our AI-driven data intelligence platform for commercial real estate — while actively developing AI-augmented and agentic capabilities to make those workflows smarter, self-healing, and more autonomous. This role is ideal for a data engineer who wants to go beyond traditional pipelines and apply Agentic AI to real-world data engineering challenges at enterprise scale. Key Responsibilities Data Engineering & Pipeline Development • Design, build, and maintain scalable data ingestion, transformation, and serving pipelines using Python and PySpark on Databricks • Develop data services and APIs (FastAPI) that expose curated data assets to downstream applications and AI services • Write and optimize SQL for data transformation, aggregation, and quality validation across large-scale datasets • Implement pipeline monitoring, alerting, and data quality checks to ensure reliability and SLA compliance • Manage data workflows using orchestration tools (Azure Data Factory, Airflow, or Databricks Workflows) Agentic AI Integration • Build AI agents that automate data engineering tasks such as self-healing pipelines, anomaly detection, and automated data quality remediation • Develop agentic workflows using LangGraph or LangChain that integrate with data platforms and enterprise data sources • Implement LLM-powered natural language to data query capabilities (e.g., Databricks Genie-style interactions) for data access layers • Integrate LLM APIs (Azure OpenAI) into data services for intelligent data enrichment, classification, and summarization • Collaborate with AI engineers to deploy RAG pipelines that leverage data assets as knowledge sources for agent workflows Data Platform & Cloud Infrastructure • Build and maintain data models, Delta Lake tables, and lakehouse architecture components on Databricks and Azure • Implement data access patterns, caching (Redis), and partitioning strategies for efficient data serving • Develop event-driven data workflows using Azure Service Bus and Dapr for real-time pipeline triggers • Assist in distributed task processing (Celery) for scalable, async data workloads • Contribute to CI/CD pipelines and infrastructure-as-code for data platform components Quality & Engineering Practices • Write unit tests and integration tests (pytest) for pipeline logic, data transformations, and AI-integrated components • Participate in code reviews with attention to data quality, pipeline reliability, and AI-specific concerns (hallucination, cost, prompt safety) • Implement structured logging and observability for pipeline health and AI workflow performance • Follow data governance, security, and compliance practices for enterprise data handling Collaboration & Growth • Collaborate with senior data engineers, AI engineers, and product managers in an Agile environment • Document data models, pipeline design decisions, and agentic workflow patterns • Participate in GenAI knowledge-sharing sessions and actively upskill in emerging Agentic AI frameworks and techniques • Progressively take ownership of data domains and pipeline components with increasing independence Required Qualifications • 3–5 years of professional data engineering experience with strong proficiency in P