Posted on 2025/12/31
AI Data Engineer – Azure & Databricks
Robert Half
Houston, TX, United States
Full Description
About the RoleOur client is seeking an AI Data Engineer to design, build, and optimize data and AI pipelines within a modern Azure Databricks Lakehouse environment.
This role sits at the intersection of data engineering, machine learning enablement, and cloud‑scale analytics, supporting advanced AI initiatives across the organization.
You will work closely with data scientists, ML engineers, and business stakeholders to deliver high‑quality data products, feature pipelines, and production‑ready AI workflows that power predictive analytics, generative AI, and operational intelligenceKey ResponsibilitiesDesign and build scalable data pipelines using Azure Databricks, Spark, and Delta LakeDevelop and optimize ETL/ELT workflows across Azure Data Lake StorageImplement AI‑ready data architectures including feature stores and vector storesProductionize ML and generative AI models using MLflow and Databricks Model ServingCreate and maintain medallion architecture for analytics and AI workloadsDevelop SQL and PySpark transformations for large‑scale datasetsIntegrate Azure services such as Data Factory, Event Hub, and FunctionsEnsure data governance and security using Unity Catalog and RBACMonitor and optimize Databricks clusters for cost and performanceSupport CI/CD automation using Azure DevOps
Find AI, ML, Data Science Jobs By Location
Find Jobs By Position