< More Jobs

Posted on 2026/11/21

Data Engineer (AI-Ready Data)

Swift Hire LLC

Raleigh, NC, United States

Contractor

Job Title: Data Engineer (AI-Ready Data)

Location: US: East Coast (RTP preferred)

Job Description

We are looking for a hands-on Data Engineer to design, build, and maintain data pipelines that transform raw application data into clean, structured, AI-ready datasets.

The ideal candidate will have strong experience with AWS Glue, PostgreSQL, data modeling, and ETL/ELT pipelines.

The role involves defining relationships between different data entities and preparing curated datasets that enable AI assistants to answer business and analytical questions accurately and consistently.

Key Responsibilities • Design, build, and maintain data pipelines to transform raw application data into clean, structured, AI-ready datasets.

• Develop and manage AWS Glue jobs for data extraction, transformation, and loading.

• Model and document relationships between entities, including Customer-to-Orders relationships.

• Build curated datasets and views to support AI-driven analytical queries.

• Design and optimize PostgreSQL schemas, queries, and indexes.

• Implement data quality checks, validation rules, and monitoring.

• Add business context to data through metadata, naming conventions, descriptions, and semantic layers.

• Collaborate with AI engineers to understand data requirements and consumption needs.

Required Qualifications • Must have 6+ years exp in USA.

• Hands-on experience with AWS Glue jobs (Must Have).

• Strong hands-on experience with PostgreSQL (Must Have), including advanced SQL, joins, aggregations, and window functions.

• Experience preparing and transforming application data for AI/ML or analytics use cases.

• Strong understanding of data modeling and entity relationships, including identifying correlations across entities.

• Experience building and maintaining production ETL/ELT pipelines.

• Strong analytical skills and ability to translate business questions into data structures and queries.

Winning Qualifications • Experience with Python or PySpark for data transformation.

• Familiarity with AWS services such as S3, Athena, Redshift, Lambda, and Step Functions.

• Experience preparing data for LLM or RAG-based applications, including text-to-SQL, semantic layers, or knowledge graphs.

• Experience with data quality, observability, and data cataloging tools.

• Understanding of data governance, security, and PII handling.

• Experience working with AI or analytics teams.