Generative AI Data Scientist (Palantir - Must Have)

Qualifications

• 10+ years in Data Science / Machine Learning, with at least 3 years leading teams and hands-on experience in LLMs / Generative AI on enterprise platforms like Palantir
• Proven track record delivering AI solutions from concept to production, including ontology design, pipeline orchestration, and Workshop deployment
• Strong proficiency in Python and ML/AI frameworks (Transformers, LangChain, PyTorch, TensorFlow, Hugging Face), integrated into Foundry Code Workbooks and AIP logic
• Experience with LLMs (e.g., GPT-4, Claude, Mistral, LLaMA) and GenAI ecosystems (LangChain, LlamaIndex, PromptFlow)
• Knowledge of embedding models, semantic search, and vector databases, with practical Foundry integration experience
• Familiarity with MLOps practices, particularly in hybrid cloud environments involving Palantir
• Strong leadership, people management, and stakeholder management skills
• Excellent communication skills with the ability to influence technical and non-technical audiences, especially in Foundry governance and data stewardship contexts

Responsibilities

• We are seeking a highly skilled and visionary Data Science Manager with deep expertise in Generative AI and Palantir Foundry/AIP to lead our AI initiatives
• In this role, you will architect and operationalize enterprise-grade GenAI solutions, including LLM-based applications, RAG pipelines, and model fine-tuning workflows
• You will mentor a team of data scientists and engineers while collaborating with cross-functional stakeholders to deliver transformative AI products across Foundry environments
• Lead and mentor a team of data scientists in designing, building, and deploying Generative AI solutions using Palantir Foundry, Ontology, Object Types, and AIP logic
• Define the roadmap and strategy for GenAI adoption in AIP, ensuring alignment with business objectives
• Oversee fine-tuning and adaptation of foundation models using Foundry-integrated pipelines, including custom training datasets and model evaluation workflows
• Design and implement scalable Retrieval-Augmented Generation (RAG) pipelines using AIP Logics and Foundry Code Workbooks, integrating embedding models and vector databases (FAISS, Pinecone, ChromaDB)
• Establish best practices for prompt engineering, model evaluation, and bias mitigation within Foundry governance and audit frameworks
• Collaborate with product, engineering, and MLOps teams to deliver end-to-end AI workflows and integrate GenAI outputs into Workshop applications, APIs, and dashboards
• Monitor and apply emerging trends in LLMs, transformers, and GenAI to continuously innovate Foundry-native implementations
• Represent the Data Science team in leadership forums, communicating technical concepts and business impact effectively

Full Description

Job Title: Manager – Generative AI Data Scientist (Palantir – Must Have)

Location: Atlanta, GA | Hybrid (3–4 days onsite)

Job Overview:

We are seeking a highly skilled and visionary Data Science Manager with deep expertise in Generative AI and Palantir Foundry/AIP to lead our AI initiatives.

In this role, you will architect and operationalize enterprise-grade GenAI solutions, including LLM-based applications, RAG pipelines, and model fine-tuning workflows.

You will mentor a team of data scientists and engineers while collaborating with cross-functional stakeholders to deliver transformative AI products across Foundry environments.

Key Responsibilities:

• Lead and mentor a team of data scientists in designing, building, and deploying Generative AI solutions using Palantir Foundry, Ontology, Object Types, and AIP logic.

• Define the roadmap and strategy for GenAI adoption in AIP, ensuring alignment with business objectives.

• Oversee fine-tuning and adaptation of foundation models using Foundry-integrated pipelines, including custom training datasets and model evaluation workflows.

• Design and implement scalable Retrieval-Augmented Generation (RAG) pipelines using AIP Logics and Foundry Code Workbooks, integrating embedding models and vector databases (FAISS, Pinecone, ChromaDB).

• Establish best practices for prompt engineering, model evaluation, and bias mitigation within Foundry governance and audit frameworks.

• Collaborate with product, engineering, and MLOps teams to deliver end-to-end AI workflows and integrate GenAI outputs into Workshop applications, APIs, and dashboards.

• Monitor and apply emerging trends in LLMs, transformers, and GenAI to continuously innovate Foundry-native implementations.

• Represent the Data Science team in leadership forums, communicating technical concepts and business impact effectively.

Required Skills & Experience:

• 10+ years in Data Science / Machine Learning, with at least 3 years leading teams and hands-on experience in LLMs / Generative AI on enterprise platforms like Palantir.

• Proven track record delivering AI solutions from concept to production, including ontology design, pipeline orchestration, and Workshop deployment.

• Strong proficiency in Python and ML/AI frameworks (Transformers, LangChain, PyTorch, TensorFlow, Hugging Face), integrated into Foundry Code Workbooks and AIP logic.

• Experience with LLMs (e.g., GPT-4, Claude, Mistral, LLaMA) and GenAI ecosystems (LangChain, LlamaIndex, PromptFlow).

• Knowledge of embedding models, semantic search, and vector databases, with practical Foundry integration experience.

• Familiarity with MLOps practices, particularly in hybrid cloud environments involving Palantir.

• Strong leadership, people management, and stakeholder management skills.

• Excellent communication skills with the ability to influence technical and non-technical audiences, especially in Foundry governance and data stewardship contexts.