< More Jobs

Posted on 2025/12/11

BCG Platinion | Principal Architect - AI (Boston)

Boston Consulting Group (BCG)

Boston, MA, United States

Full-time

Qualifications

  • Technical expert: Drive novel solutions with extensive Technology & AI expertise
  • Knowledgeable: Deep understanding of Technology Architecture and AI Platforms
  • 10+ years of technology consulting or software engineering experience, with 5+ years in architecture discipline
  • Strong foundation in software architecture & distributed systems design
  • Proven experience designing or scaling AI/ML or LLMbased applications
  • Proficiency in Python, JavaScript, TensorFlow, Keras, PyTorch, TypeScript, or Node.js
  • Familiarity with modern AI frameworks: LangChain, LangGraph, Google ADK, Strands, Semantic Kernel, AutoGen, CrewAI, LlamaIndex
  • Understanding of Agentic AI capabilities and tools such as LangChain agents, AutoGen, RAG, memory modules, vector DBs, functioncalling, observability, safety, deployment strategies, and governance
  • Understanding of cloud architecture, data management, and APIbased system integration
  • Integration of agent workflows with enterprise APIs, knowledge bases, and vectorized memory stores
  • Containerization & orchestration: Docker, Kubernetes, Helm, Istio with GPU autoscaling
  • Experience with AI coding tools: Cursor, Replit, Claude code, Codex, etc
  • Experience with vector databases, embeddings, context retrieval, and prompt orchestration patterns
  • Outstanding ability to work creatively, autonomously, analytically in a fastpaced problemsolving environment
  • Superior technical knowledge, engineering rigor, and creative problemsolving
  • Ability to explain complex technology topics to senior executives
  • Ideally, experience with: multiagent systems, RAG, knowledge graph integration, MLOps/LLMOps pipelines, observability, evaluation frameworks, React/Next.js, and consulting or innovation lab experience
  • An agile mindset with vision for business benefits/value
  • Experience with decisionmaking processes in large organizations
  • Strong customer and results orientation
  • Confidence and persuasiveness
  • Experience planning and managing large, complex projects
  • Willingness to travel to client sites significant travel may be required

Benefits

  • Opportunity to work organically across disciplines and across BCG; unified and unrivaled career paths
  • Base compensation: $230,000 USD + discretionary performance bonus and retirement contribution
  • Zerodollar health insurance premiums for employees, spouses, and children
  • $10 copays for doctor visits, urgent care, and generic prescriptions
  • Dental coverage up to $5,000 for orthodontia benefits
  • Vision insurance covering glasses & contact lenses annually
  • Reimbursement for gym memberships and fitness activities
  • Fully vested retirement contributions annually
  • Generous paid time off, including vacation, holidays, and office closure between Christmas & New Years
  • Paid parental leave & other family benefits such as elective egg freezing, surrogacy, adoption reimbursement

Responsibilities

  • Collaborative: Interdisciplinary team player aligning crossfunctional stakeholder groups
  • Systems thinker: Design sophisticated, robust AI solutions to common business problems
  • Comfortable with ambiguity: Navigate undefined paths confidently
  • Change agent: Implement new processes and toolsets across an organization
  • Agile advocate: Leverage agile methodologies strategically
  • Innovative: Envision novel design patterns for emerging technology solutions
  • Strategic partner: Build solutions at the intersection of technology and business with senior stakeholders
  • Cloud platforms: AWS (Bedrock, AgentCore), Microsoft (Azure AI Foundry, Copilot Studio), Google (Vertex AI, ADK, Agentspace)
  • Design and deployment of autonomous & semiautonomous agents across multicloud and hybrid environments

Full Description

Principal Architect AI (BCG Platinion)

Boston Consulting Group (BCG) partners with leaders to tackle challenges; BCG Platinion extends digital excellence across the globe.

This role focuses on architecting nextgeneration intelligent agentic systems.

Locations: Atlanta, Austin, Boston, Brooklyn, Chicago, Dallas, Denver, Detroit, Houston, Miami, Minneapolis, Nashville, Summit, New York, Philadelphia, Pittsburgh, Durham, Washington.

Who We Are

BCG transforms clients through strategy, technology, and design; our teams bring deep industry and functional expertise to spark change across all levels.

About BCG Platinion

BCG Platinion delivers technologydriven solutions at scale, guiding clients from strategy to execution across Architecture, Cybersecurity, Digital Transformation, and more.

What You'll Do

• Collaborative: Interdisciplinary team player aligning crossfunctional stakeholder groups.

• Systems thinker: Design sophisticated, robust AI solutions to common business problems.

• Technical expert: Drive novel solutions with extensive Technology & AI expertise.

• Comfortable with ambiguity: Navigate undefined paths confidently.

• Change agent: Implement new processes and toolsets across an organization.

• Agile advocate: Leverage agile methodologies strategically.

• Innovative: Envision novel design patterns for emerging technology solutions.

• Knowledgeable: Deep understanding of Technology Architecture and AI Platforms.

• Strategic partner: Build solutions at the intersection of technology and business with senior stakeholders.

What You'll Bring

• Bachelor's degree in information technology, business administration, computer science, information systems, or system controls & engineering (Master's degree is a plus).

• 10+ years of technology consulting or software engineering experience, with 5+ years in architecture discipline.

• Strong foundation in software architecture & distributed systems design.

• Proven experience designing or scaling AI/ML or LLMbased applications.

• Proficiency in Python, JavaScript, TensorFlow, Keras, PyTorch, TypeScript, or Node.js.

• Familiarity with modern AI frameworks: LangChain, LangGraph, Google ADK, Strands, Semantic Kernel, AutoGen, CrewAI, LlamaIndex.

• Understanding of Agentic AI capabilities and tools such as LangChain agents, AutoGen, RAG, memory modules, vector DBs, functioncalling, observability, safety, deployment strategies, and governance.

• Understanding of cloud architecture, data management, and APIbased system integration.

• Cloud platforms: AWS (Bedrock, AgentCore), Microsoft (Azure AI Foundry, Copilot Studio), Google (Vertex AI, ADK, Agentspace).

• Design and deployment of autonomous & semiautonomous agents across multicloud and hybrid environments.

• Integration of agent workflows with enterprise APIs, knowledge bases, and vectorized memory stores.

• Containerization & orchestration: Docker, Kubernetes, Helm, Istio with GPU autoscaling.

• Experience with AI coding tools: Cursor, Replit, Claude code, Codex, etc.

• Experience with vector databases, embeddings, context retrieval, and prompt orchestration patterns. Exposure to Pinecone, QDrant, Cosmos DB, Azure Search is a plus.

• Experience with knowledge graphs such as Neo4j & knowledge representation techniques is a plus.

• Exposure to Agentic memory engines such as mem0, Redis Memory, Postgres Memory is a plus.

• Outstanding ability to work creatively, autonomously, analytically in a fastpaced problemsolving environment.

• Superior technical knowledge, engineering rigor, and creative problemsolving.

• Ability to explain complex technology topics to senior executives.

• Ideally, experience with: multiagent systems, RAG, knowledge graph integration, MLOps/LLMOps pipelines, observability, evaluation frameworks, React/Next.js, and consulting or innovation lab experience.

• An agile mindset with vision for business benefits/value.

• Experience with decisionmaking processes in large organizations.

• Strong customer and results orientation.

• Confidence and persuasiveness.

• Experience planning and managing large, complex projects.

• Willingness to travel to client sites significant travel may be required.

Additional Info

What We Offer

• Opportunity to work organically across disciplines and across BCG; unified and unrivaled career paths.

• A unique experience with passionate problemsolvers delivering innovative digital solutions in a supportive environment.

Benefits (U.

S.

Applicants)

• Base compensation: $230,000 USD + discretionary performance bonus and retirement contribution.

• Zerodollar health insurance premiums for employees, spouses, and children.

• $10 copays for doctor visits, urgent care, and generic prescriptions.

• Dental coverage up to $5,000 for orthodontia benefits.

• Vision insurance covering glasses & contact lenses annually.

• Reimbursement for gym memberships and fitness activities.

• Fully vested retirement contributions annually.

• Generous paid time off, including vacation, holidays, and office closure between Christmas & New Years.

• Paid parental leave & other family benefits such as elective egg freezing, surrogacy, adoption reimbursement.

Equal Opportunity Employer

Boston Consulting Group is an Equal Opportunity Employer.

All qualified applicants will receive consideration without regard to race, color, age, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other characteristic protected under law. BCG is an EVerify Employer.

#J-18808-Ljbffr

Zero to AI Engineer Program

Zero to AI Engineer

Skip the degree. Learn real-world AI skills used by AI researchers and engineers. Get certified in 8 weeks or less. No experience required.