Posted on 2026/11/17
Practice Architect AI/ML Test
TEKsystems
Austin, TX, United States
Think of TEKsystems Global Services (TGS) as the growth solution for enterprises today.
We unleash growth through technology, strategy, design, execution and operations with a customer-first mindset for bold business leaders.
We deliver cloud, data and customer experience solutions.
Our partnerships with leading cloud, design and business intelligence platforms fuel our expertise.
We value deep relationships, dedication to serving others and inclusion.
We drive positive outcomes for our people and our business, and we stay true to our commitments and act in harmony with our words.
We exist to create significant opportunity for people to achieve fulfillment through career success.
Ready to join us?
Here's what the opportunity supported through our TGS Talent Acquisition Team requires:
We are seeking a Practice Architect to lead the design and delivery of AI-driven quality engineering solutions across client engagements.
You will architect test strategies and frameworks for both traditional and AI-enabled systems, including ML models, GenAI, LLMs, RAG, and agentic applications, and apply AI to transform how testing itself is designed, automated, and governed.
This is a senior, client-facing architecture role.
You will shape solutions and Statements of Work, build reusable AI testing accelerators, guide delivery teams, and advise clients on trustworthy, responsible AI.
KEY RESPONSIBILITIES
Solution Architecture and Practice Leadership
- Architect end-to-end quality engineering solutions and reference architectures for enterprise applications, data platforms, and AI-enabled systems.
- Provide architectural direction across engagements; review designs, set standards, and ensure solutions are scalable, secure, and aligned to client strategy.
- Evaluate and recommend tools, platforms, and AI models based on fit, cost, risk, security, and client constraints.
- Grow the CQ practice by identifying improvement opportunities, defining best practices, and documenting reusable patterns and accelerators.
AI Quality Engineering
- Design testing methodologies for deterministic and non-deterministic systems, covering data quality, model validation, fairness, explainability, hallucination, prompt injection, and safety.
- Define evaluation approaches for GenAI, RAG, and agentic systems, including golden datasets, LLM-as-judge, and human-in-the-loop validation.
- Embed AI quality gates into CI/CD and MLOps/LLMOps workflows, with production monitoring, observability, and feedback loops.
- Define and track AI quality metrics (accuracy, precision/recall/F1, drift, bias indicators, latency, cost).
AI-Driven Testing Accelerators
- Architect and build reusable accelerators using LLMs, copilots, prompt engineering, agentic AI, and test data generation.
- Establish guardrails for AI-assisted delivery: human review, deterministic validation, traceability, and auditability.
Client Advisory and Delivery Leadership
- Serve as a trusted AI quality advisor through workshops, AI quality assessments, solution design, and implementation.
- Lead creation and revision of Statements of Work, estimates, and proposals with clear assumptions, scope, risks, and delivery plans.
- Provide technical leadership and mentorship across delivery teams, scaling AI testing capability and adoption.
- Partner with engineering, data science, product, and security teams to embed quality early and continuously.
REQUIRED QUALIFICATIONS
- 10+ years in software development or quality engineering, or system integration, including at least 5+ years in test architecture or quality engineering leadership.
- Proven track record designing enterprise test strategies, automation architectures, and frameworks for web, API, data, and cloud systems.
- Demonstrated hands-on experience designing and executing testing strategies for AI/ML and GenAI systems (LLMs, RAG, agents), including evaluation methods and quality metrics.
- Expertise in using open-source and commercial AI models, copilots, prompt engineering, and agentic tools to accelerate testing and delivery.
- Strong knowledge of UI and API automation (e.g., Playwright, Selenium, Rest Assured, Karate), CI/CD (GitHub Actions, Azure DevOps, Jenkins), and test management (e.g., Jira Xray, Zephyr, TestRail).
- Familiarity with model evaluation metrics, AI observability, and data validation strategies for data and AI systems.
- Experience shaping Statements of Work, proposals, and estimates in a consulting or client-facing environment.
- Excellent communication, presentation, and executive stakeholder skills; able to explain AI risk and quality trade-offs in business terms.
- Bachelors degree in computer science or a related engineering field, or equivalent experience.
- Ability to travel to the United States or Canada, and satisfactory completion of standard employment eligibility requirements.
PREFERRED QUALIFICATIONS
- AI evaluation: Experience with evaluation frameworks such as DeepEval, Ragas, promptfoo, or Azure AI Evaluator.
- AI platforms: Exposure to MLOps/LLMOps platforms, vector databases, and AI observability tools.
- Specialization: Depth in one or more domains such as performance, ETL/data, security, or accessibility testing.
- Industry: Experience in financial services, healthcare, telecommunications, energy, or other regulated industries.
- Certifications: One AI testing or cloud certification (e.g., ISTQB CT-AI/CT-GenAI, Azure AI Engineer, AWS ML Specialty).
WHAT SUCCESS LOOKS LIKE
- Clients adopt AI-enabled quality solutions with clear, measurable improvements in speed, coverage, and reliability.
- Reusable AI testing accelerators are adopted across multiple engagements.
- SOWs and solutions are well-scoped, delivered predictably, and positioned for expansion.
Job Type & Location This is a Permanent position based out of Austin, TX.
Pay and Benefits The pay range for this position is $128000.00 - $192000.00/yr.
Individual compensation offered for this position within this range will depend on many factors, including but not limited to geographic location, education, experience, knowledge, skills, and abilities.
Compensation decisions are also dependent on the hours worked and may include paid holidays, paid time off, overtime, bonuses, and other incentive opportunities.
We reserve the right to pay above or below the posted wage based on factors unrelated to sex, race, or any other protected classification.
Additional earnings may be available through incentive programs like annual bonuses, profit sharing, and commission.
Our full-time, internal employment benefits include the following: Medical, Dental, and Vision Critical Illness, Accident, and Hospital 401(k) Retirement Plan Pre-tax and Roth post-tax contributions available Life Insurance (Voluntary Life and AD&D for employee and dependents) Short and Long-Term Disability Health Spending Account (HSA) Transportation Benefits Employee Assistance Program Time Off/Leave (PTO, Vacation or Sick Leave)
Application Deadline This position is anticipated to close on Nov 27, 2026.
Workplace Type This is a fully remote position.
About TEKsystems
We're partners in transformation.
We help clients activate ideas and solutions to take advantage of a new world of opportunity.
We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia.
As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change.
That's the power of true partnership.
TEKsystems is an Allegis Group company.
The company is an equal opportunity employer and will consider all applications without regards to race, sex, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.
About TEKsystems and TEKsystems Global Services
We're a leading provider of business and technology services.
We accelerate business transformation for our customers.
Our expertise in IT services, data, digital, cloud, and AI allows us to partner with customers to help them achieve their goals faster, and to transform their business for the future.
We're passionate about our work and believe that building strong relationships, with our people, clients, and partners, is critical to our success.
We're part of the Allegis Group family of companies, a global leader in talent solutions.
We believe that every person has the right to be respected and treated equally, regardless of age, race, color, national origin, religion, sex, gender, gender identity or expression, sexual orientation, pregnancy, disability, genetic information, marital status, protected veteran status, or any other characteristic protected by applicable law.
For details, view a copy of the Allegis Group Equal Opportunity and Affirmative Action Policy here.
The company is an equal opportunity employer and will consider all applications without regard to race, sex, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.
San Francisco Fair Chance Ordinance: Pursuant to the San Francisco Fair Chance Ordinance, for all positions for which a background check may be required, candidates must disclose whether they have been convicted of a felony in the last seven years.
Job candidates will not be obligated to disclose sealed or expunged records of conviction or arrest as part of the hiring process.
Massachusetts Lie Detector: It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment.
An employer who violates this law shall be subject to criminal penalties and civil liability.
Use of Artificial Intelligence (AI): We may use Artificial Intelligence (AI) to support parts of our hiring process, including screening applications, conducting initial interviews, or assessing qualifications.
Where AI is used, final hiring decisions are made by humans.
If you would like to request human review of an AI-based decision, please contact us at TGS-Hiring@TEKsystems.com.
Find AI, ML, Data Science Jobs By Location
Find Jobs By Position