Role : Senior AI Test Engineer (API & AI Validation)

Location: Houston, TX- Onsite

## Job Summary

We are seeking an experienced Senior AI Test Engineer with 10–12 years of experience in Quality Engineering, including hands-on expertise in API testing and AI application validation. The ideal candidate should have strong experience testing AI/LLM-powered applications, validating REST APIs, designing automation frameworks, and ensuring the quality, reliability, security, and performance of modern AI-enabled systems.

This role requires a blend of traditional testing expertise and knowledge of AI-specific validation techniques, including prompt testing, model evaluation, hallucination detection, and retrieval validation.

## Key Responsibilities

- Define and implement end-to-end test strategies for AI-enabled applications.
- Design and execute comprehensive test plans for Generative AI, LLM, RAG, and AI Agent workflows.
- Perform functional, integration, regression, system, and UAT testing.
- Validate RESTful APIs using tools such as Postman, Swagger, REST Assured, or similar frameworks.
- Develop and maintain API automation frameworks.
- Validate AI model responses for accuracy, relevance, consistency, hallucinations, bias, and toxicity.
- Test prompt engineering scenarios and optimize prompt quality.
- Validate Retrieval-Augmented Generation (RAG) pipelines and vector search accuracy.
- Verify AI guardrails, content moderation, and responsible AI compliance.
- Perform database validation using SQL.
- Conduct performance and load testing for APIs and AI services.
- Collaborate with Product Owners, Architects, Data Scientists, ML Engineers, and Developers.

Thanks & Regards Madhu Challa

Sr. Technical recruiter Propelsys Technologies | 4975 Preston Park Boulevard, Suite 70 West

Plano, TX 75093

E: madhu@propelsys.com

## About Gramian

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

## About the Role

We are seeking AI Personalization Raters based in Canada to support Gemini Personalization Evals. In this role, you will assess how effectively AI models retrieve and use relevant context from connected Google applications, including Gmail, Google Calendar, Google Drive, and Google Photos. You will evaluate accuracy, relevance, helpfulness, and personalization quality while providing structured feedback to support model improvements.

This opportunity is suitable for detail-oriented individuals with strong analytical thinking, excellent written communication, and active use of Google applications.

## Engagement Details

CONTRACT: Contractor

LOCATION: Remote — Canada only

COMMITMENT: Minimum 4 hours per day, up to 40 hours per week

TIME OVERLAP: 4 hours of overlap with PST

DURATION: Up to 16 weeks

## Key Responsibilities

- Evaluate AI-generated responses using personalized prompts and information retrieved from connected Google applications.
- Assess whether responses are relevant, accurate, helpful, and appropriately personalized.
- Identify incorrect personalization, unsupported assumptions, irrelevant recommendations, and inconsistencies.
- Compare multiple AI-generated responses and assess their overall user experience.
- Provide clear, detailed, and well-reasoned evaluation feedback.
- Follow project guidelines to ensure consistent and high-quality ratings.
- Identify subtle strengths and weaknesses in AI-generated responses.
- Maintain data privacy and comply with project confidentiality requirements.

## Requirements

- Currently based in Canada.
- Willing and able to connect relevant Google applications to Gemini, subject to required permissions and consent.
- Active use of Google Workspace or consumer Google apps, with sufficient personal data or history to support personalized retrieval evaluations.
- Strong analytical thinking and attention to detail.
- Excellent written English and ability to provide structured feedback.
- Ability to work independently in a remote environment.
- Access to a desktop or laptop with a reliable internet connection.
- Bachelor’s degree or equivalent practical experience in any field.

DataAnnotation is looking for an experienced UX/UI Designer - AI Trainer to evaluate how frontier AI models handle real visual design work: interfaces, layouts, typography, and visual systems. You bring the eye you have already built over a career of shipping design. We bring design problems the models cannot yet solve on their own.

In this role, you will design a challenging, realistic brief drawn from your own practice - a landing page, a pitch deck, a data visualization, a poster, a motion piece - then run it through frontier AI design tools and evaluate what comes back against a professional standard.

This is a new and growing area for our company, focused on teaching AI to better understand visual and design principles. These projects span UI/UX critique, product visuals, and aesthetic evaluation, including presentations and creative deliverables. Your taste, your craft standards, and the written rationale behind them become the signal that shapes the next generation of design tools.

## Advantages of contracting with us:

- You will be able to choose which projects you want to work on and when.
- You work on your own schedule, on your own computer, from the comfort of your own home.
- Projects are paid hourly up to $75-$125 USD per hour, with bonus rates available on some projects.

## Responsibilities:

- Design challenging, realistic design briefs drawn from your own professional expertise.
- Run those briefs through frontier AI design tools and evaluate the output against the standard you would hold a colleague to.
- Compare two model versions on identical prompts and assets, and make the call on which performed better and where each fell short.
- Critique model-generated interfaces, mockups, layouts, slides, infographics, illustrations, and motion.
- Flag concrete failures with evidence: alignment and spacing, content overflow and cutoff, typography, visual hierarchy, SVG and illustration quality, ignored assets, off-brief interpretation.
- Contribute across software and interactive work, office and presentation design, technical illustration, graphic design, and new media.

## Qualifications:

- Fluency in English (native or bilingual level).
- Background in UI/UX design, web design, product design, or graphic design.
- Strong understanding of visual hierarchy, layout, typography, interaction design, and user flow.
- The ability to articulate why a design fails, not only that it does.
- Working comfort with AI design tools, or the ability to pick them up quickly.
- A current, in progress, or completed Bachelor's is preferred but not required.

Note: Payment is made via PayPal. We will never ask for any money from you. PayPal will handle any currency conversions from USD. Only applicants in Australia, Canada, Ireland, New Zealand, the United Kingdom, and the United States will be considered for this role. This is an independent contractor position.

Salesforce / HubSpot Administrator – Revenue Systems (SaaS)

Role Type: Contractor
Location: Remote

We are seeking experienced Salesforce / HubSpot Administrators – Revenue Systems (SaaS) to support a customer project focused on operational excellence across CRM and revenue systems.

You'll use your CRM expertise to evaluate real-world SaaS operations, resolve data and process inconsistencies, and help improve how AI systems understand complex business workflows. No prior AI experience is required.

## Scope of Work

- Audit CRM and integrated revenue systems for inconsistencies, outdated policies, duplicate records, and automation issues.
- Analyze policy conflicts and determine appropriate business rules.
- Review and reconcile data across CRM and connected platforms.
- Create clear operational prompts and documentation for complex SaaS scenarios.
- Document recommended system changes and operational decisions.
- Assess the impact of CRM changes on billing, CPQ, ticketing, and other integrated tools.
- Provide insights on CRM optimization, system design, and sustainable governance.

## Preferred Qualifications

- 4–6 years of hands-on experience with Salesforce, HubSpot, Microsoft Dynamics 365, or similar CRM platforms.
- Experience leading CRM implementations, migrations, consolidations, or rollouts.
- Strong knowledge of fields, objects, flows, validation rules, automation, and permissions.
- Experience with at least two revenue or operational systems such as billing, CPQ, ticketing, or integration platforms.
- Working knowledge of SQL, APIs, data models, and cross-system data reconciliation.
- Experience working in SaaS environments.
- Excellent written and verbal English communication skills.

Build the Physical AI platform from scratch, at a business that already has everything else in place.

This role does not exist yet. You create it. That means the architecture is yours, the operating model is yours, and the decisions that define how this business competes in the AI era are yours to make. You are not stepping into someone else's blueprint.

The company is profitable, globally scaled and has a substantial engineering organisation spread across multiple countries. Blue-chip industrial customers, tier-one AI partnerships and world-class hardware engineering are already in place. The foundation is built. You put the AI layer on top of it.

The business is being restructured around this shift right now. That means you shape how the organisation operates rather than arriving after the structure has already been set. You get the autonomy of a startup with the advantage of a vast installed base and decades of customer trust already behind you.

Backing comes from an ambitious technology investor with the capital and conviction to lead this market, not simply participate in it.

Your background is in AI applied to physical systems, spanning perception, planning and control. You have delivered mission-critical, safety-relevant systems at industrial scale and you have built and scaled large, globally distributed engineering organisations. You hold yourself well at board and C-suite level, including in front of customers and partners. You hold an MSc or PhD in AI, robotics, computer science or engineering.

This is a role for someone who has operated at the top of the field and wants the biggest possible canvas to work on.

Ready to define what Physical AI looks like at global scale?

Get in touch.

No up-to-date CV required.

This a Full Remote job, the offer is available from: North America, Canada

## Company Background

Censys’ mission is to be the one place to understand everything on the internet. Frustrated by the lack of trustworthy Internet intelligence, we set out to create the industry’s most comprehensive, accurate, and up-to-date map of the Internet. Today, Censys delivers real-time Internet intelligence and actionable threat insights to global governments, over 50% of the Fortune 500, and leading threat intelligence providers worldwide.

At Censys, we’re on a mission to provide best in class internet visibility and intelligence to the global security community. Our platform helps security teams uncover hidden threats, gain actionable insights, and build proactive defense strategies. Trusted by organizations worldwide, Censys cuts through the noise to surface the most critical risks, enabling teams to respond faster, and stay ahead of attackers. We’re constantly pushing the boundaries of what’s possible to help our customers see and secure the internet more clearly than ever before.

## Location:

This position is remote within the United States or Canada.

## Role Summary:

Censys is seeking a Senior Software Engineer to join our SOC/TH team focused on AI and LLMs. The SOC-TH team builds intelligence-driven investigation workflows on top of the Censys Platform, helping analysts, threat hunters, detection engineers and incident responders triage, identify, analyze, and monitor malicious infrastructure at internet scale. We are defining Censys as the internet intelligence layer for the modern SOC by delivering deep third-party enrichments and real-time adversary infrastructure visibility to analysts in a single pane.

The team transforms global internet scan data, threat intelligence, into AI-powered actionable insights. You'll work closely with product and across engineering teams dedicated to understanding customers’ business needs and to translate complex requirements into well-architected AI enabled interactions within our platform. By fostering a culture of learning and cross collaboration, we aim to build secure infrastructures tailored to our customers' unique requirements. You’ll help shape how the world sees the Internet building AI-powered experiences that make Censys platform smarter, sharper and more intuitive to explore every signal and threat.

## What You’ll Do:

- Rapidly prototype and deploy AI-powered features to enhance search, improve recommendations, and automate workflows across the Censys Platform.
- Apply machine learning to streamline workflows, personalize experiences, and surface critical insights
- Develop and fine-tune LLMs and RAG pipelines to reason over Internet-scale data, summarize findings, and deliver context-aware insights.
- Build, scale and maintain AI-driven analytics and automation systems helping users make faster, data-backed decisions
- Collaborate with frontend, product, and data engineering teams to integrate AI-native experiences that feel seamless, intuitive, and secure
- Continuously evaluate and improve model performance through RAGAS, LangSmith, and automated regression testing frameworks

## What You’ll Bring:

- 5+ years of software engineering experience, including 2+ years building and scaling AI-powered user-facing features
- Strong proficiency in Python for backend and API services development
- Familiarity with RAG evaluation frameworks (e.g., RAGAS, LangSmith) and designing regression testing for LLM pipelines
- Ability to rapidly prototype, validate and refine AI features in a fast-paced, experiment-driven environment
- Prior knowledge in prompt engineering improving LLM accuracy, reasoning and consistency
- Understanding secure and responsible AI practices, implementing guardrails and safety checks to prevent misuse or data exposure
- Hands-on experience with CI/CD pipelines, test automation, and deployment best practices for AI applications.
- Strong cross-team collaboration to ensure AI capabilities elevate the overall user experience on the Platform

## What Sets You Apart:

- Leveraging AI tools as a force multiplier to code smarter, iterate faster boosting productivity and improving product capabilities
- Advanced knowledge of AI/ML architectures, model evaluation, and applied deep learning
- Experience with retrieval-augmented generation (RAG), vector search, and LLM fine-tuning
- Understanding of embedding models and AI-driven analytics.
- Proven ability to optimize AI models for low-latency, real-time interactions in browser or frontend environments
- Experience deploying secure AI systems in cybersecurity or other sensitive data domains

For high cost of living areas (San Francisco Bay, New York City, and Seattle), the expected salary range for this position is $179,000 USD - $201,000 USD, plus bonus eligibility and equity.

For all other locations, the expected salary range for this position is $148,000 USD - $192,000 USD, plus bonus eligibility and equity.

In addition to our great compensation package, our benefits are effective on day one and include but are not limited to: 401k match, health, vision, dental, and more! Please see our careers page for more details.

Our roots are in Ann Arbor, Michigan.

Our innovation is fueled by the team’s global perspectives.

For this role, we are open to remote employees across the continental US and Canada.

## Identity Verification

As part of our hiring process, all candidates who receive an offer of employment will be asked to complete an identity verification through CLEAR.

## California Privacy Rights Notice

Pursuant to the California Consumer Privacy Act (CCPA), we are providing you with notice that we collect personal information from job applicants for business purposes, including evaluating your candidacy for employment, conducting interviews, and, if applicable, completing the hiring process. The categories of information we may collect include identifiers (such as name and contact information), professional or employment-related information (such as work history, education, and references), and other information you provide in your application. We do not sell or share your personal information. For more information on how we use and protect your personal information, and your rights under the CCPA, please refer to our Privacy Policy.

Are you a current small business owner or manager eager to shape the future of AI? Large-scale language models are evolving from simple conversational tools into systems capable of supporting entrepreneurs with operations, strategy, financial planning, and customer engagement. With high-quality training data grounded in real-world business experience, tomorrow’s AI can better serve Small Business owners and managers navigating limited resources and high-stakes decisions.

That training data begins with you—we need your practical expertise to help power the next generation of AI.

We’re looking for current owners, co-owners, and managers across a range of industries, including retail, e-commerce, professional services such as consulting, legal, and accounting, technology and software, hospitality and food and beverage, healthcare and wellness, creative and media, construction and trades, and other small business sectors. Whether you are a new business owner or have years of operational experience, your insight into day-to-day decision-making is highly valuable.

On a typical day, you will engage the model with realistic small business scenarios and operational challenges; evaluate outputs related to budgeting, pricing, marketing strategy, hiring decisions, vendor management, customer communications, and basic compliance considerations; assess whether responses are practical and aligned with how Very Small Businesses actually operate; capture reproducible error traces; and provide structured feedback to improve prompts, evaluation criteria, and real-world applicability.

You may also help identify where models oversimplify trade-offs or misunderstand resource constraints common to VSB environments.

Direct experience owning or co-owning a small business is strongly preferred. Experience managing operations, finances, marketing, staffing, or growth strategy is highly relevant. Entry-level business owners as well as seasoned entrepreneurs are encouraged to apply. Clear, metacognitive communication—explicitly articulating how and why decisions are made in a real business context—is essential.

We offer a pay range of $20 to $100 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and high-speed internet; company-sponsored benefits such as health insurance and PTO do not apply.

Employment type: Freelance / Contract
Workplace type: Remote
Seniority level: Entry Level

At Expedia Group, we help travelers explore the world, one journey at a time. As a global travel company powered by passionate people, trusted partnerships, and leading technology, we connect travelers, partners, and advertisers through our consumer brands, B2B network, and travel advertising business.

Here, you'll do meaningful work that helps millions of people discover, book, and experience travel with more ease, confidence, and joy. Our five Behaviors-Traveler First, Think Big, Operate with Excellence, Ownership Mindset, and Succeed Together-help foster a supportive environment where people can grow their careers and have the flexibility, benefits, and support to do their best work. Join us and build for travelers everywhere.

Program Manager II, AI & Productivity

## Introduction to the team

Expedia Group B2B connects partners across the travel industry to our leading technology, supply, and services - helping them deliver seamless travel experiences to their customers. From airlines and hotels to financial institutions and other travel platforms, we power smarter, faster, and more impactful travel solutions through the most connected marketplace in the world.

Expedia Cruises is seeking a Program Manager II, AI & Productivity to identify and implement opportunities to improve how we work through AI, automation, and emerging technologies across the cruise and travel business. You’ll examine existing workflows, including legacy technology and manual processes, to simplify work, improve productivity, and modernize our operations for the future. This is a highly hands-on role focused on building and implementing practical AI solutions, while also championing AI adoption across our corporate teams.

## In this role, you will:

- Identify and prioritize opportunities to use AI and automation, spending regular time with internal teams to understand workflows and pain points firsthand and shape what gets built and in what order.
- Analyze existing workflows, legacy technology, and manual processes to identify opportunities to automate, simplify, or modernize.
- Design, build, and implement practical AI solutions, including document processing, data extraction, email workflows, summarization, and other repetitive activities.
- Build and deploy solutions using LLMs and agentic workflows (e.g., prompt engineering, RAG, multi-step automation) to solve real business problems.
- Evaluate and maximize AI capabilities within existing enterprise software and licensed platforms, while identifying emerging technologies that can deliver value.
- Take solutions from pilot to scaled rollout, managing timelines, communications, and change management to drive adoption -- iterating based on real usage and feedback.
- Track the impact of AI initiatives against clear metrics, and keep stakeholders informed on progress and results.
- Partner with business and Technology teams to implement, scale, and troubleshoot AI initiatives, coordinating across teams as needed to keep work moving.
- Serve as an AI champion across the corporate organization through training, coaching, demonstrations, and practical guidance

## Experience and Qualifications:

- 5+ years of experience in program management, process improvement, automation, technology, or a related field.
- Hands-on experience building with LLMs and agentic workflows (e.g., prompt engineering, multi-step automation) to solve real business problems.
- Experience designing, building, and implementing AI-powered solutions, workflows, or automations.
- Strong understanding of AI tools, emerging technologies, and their practical business applications.
- Strong analytical, problem-solving, and process improvement skills.
- Comfortable working across teams and functions to get things done, with strong communication skills to train and advocate for AI adoption.

The total cash range for this position in Vancouver is $95,000.00 to $133,000.00. Employees in this role have the potential to increase their pay up to $152,000.00, which is the top of the range, based on ongoing, demonstrated, and sustained performance in the role.

Starting pay for this role will vary based on multiple factors, including location, available budget, and an individual’s knowledge, skills, and experience. Pay ranges may be modified in the future.

## Benefits and perks

Expedia Group offers benefits and perks designed to support employees and their families, including medical, dental, and vision coverage, paid time off, an Employee Assistance Program, wellness and travel reimbursement, travel discounts, and International Airlines Travel Agent Network (IATAN) membership. Learn more about life at Expedia Group at https://careers.expediagroup.com/life.

## Accommodation requests

Expedia Group is committed to providing an inclusive and accessible recruiting experience. If you need an accommodation or adjustment due to a disability during the application or recruiting process, please submit a request at https://expedia.service-now.com/askeg?id=job_accommodation.

## About Expedia Group

Expedia Group includes three flagship consumer brands - Expedia, Hotels.com, and Vrbo - along with a leading B2B travel business and travel advertising offerings. Across our brands and business, we help travelers explore the world with confidence and ease.

## Important notice

Employment opportunities and job offers at Expedia Group will always come from Expedia Group's Talent Acquisition and hiring teams. Never share sensitive personal information unless you are confident of the recipient. Expedia Group does not extend job offers via email or messaging tools to individuals with whom we have not made prior contact. Our email domain is @expediagroup.com. The official place to find and apply for roles is https://careers.expediagroup.com/jobs/.

## Equal Opportunity

Expedia is committed to creating an inclusive work environment with a diverse workforce. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, veteran status, or any other characteristic protected by law. This employer participates in E-Verify. The employer will provide the Social Security Administration (SSA) and, if necessary, the Department of Homeland Security (DHS) with information from each new employee's I-9 to confirm work authorization.

Job Title: Full Stack Architect with AI & Agentic Systems (ReactJS, NextJS, NodeJS)

Location: Chicago, IL (Hybrid- 3Days a week)

Duration: 12+ Months

## Job Description:

Please note that .NET experience is secondary for this role. We are primarily seeking candidates with strong hands-on expertise in ReactJS, NextJS, NodeJS and Agentic AI.

We are seeking a highly experienced Full Stack Architect – AI & Agentic Systems to lead the design and implementation of next-generation digital platforms powered by modern web technologies and AI-driven architectures.

The ideal candidate will possess deep expertise in ReactJS, NextJS, NodeJS, .NET Core, ASP.NET Web APIs, cloud-native application development, and enterprise architecture, along with hands-on experience designing and implementing Agentic AI solutions, Retrieval-Augmented Generation (RAG), AI orchestration frameworks, and AI Development Lifecycle (AI-DLC) practices.

This role will drive the convergence of traditional software engineering and AI engineering, enabling scalable, secure, and production-ready AI-powered applications.

## Enterprise & Solution Architecture

- Define end-to-end architecture for enterprise applications and AI-enabled platforms.
- Design scalable systems leveraging microservices, API-first architecture, event-driven patterns, and cloud-native principles.
- Establish architecture governance, design standards, and engineering best practices.
- Conduct architecture reviews and technology assessments.

## Full Stack Architecture

- Architect modern frontend applications using ReactJS, NextJS, TypeScript, and component-driven design.
- Design backend services using NodeJS, .NET Core, ASP.NET Web APIs, and microservices.
- Define secure integration patterns across enterprise applications, cloud services, and AI platforms.
- Drive performance optimization, observability, security, scalability, and maintainability.

## Agentic AI Solution Architecture

- Architect autonomous and semi-autonomous AI agents for business process automation.
- Design multi-agent systems using orchestration frameworks such as LangGraph, Semantic Kernel, AutoGen, CrewAI, or similar technologies.
- Define AI workflows involving planning, reasoning, memory management, tool usage, and human-in-the-loop controls.
- Architect enterprise-grade RAG solutions integrating vector databases, enterprise knowledge sources, and LLMs.
- Implement guardrails, AI governance, responsible AI controls, and evaluation frameworks.

## AI Development Lifecycle (AI-DLC)

- Establish and operationalize AI-DLC processes across ideation, experimentation, development, deployment, monitoring, and continuous optimization.
- Define standards for:
- Prompt Engineering
- Context Engineering
- Evaluation & Benchmarking
- Model Selection
- RAG Validation
- Agent Testing
- AI Security Reviews
- Responsible AI Compliance
- Develop AI observability frameworks to monitor:
- Accuracy
- Hallucinations
- Latency
- Token Consumption
- Cost
- User Satisfaction
- Implement AI release governance, validation gates, and production readiness assessments.

## Cloud, DevOps & MLOps

- Architect solutions on Azure and/or AWS.
- Design CI/CD pipelines supporting both software and AI workloads.
- Integrate AI testing, prompt validation, and model evaluation into engineering workflows.
- Establish MLOps/LLMOps practices for enterprise deployments.
- Drive containerization and orchestration using Docker and Kubernetes.

## Technical Leadership

- Mentor architects, engineering leads, and AI engineers.
- Drive AI-first engineering transformation initiatives.
- Collaborate with business stakeholders to identify and prioritize AI opportunities.
- Support solutioning, estimations, proposals, and executive presentations.

## Frontend

- ReactJS
- NextJS
- TypeScript
- JavaScript (ES6+)
- HTML5/CSS3
- Redux / Redux Toolkit
- Responsive & Accessible UI Design

## Backend

- NodeJS
- ExpressJS
- .NET Core (.NET 6+ /.NET 8)
- ASP.NET Core
- Web API / REST API
- C#

## Databases

- SQL Server
- PostgreSQL
- MongoDB
- Vector Databases (Pinecone, Azure AI Search, Weaviate, Chroma, Milvus)

## Architecture

- Microservices
- API-First Design
- Event-Driven Architecture
- DDD
- CQRS
- SOLID Principles
- Design Patterns

## AI & Agentic AI

- Azure OpenAI / OpenAI / Anthropic / Gemini
- RAG Architecture
- Agentic Workflows
- Multi-Agent Systems
- Semantic Kernel
- LangChain / LangGraph
- MCP (Model Context Protocol)
- AI Guardrails
- Prompt Engineering
- Context Engineering
- AI Evaluation Frameworks

## Cloud & DevOps

- Azure / AWS
- Docker
- Kubernetes
- Azure DevOps
- GitHub Actions
- Jenkins
- Observability Platforms

## Preferred Qualifications

- Experience delivering AI-powered healthcare, payer, provider, or life sciences solutions.
- Experience with Healthcare interoperability standards (FHIR, HL7).
- AI Governance and Responsible AI experience.
- Exposure to AI-driven SDLC transformation and engineering productivity platforms.
- Experience implementing enterprise-scale Copilot or Agentic AI ecosystems.

## About The Role

The Healthcare Administrator manages the operational infrastructure behind healthcare delivery, including provider workflows, patient-access processes, payer requirements, and regulatory controls. The role connects clinical, technical, finance, and customer operations teams to keep services accurate, compliant, and efficient.

You will use healthcare information systems, workflow tools, and operational reporting to improve throughput, reduce administrative errors, and maintain reliable service across a distributed healthcare environment. The role is based remotely in Los Angeles, CA and requires strong working knowledge of US healthcare operations.

## Key Responsibilities

- Own day-to-day administrative workflows across scheduling, referrals, prior authorization, eligibility verification, claims coordination, and provider support
- Configure and maintain operational processes in healthcare platforms, CRM systems, ticketing tools, and electronic health record or practice-management systems
- Monitor KPIs including appointment access, authorization turnaround time, claim error rates, service-level compliance, and patient issue resolution
- Develop standard operating procedures, audit controls, training materials, and escalation paths for healthcare operations teams
- Coordinate with compliance, billing, clinical operations, product, and engineering teams to resolve workflow defects and implement process improvements
- Analyze operational data using Excel, SQL-based reporting, dashboards, or BI tools to identify root causes and recommend corrective actions
- Manage external payer, vendor, and healthcare partner communications while documenting decisions, risks, and remediation plans

## What We Are Looking For

- 3-8 years of experience in healthcare administration, healthcare operations, practice management, payer operations, or a related field
- Working knowledge of US healthcare workflows, including eligibility, referrals, prior authorization, claims, HIPAA, and payer-provider requirements
- Experience with EHR, practice-management, CRM, ticketing, or workforce-management systems; familiarity with integrations and structured healthcare data is preferred
- Strong analytical and process-improvement skills, with hands-on proficiency in Excel or Google Sheets and experience building operational reports or dashboards
- Demonstrated ability to manage cross-functional projects, document workflows, and deliver measurable improvements in accuracy, turnaround time, or service quality
- Bachelor’s degree in healthcare administration, business operations, public health, or a related discipline, or equivalent practical experience
- Bonus: Experience with SQL, Tableau or Looker, HL7/FHIR workflows, revenue-cycle operations, Lean or Six Sigma methods, and healthcare compliance certifications

We're building the platform that lets long-running autonomous agents operate safely inside NVIDIA's enterprise. These are not assistants on a developer's laptop. They are fleets of agents deployed in the cloud, running continuously at scale on shared accelerated compute. They take on real work across enterprise systems, so people get far more done than they could before. This role defines the constructs that agents are built from: the blueprints they start from, the tools, skills, and plugins that power them against enterprise data, the runtime safety harness that keeps them in bounds, and the connections into credential management, sandbox, memory, and observability. The team designs and ships these building blocks so that agent developers across the company can stand up a new agent, wire it in, and run it for days or weeks. Security and safe execution come out of the box, not something each team has to get right on its own.

Today an agent runs inside a single harness. Claude, Codex, and open-source agent harnesses each work differently underneath, with their own execution model, tool interface, and telemetry shape. The platform smooths over those differences, so a single skill, safety policy, or trace works the same no matter which harness is running. We want to enable agents that act on a person's behalf, governed and secure, continuously evaluated and self-improving. These agents coordinate and hand work off to each other, with identity and policy following every hop. They route and tune themselves across harnesses from live eval signals, and get better from their own production telemetry instead of waiting on a human to retrain them. Have you run agents on a harness like Claude or Codex and hit the walls that show up when they run for real, for days, against live systems — and wanted them to learn from it on their own? We're building the platform that solves those problems once, for every team.

## What you'll be doing:

The day-to-day is designing and building the platform that agent builders across NVIDIA depend on, from engineering teams to functions like finance, legal, and HR:

- Design agent blueprints with clean interfaces for authorization, sandbox, memory, observability, and skills, so a new agent inherits its enterprise integrations from the platform.
- Build the runtime safety harness: a policy engine that checks every action before it runs, rate and budget caps, circuit breakers, approval gates, action allow-lists, and a kill switch that works even when an agent goes rogue.
- Enable composing and orchestrating agents: skills as first-class units with declarative manifests, multi-agent orchestration for delegation and handoff, and support for headless, long-running, autonomous agents.
- Broker credentials so multi-agent systems can authenticate and authorize without ever touching secrets, with least-privilege scoping on every token.
- Provide checkpoint and recovery so an agent resumes cleanly after a crash or restart.
- Instrument observability and evaluation that span harnesses: decision-level traces with correlation IDs, what the agent saw and chose and why, cost anomaly alerts that catch looping, and quality scoring across skills, whole agents and products. Then close the loop: turn those signals into insights that make the agents better.

Since teams across NVIDIA depend on this platform in production, the whole team shares in keeping it healthy and reliable, including taking part in an on-call rotation.

## What we need to see:

- BS or MS in Computer Science, Engineering, or related field (or equivalent experience)
- 12+ years building distributed systems, infrastructure, or developer platforms at scale
- Hands-on experience building agents on a harness, exposing them as APIs, and shipping them with CI/CD
- Experience deploying and operating long-running services on container orchestration platforms
- Experience with the building blocks of scalable systems: messaging, caching, and durable storage
- Proficiency in Python, Go, Rust, or similar

## Ways to stand out from the crowd:

- Built a safety or policy engine that enforces rules on agent actions at runtime, with approval gates and kill switches
- Designed evaluation and feedback loops for agent behavior, tied to versioned skills or blueprints. Built self-evolving loops where agents improve from their own eval and production signals, on the latest agent harnesses — the closed-loop, self-improving side you want to attract
- Applied security fundamentals like threat modeling, authentication and authorization, least privilege, secrets management, and token exchange
- Designed AI data platform components like ingestion pipelines, vector stores, and retrieval APIs
- Shipped platform building blocks adopted by multiple engineering teams. Led complex technical projects like migrations or greenfield platform builds, aligning teams and writing clear design docs

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 224,000 USD - 356,500 USD for Level 5, and 272,000 USD - 431,250 USD for Level 6.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until September 27, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

## Skills:

Application Programming Interface (API), Artificial Intelligence (AI), Authentication, Autoscaling, Blueprints, Brokerage, Budgeting, Caching, Circuit Breakers, Cloud Computing, Computer Science, Computer Security, Continuous Deployment/Delivery, Continuous Integration, Distributed Computing, Finance, Go Programming Language (Golang), Laptop PC, Legal, Memory Hardware, Messaging Technology, On Call, Open Source, Policy Development, Python Programming/Scripting Language, Rust Programming Language, Scalable System Development, Security Attacks, Software Engineering, Team Lead/Manager, Telemetry, Threat Modeling, Vehicle Fleets, Web Client Plug-ins

NVIDIA

Visualize your future. We Do

NVIDIA is the world leader in graphics processing technologies, creating innovative, industry-changing products for computing, consumer electronics, and mobile devices. NVIDIA products are transforming visually-rich applications such as video games, film production, broadcasting, industrial design, space exploration, and medical imaging. We invest in our people and our technologies, support and fund industry research around the world, and consistently deliver high-quality products. NVIDIA's culture promotes and inspires a team of world-class employees to be at the top of their game. We've created an environment where talents are recognized and collaboration is valued. Our employees are shaping the world of tomorrow, today. We invite you to explore the opportunities available at NVIDIA to see what your future may hold.

Company Size:
10,000 employees or more

Industry:
Computer Software

1993

Website:
http://www.nvidia.com

Senior AI Test Engineer QA Automation Engineer AI LLM at Houston, TX- Onsite

Job Summary

Key Responsibilities