Backend AI Engineer (2+ years of Experience)

Full Description

RocketDevs empowers software engineers by bridging talent with global tech opportunities.

We connect skilled developers with innovative projects, fostering an inclusive tech community.

We are seeking a Backend AI Engineer with a strong focus on AI systems and agent development to join our team and work on client projects that leverage modern AI capabilities.

This is a full-time, remote position focused on building intelligent, scalable backend systems and AI-powered agents for global clients.

Key Responsibilities

• Design, build, and maintain backend systems that power AI-driven applications.

• Develop and deploy AI agents capable of reasoning, planning, tool usage, and multi-step workflows.

• Integrate Large Language Models (LLMs) and AI APIs (e.g., OpenAI, Anthropic, Hugging Face) into backend services.

• Build and manage RESTful or GraphQL APIs for AI-powered features.

• Design data pipelines for storing prompts, embeddings, agent memory, and model outputs.

• Implement vector search and retrieval systems (e.g., embeddings, RAG pipelines).

• Optimize AI workflows for performance, cost, and reliability.

• Handle authentication, authorization, and secure access to AI services.

• Collaborate in architecture discussions, code reviews, and sprint planning.

• Explore and implement AI tooling to improve developer productivity and client outcomes.

Qualifications

• Strong backend development experience with Python (FastAPI, Flask, Django) or Node.js (Express, NestJS).

• Hands-on experience integrating LLMs or AI APIs into production systems.

• Experience building or experimenting with AI agents, including:

• Tool calling / function calling

• Multi-step reasoning or workflows

• Agent memory or state management

• Solid understanding of API design, async processing, and background jobs.

• Experience with databases such as:

• SQL (PostgreSQL - PgVector, MySQL)

• NoSQL (MongoDB)

• Vector databases (e.g., Pinecone, Weaviate, FAISS, Elasticsearch)

• Familiarity with Redis or similar caching layers.

• Experience with Git & GitHub, Docker, and basic CI/CD workflows.

• Experience with web scraping and document parsing (HTML, PDFs).

• A deployed project (personal or professional) demonstrating an AI-powered backend system or agent is required.

Nice to Have

• Experience with RAG (Retrieval-Augmented Generation) systems.

• Familiarity with agent frameworks (e.g., LangChain, LangGraph, LlamaIndex, CrewAI, AutoGen).

• Experience with embeddings, prompt versioning, and evaluation.

• Familiarity with Model Context Protocol (MCP) or similar standards for connecting AI models to tools, data sources, and environments.

• Experience building or integrating automation workflows for AI systems (e.g., background jobs, task orchestration, event-driven workflows, or tools like Temporal, Airflow, n8n, Zapier).

• Knowledge of Kubernetes, serverless platforms, or Supabase.

• Understanding of AI safety, cost optimization, and observability.

• Familiarity with AI-assisted development tools or platforms.

Hiring Process

We ensure a fair and transparent process for every applicant:

Apply → Take a Compulsory 30-minute Assessment → 30-minute Onboarding Interview → Receive offer and start contributing to client projects

Note

• The assessment is mandatory.

Please apply only if you’re willing to take it.

• Having a deployed AI-powered backend project (personal or professional) is a must.