Job
AI Developer
Salvo Software AI-focused software company with roles in building LLM-powered systems
AI Developer role at Salvo Software building and operating LLM-powered systems, focusing on production-grade Python, RAG pipelines, and MCP integrations in a distributed AI department.
At a glance
- Location
- Remote
- Listed
- Source
- Remote OK
About this opportunity
Salvo Software is expanding its AI department and seeks a hands-on AI Developer. The role centers on building and operating LLM-powered systems, using open-source models with Ollama and llama.cpp, and creating RAG pipelines and MCP integrations to connect LLMs with internal tools and data sources.
You’ll work closely with engineering and product teams to move features from prototype to reliable production deployments. Mentorship is available as you grow in areas like RAG architecture, Kafka, and advanced MCP work.
Experience in production-grade Python, strong fundamentals in AI engineering, and the ability to learn quickly are valued. The role supports DevOps foundations like Docker, CI/CD, and Azure, but AI engineering is the core focus.
This is a remote role with collaboration across distributed teams and opportunities to work on on-prem and cloud deployments, with growth into model optimization and broader AI infrastructure.
Responsibilities
- Serve and operate open-source LLMs using Ollama and llama.cpp, locally and in on-prem environments.
- Build and maintain RAG pipelines: embeddings, vector databases, chunking strategies, and retrieval quality.
- Develop MCP (Model Context Protocol) integrations connecting LLMs to internal tools and data sources.
- Build backend services in Python that power ML inference and AI-driven product features.
- Parse and process structured and semi-structured data (XML/XSD, Office document formats) as pipeline inputs.
- Grow into model optimization over time: quantization (GGUF), GPU/CUDA tuning, and offline/air-gapped deployments.
Requirements
- 3–5+ years engineering experience with production-level Python for building real services, LLM inference, RAG pipelines, and automated tooling.
- Hands-on LLM & AI integration serving models via Ollama/llama.cpp, implementing vector retrieval/RAG, and developing MCP integrations (GPU/CUDA tuning & model quantization nice to have).
- Cloud & Infrastructure expertise covering Azure/AWS deployments, Docker containerization, Linux/Windows admin, and CI/CD automation (Azure DevOps, GitHub Actions, or GitLab CI).
- DevOps, Security & Operations awareness, including Git workflows, scripting (Python, Bash, PowerShell), observability (Prometheus/Grafana), DevSecOps, and compliance frameworks (SOC 2, ISO 27001, Zero Trust).
- Strong problem-solving & communication with a root-cause troubleshooting mindset, self-directed learning, ownership, and distributed team collaboration.
How to apply
- Mention the word BREAKTHROUGHS and the tag #RMmEwMjpjMjA3OjIyODA6MTI4Mzo6MQ== in your application as requested in the listing.
Ready to apply?
WorkInRwanda never asks for money to apply. If anyone does, report it. Report this listing
About Salvo Software
Salvo Software is an organization offering software solutions, including AI-enabled systems. The Listings indicate an AI department focused on building and operating LLM-powered systems, RAG pipelines, and MCP integrations, with a remote job posting for an AI Developer.
See everything from Salvo Software