AI Developer (LLM & RAG)

About the role

Salvo Software is expanding its global artificial intelligence division and is looking for an AI Developer to join its remote team. The company, which has a distributed footprint across time zones, builds high-performance custom software and scalable engineering solutions. The role focuses on developing and operating LLM-powered ecosystems: using existing open-source technology to solve real business problems, working with product teams on scalable and secure workflows, and managing applications from prototype through deployment on cloud infrastructure.

Key responsibilities

• Build the connection between large language models and enterprise data.
• Operate and serve open-source LLMs with tools such as Ollama and llama.cpp in various environments.
• Design and maintain Retrieval-Augmented Generation (RAG) pipelines, including vector databases, chunking strategies and retrieval optimisation.
• Develop Model Context Protocol (MCP) integrations so models can access internal tools and data repositories.
• Build production-grade Python backend services supporting AI inference.
• Manage data ingestion pipelines for complex formats such as XML, XSD and standard office documents.
• Work with engineering teams to move features from sandbox environments to production-ready solutions.

Required profile

• 3 to 5 years of professional software engineering experience, specifically with Python in production environments.
• Demonstrable experience integrating LLMs, including vector retrieval and modern inference tools.
• Ability to take ownership of work remotely, with clear communication across distributed teams.
• Quick learner, with interest in topics such as model quantization, GGUF and GPU/CUDA tuning.

Required skills

• Python in production environments.
• Cloud and infrastructure knowledge, especially Azure or AWS.
• Containerisation (Docker) and CI/CD automation.
• DevOps practices, including Linux/Windows administration and observability tools such as Prometheus and Grafana.
• SOC 2 or ISO 27001 awareness is beneficial.