AI Inference Engineer (f/m/d)

About ITRex THE PLACEITRex - AI pioneers who build systems that actually work in the real world, not just in demos. We're 250+ people spread across the US and Europe, creating solutions for companies like Procter & Gamble and Shutterstock. We keep it simple, build it right, and focus on what works. THE PEOPLEWe're the kind of people who don't ignore messages in Slack, who jump in to help when you're stuck on a problem, and who offer solutions instead of blame when things go sideways. We believe in openness, accountability, and having each other's backs. No office politics, no hidden agendas - just people who care about doing good work together and supporting each other to get there. THE ROLEWe are looking for a strong C++ Engineer with hands-on experience deploying and optimizing modern AI models for production. The ideal candidate combines deep systems programming expertise with practical experience working with LLMs and modern deep learning architectures. Rather than building or training models from scratch, this engineer focuses on integrating, evaluating, profiling, and optimizing AI inference pipelines for high-performance on-device execution.

Responsibilities• Work on deploying machine learning models to edge devices using the frameworks: llama.cpp, ggml • Collaborate closely with researchers to assist in coding, training and transitioning models from research to production environments • Integrate AI features into existing products, enriching them with the latest advancements in machine learning