AI Engineer (Agents)

ABOUT SANA Sana is an AI lab building superintelligence for work. We believe organizations can accomplish their missions faster when teams can effortlessly access knowledge, automate repetitive work, and learn anything with the help of agentic AI. As part of Workday, we are committed to building AI that augments people - not replaces them. We bring this mission to life through two products. Sana Agents provide a seamless way to access all your company’s apps, knowledge, and data, enabling AI agents to do real work so teams can process and act on information at unprecedented scale. Sana Learn is an AI-powered learning hub that combines the simplicity of a modern learning platform with intelligent features like an AI tutor, automated content generation, and interactive apps, making knowledge not just accessible but actionable. We’re a talent-dense, product-obsessed team of engineers and designers from companies like Google, Spotify, Apple, and Databricks, united by deep technical excellence and rapid iteration. Our tools already help over a million people learn and work better across hundreds of leading enterprises - and we’re just getting started. ABOUT THE ROLE You’ll be the quality champion for Sana’s AI agent platform, ensuring our LLM-powered products are robust, reliable, and a delight to use. You’ll design and implement test strategies that keep pace with rapid iteration, automate critical workflows, and drive a culture of quality across engineering. This is a hands-on role for someone who thrives on constructing scalable ways of breaking things, uncovering edge cases unique to agentic and LLM-based systems, and building the safeguards that prevent issues from reaching production. You’ll help us deliver agent workflows that are safe, trustworthy, and enterprise-ready, for the AI landscape of today and tomorrow. IN THIS ROLE, YOU WILL * Design and implement test plans for agent infrastructure, LLM-based APIs, and end-to-end user journeys * Build and maintain automated test suites for backend, frontend, and integration layers, including prompt and response validation for generative models * Develop tools and frameworks to accelerate testing and catch regressions early, especially in agent reasoning, tool use, and context handling * Collaborate closely with engineers to embed quality into every stage of development, with a focus on the unique challenges of AI/LLM systems (e.g., non-determinism, hallucinations, safety) * Lead root cause analysis and drive resolution for critical issues and incidents, including those arising from model updates or agent behaviors * Advocate for best practices in code quality, observability, and CI/CD pipelines—ensuring quality signals are actionable and visible WHAT SUCCESS LOOKS LIKE * Critical bugs, regressions, and model failures are caught before they reach users—even as we scale and ship rapidly * Automated test coverage is high, reliable, and easy to maintain, including for LLM outputs and agent workflows * Release cycles are fast and safe. Confidence in shipping is high, even with evolving models and agent capabilities * Quality metrics (including model quality, agent reliability, and user experience) and dashboards provide clear, actionable signals to the team * You are a go-to partner for engineers, raising the bar for quality and reliability in AI-driven systems OUR TECH STACK We build on a simple modern stack optimized for both humans and AI. * Backend: TypeScript, Kotlin, Node.js * Frontend: TypeScript, React, Tailwind * Databases: Postgres, Redis * Cloud infra: GCP/Kubernetes/Terraform WHAT WE OFFER * Help shape AI's future alongside brilliant minds from Google, Apple, Spotify, Notion, Slack, Databricks, and BCG. * Competitive salary complemented with a competitive RSU program. * Swift professional growth in an evolving environment, supported by a culture of continuous feedback and mentorship from senior leaders. * Work with talented teammates across 5+ countries, and global customers, from our beautiful office in Stockholm.

At Umain, we're not just creating software; we're crafting the future, one innovative project at a time. With our motto "Shape, Ship, Scale," we empower our team to not only envision the future but also play a pivotal role in building it. We're a dynamic team where you can shape the future, ship groundbreaking solutions, and scale your abilities in many different ways. We're on the lookout for developers ready to join us in this journey, bringing passion, creativity, and dedication along with them. The role is ideal for engineers with demonstrable skills in AI as well as for software engineers who have recently transitioned to AI and ML expertise, and offers an opportunity to develop your craft whilst working closely with clients on delivering AI solutions to real-world challenges. We are seeking an AI Engineer with experience in building robust, scaleable, AI powered solutions. The ideal candidate combines a product engineering mindset with a deep enthusiasm for advancing AI capabilities. They demonstrate a great understanding of core AI concepts, product development workflows, and embodies team spirit. AS AN AI ENGINEER AT UMAIN, YOUR ROLE WILL INVOLVE: * Assisting our clients in clarifying their questions and determining if using AI is a suitable solution for them * You understand the limitations of a model and how to address them within the product's UX * Experience architecting agentic solutions (context, memory, and tool/skill handling) and implementing them using frameworks such as Mastra, Microsoft Agent Framework, LangChain/LangGraph. * Applying stochastic test casing and trace-based reasoning to evaluate, test, and improve agent behaviour, supported by observability tooling (Langfuse, Promptfoo, etc.). * Understanding and applying core AI concepts such as redlining, document chunking for accuracy, efficient use of embeddings, and debugging AI systems * Validating, deploying, monitoring, and maintaining built models, ensuring they can be used at scale * Developing and maintaining end-to-end data pipelines and machine learning workflows, optimizing for performance and reliability * Working with diverse, cross-functional teams on projects that deliver groundbreaking AI solutions for global brands WE ALSO WELCOME EXPERIENCED SOFTWARE ENGINEERS LOOKING TO TRANSITION INTO AI: * Strong product development background with several years of software engineering experience * Active engagement in AI (agents, wrappers, context engineering) * Knows how to work efficiently in a product/engineering team WHO YOU ARE: We value candidates who demonstrate: * Great delivery skills: Proven capability to deliver AI solutions * Strong AI intuition: A deep understanding of AI concepts * Curiosity: Enthusiasm for emerging technologies, creativity in problem-solving, and an eagerness to learn in a rapidly evolving AI landscape * Full-stack product thinking: Frontend or backend experience outside the traditional AI field, with the ability to build end-to-end * You're a developer with a passion for innovation and a knack for problem-solving. * You're eager to learn, grow, and take on new challenges. * You value collaboration, diversity, and the opportunity to make a significant impact. * You believe in the power of technology to shape the future. WHAT WE OFFER: * A chance to work closely with global brands on a range of diverse and unique projects that explore and truly push the boundaries of what's possible. * A fun and fair work environment where you have the opportunity to expand your skills through unique challenges and fantastic colleagues. * A personal coach, and a setting where you can grow professionally and personally. * Being part of multidisciplinary teams, participating in agile teams, being an important player in a highly ambitious setting. WHY UMAIN? Career Framework: We believe in fairness and clarity, which is why we've established a transparent career framework to ensure equal pay and equal opportunities for all. Your growth and success are as important to us as they are to you. Together with your coach, you will build your own development plan and grow in your career. Work-Life Balance: At Umain, diversity is our strength. We understand that life doesn't pause when you walk into the office. That's why we've cultivated an environment that supports an excellent work-life balance. We welcome team members from all walks of life, recognizing the richness that different backgrounds, ages, and life stages bring to our team. We're committed to supporting each other, encouraging a healthy work-life balance that respects your needs, whether it's taking care of your family, your pets, or yourself. Innovations and Learning: Technology is always evolving, bringing new challenges and opportunities for collaboration and learning. Our developers work closely with designers, analysts, testers and more to tackle these challenges head-on, sharing knowledge and growing together. Skills Over Degrees: We're more interested in what you can do than in the diplomas you hold. Talent, drive, and creativity are what count at Umain. Here, you'll find opportunities to grow, learn, and excel in your career, regardless of your educational background. If you have the ambition and commitment to succeed, we have the environment and resources to support your journey. Background Check: Umain conducts a background check for final candidates in accordance with our internal policies. The check is carried out only with your consent and is ordered by our CISO through our approved screening partner. The scope of the check depends on the role level. This step is performed late in the recruitment process and is used solely to support a secure and fact-based hiring decision.