LLM Evaluation Lead
Sparta Science
Our mission at Oura is to empower every person to own their inner potential. Our award-winning products help our global community gain a deeper knowledge of their readiness, activity, and sleep quality by using their Oura Ring and its connected app. We've helped 2.5 million people understand and improve their health by providing daily insights and practical steps to inspire healthy lifestyles.
Join Oura in shaping how millions of people connect with their health!
At Oura, we’re building the future of personal health, powered by cutting-edge technology and backed by science. We’re expanding our efforts to bring more thoughtful, human-centered AI features into our mobile app, and are now looking for an AI Evaluation Lead to help us set the quality bar for Oura Advisor and AI-driven features.
About this role
This role combines cross-team coordination, forward-looking innovation, and linguistic craft. As the AI Evaluation Lead, you’ll guide teams on how our AI speaks with Members, help design and run evaluations on tone and content, and champion AI solutions across the company.
We’re looking for someone who doesn’t just follow the latest in AI development, but actively participates in it. You experiment with new tools, refine prompts, and innovate how AI can be used and improved in practice.
This is a unique opportunity to directly influence how Oura’s AI Advisor supports members on their health journey – one conversation and insight at a time.
What You’ll Do
- Own our evaluation data set, making sure of its quality and optimal coverage.
- Act as the guardian of Oura’s AI voice and set the quality bar: ensure Advisor and other AI-powered features always reflect our distinctive communication style.
- Coordinate and guide teams: help them design and create their own evaluations by providing best practices and consultation, while prioritizing evaluation needs and keeping standards consistent.
- Champion AI practices across Oura: serve as a trusted spokesperson, helping teams understand how to use and improve AI responsibly and effectively.
- Shape prompts and interactions: bring your linguistic expertise and copywriting craft to ensure every AI response feels clear, human, and on brand.
- Evolve evaluation processes: partner with engineering to refine tooling and create scalable, repeatable workflows for LLM testing and feedback.
What we are looking for
- Deep curiosity about AI, with experience and forward-looking ideas on how prompting and evaluation work in practice.
- Proven linguistic and copywriting skills.
- Experience guiding or coaching others: you’re comfortable helping cross-functional teams adopt new practices and learn from you.
- Strong collaboration skills: you thrive in busy interfaces across product, design, and engineering.
- Ability to balance detail-oriented evaluation with the bigger picture of member experience.
- Comfort working in the evolving, sometimes ambiguous context of AI.
Bonus points for
- Familiarity with Oura’s product, or a strong interest in health, wellbeing, and human physiology and psychology.
- Background in building content libraries, or curating knowledge bases.
- Experience facilitating workshops, training, or internal advocacy around new tools or processes.
- Understanding of product development and software workflows.
Location
Our team is based in our Helsinki and Oulu offices, so we’re ideally looking for someone located in either city. The role can also be done remotely from elsewhere in Finland, as long as you’re open to occasionally visiting one of the offices to connect with the team in person.
What we offer:
- Competitive Salary
- Lunch benefit
- Wellness benefit
- Flexible working hours
- Collaborative, smart teammates
- Personal learning & development program
- An Oura ring of your own
If this sounds like the next step for you, please send us your application as soon as possible.
Oura is proud to be an equal opportunity workplace. We celebrate diversity and are committed to creating an inclusive environment for all employees. Individuals seeking employment at Oura are considered without regard to age, ancestry, color, gender (including pregnancy, childbirth, or related medical conditions), gender identity or expression, genetic information, marital status, medical condition, mental or physical disability, national origin, protected family care or medical leave status, race, religion (including beliefs and practices or the absence thereof), sexual orientation, military or veteran status, or any other characteristic protected by federal, state, or local laws. We will not tolerate discrimination or harassment based on any of these characteristics.
Disclaimer: Beware of Fake Job Offers!
We’ve been alerted to scammers posing as ŌURA recruiters, especially for remote roles. Please note:
- Our jobs are listed only on the ŌURA Careers page and trusted job boards.
- We will never ask for personal information like ID or payment for equipment upfront.
- Official offers are sent through Docusign after a verbal offer, not via text or email.
- Stay cautious and protect your personal details.
To all recruitment agencies: Oura does not accept agency resumes. Please do not forward resumes to our jobs alias, Oura employees, or any other organization's location. Oura is not responsible for any fees related to unsolicited resumes