Jobs with Startups
JobsStartupsInvestorsMCP
JobsLegora (formerly Leya)

Technical Legal Engineer - Evals

Legora (formerly Leya) logo

Legora (formerly Leya)

B2B

Technical Legal Engineer - Evals

Stockholm HQ; Stockholm, Stockholm, Sweden
On-site
Full-time
Posted Aug 19, 2026
Apply on company site

Opens the original job posting

Engineering
On-site

About Us

Legora is redefining how legal work gets done. Not built for lawyers, built with them. We work alongside the world’s best legal teams, who expect excellence, precision, and speed, and we hold ourselves to the same bar.

Our AI-native workspace lets legal professionals move faster, think more clearly, and operate with sharper precision. By analysing thousands of documents in minutes and powering end-to-end workflows, we cut through complexity, teams can focus on what matters: judgment, strategy, and outcomes.

1,000+ customers across 50+ countries trust us, including Cleary Gottlieb, Goodwin, Linklaters, White & Case, Dentons, and Barclays. We’ve scaled to $100M+ in ARR, with teams across Europe, North America and APAC, and continue to expand through acquisitions including Qura, Walter AI and Graceview.

We partner with world-class performers: including Aaron Judge and the New York Yankees, Ludvig Åberg (and his caddie), and campaigns featuring Jude Law.

Joining Legora means three things.

  • We lean in: ownership over titles, outcomes over intentions.

  • We fight for excellence: high standards, direct, ego-free feedback.

  • We grow together: as a team and with our customers.

Mission before ego. Everyone contributes. No one coasts.

If you’re driven by impact, pace, and raising the bar. This is the place.

The Role

We are seeking a tech-savvy lawyer with knowledge of, or a strong interest in tech products, AI and LLM evaluations.

Apply your legal training and practice experience to evaluate, stress-test, and improve AI systems used in legal work. You will not be expected to code, but will apply legal judgment at scale. You would be reviewing and helping to improve AI-generated outputs as an experienced lawyer would review junior work, precedents, or research memos.

This role is ideal for a lawyer who enjoys issue-spotting, quality control, and analytical rigor, and is eager to shape how legal work is performed using modern technology.

You will collaborate closely with senior legal engineers, product managers, and engineers to ensure AI outputs meet professional standards for legal accuracy, reasoning, and usability.

What You Will Be Doing

Legal Review & Evaluations

  • Review AI-generated legal outputs for accuracy, completeness, legal reasoning, and jurisdictional correctness across research, drafting, and analysis use cases.

  • Assess outputs for real-world usability and identify failure modes, edge cases, and legal ambiguities that affect product reliability.

Dataset & Benchmark Development

  • Design and build high-quality evaluation datasets, including benchmark cases and gold-standard legal answers.

  • Define clear scoring rubrics and evaluation guidelines for consistent, objective assessment.

  • Continuously refine benchmarks as products, models, and legal requirements evolve.

Error Analysis & Insight Generation

  • Identify recurring legal errors, edge cases, and failure patterns.

  • Distinguish minor drafting issues from substantive legal risks.

  • Flag AI behavior that could mislead users or create downstream legal risk.

Collaboration & Feedback

  • Work closely with senior legal engineers, product managers, and engineers.

  • Translate legal feedback into clear, actionable guidance for non-lawyers.

What This Role Is Not

  • No production coding required.

  • No provision of legal advice to clients.

  • No traditional billable work.

Instead, you will use your legal training to define, evaluate, and safeguard legal quality at scale.

  

Legora is an Equal Opportunity Employer

At Legora, we believe great teams are built on diversity of thought and experience. We’re proud to be an equal opportunity employer and committed to creating an inclusive, high-performance culture where everyone can do their best work. We welcome people of all backgrounds and don’t discriminate based on race, color, religion, national origin, gender, gender identity or expression, sexual orientation, age, disability, veteran status, or any other characteristic protected by law.

Apply for this role
Legora (formerly Leya) logo

Legora (formerly Leya)

Company profile

The AI workspace for lawyers

View Legora (formerly Leya)

Headquarters

Stockholm, Stockholm County, Sweden

Team size

51-200

Keep exploring

More roles at Legora (formerly Leya)

View all roles

GTM Director - Dubai

Go To Market (GTM) · Dubai; Dubai, Emirate of Dubai, United Arab Emirates

Legal Engineer - Tax & Audit, Munich

Legal Engineering · Munich; Munich, Bavaria, Germany

GTM Manager - Strategic Accounts

Go To Market (GTM) · London; London, London, United Kingdom

Staff Platform Engineer - Platform Team

Engineering · Malmö; Malmö, Skåne, Sweden

Customer Trust Specialist

IT · San Francisco; San Francisco, California, United States

Jobs with Startups © 2026

Browse startupsBrowse jobsMCP guideAboutPowered by Supabase