Past Webinar
Rethinking Transformation Quality

Learn how to measure and sustain document transformation quality in a changing LLM landscape.

Aug 27, 2025

Speakers

Kevin Krom
Kevin Krom
GTM, Unstructured
Yao You
Yao You
Principal Software Engineer, Unstructured
Leah Li
Leah Li
Head of Research, Unstructured

Recorded

Wednesday, Aug 27, 2025
30 mins on Zoom Events

Overview:

In file transformation, “quality” isn’t a fixed target — it shifts as new use cases emerge, model capabilities advance, and hybrid approaches blend multiple models for better results. The challenge isn’t just about getting accurate outputs today; it’s about ensuring they remain reliable tomorrow as requirements evolve. Poor or inconsistent transformation slows decision-making, increases costs, and reduces performance in downstream applications. Benchmarks help, but they’re only the starting point — building a reliable and extensible evaluation pipeline is essential for sustaining quality over time.

In this webinar, we’ll share how we continuously evaluate and compare solutions over time to deliver best-in-class file transformation quality for our customers. We’ll focus on practical ways to measure and improve document transformation accuracy, and discuss how metrics can adapt as new LLM models or capabilities emerge — the same disciplined approach that allows us to keep our own transformation systems dependable, precise and ready for whatever comes next.

Technical Details:

In this session, we’ll walk through:

  • Why benchmarks are important
  • The reality: LLM performance isn’t static — updates, new models, new use cases.
  • State-of-the-Art metrics
  • Automating evaluation pipelines & regression tests
  • Iterating our metrics — adding new metrics to reflect current business needs and tech capabilities

This webinar includes a live demo and an open Q&A where you can get your questions answered. Can't join live? Register anyway to receive the recording!