On this episode: Stack Overflow senior data scientist Michael Geden tells Ryan and Ben about how data scientists evaluate large language models (LLMs) and their output. They cover the challenges involved in evaluating LLMs, how LLMs are being used to evaluate other LLMs, the importance of data validating, the need for human raters, and more needs and tradeoffs involved in selecting and fine-tuning LLMs. https://stackoverflow.blog/2024/04/16/how-do-you-evaluate-an-llm-try-an-llm/
Connectez-vous pour ajouter un commentaire
Autres messages de ce groupe
The first release of the year is packed with features to make your knowledge-sharing community better. https://stackoverflow.blog/2025/01/29/new-year-new-features-level-up-your-stack-overflow-for-tea
New year, new approach. https://stackoverflow.blog/2025/01/28/how-engineering-teams-can-thrive-in-2025/
Ben and Ryan are joined by RJ Tuit, Head of UI Platform and Client Architect at ClickUp, formerly an engineering director at Microsoft. They talk about ClickUp’s vision for a comprehensive productivit
We’re excited to announce our 16th annual Stack Gives Back campaign donations. https://stackoverflow.blog/2025/01/27/stack-gives-back-2024/
John Graham-Cumming, CTO of Cloudflare, joins Ben and Ryan for a conversation about the latest trends in internet usage highlighted in Cloudflare's 2024 Year in Review report. https://stackoverflow.b
Is anyone designing software where failures don't have consequences? https://stackoverflow.blog/2025/01/22/why-all-developers-should-adopt-a-safety-critical-mindset/
Kyle welcomes Wes Copeland, a senior frontend engineer at Apartment Advisor, to the interview. They talk about how good test coverage helps you develop software faster, the benefits of low-fidelity pr
