On this episode: Stack Overflow senior data scientist Michael Geden tells Ryan and Ben about how data scientists evaluate large language models (LLMs) and their output. They cover the challenges involved in evaluating LLMs, how LLMs are being used to evaluate other LLMs, the importance of data validating, the need for human raters, and more needs and tradeoffs involved in selecting and fine-tuning LLMs. https://stackoverflow.blog/2024/04/16/how-do-you-evaluate-an-llm-try-an-llm/
Ak chcete pridať komentár, prihláste sa
Ostatné príspevky v tejto skupine
Ryan talks with senior engineering manager Caitlin Weaver about how her childhood fascination with computers led to her leading CLEAR’s Cloud Infrastructure Engineering team, her experiences in DevOps
An update to the research that the User Experience team is running over the next quarter. https://stackoverflow.blog/2025/02/20/research-roadmap-update-february-2025/
How a theater major became a fullstack engineer building software to manage climate change. https://stackoverflow.blog/2025/02/19/wbit-4-using-gis-to-understand-the-rivers-and-the-lakes-that-you-re-u
Minh Nguyen, VP of Engineering at Transcend, joins Ryan for a conversation about the complexities of privacy and consent in tech, from the challenges organizations face in managing data privacy to the
Ken Stott, Field CTO of API platform Hasura, tells Ryan about the data doom loop: the concept that organizations are spending lots of money on data systems without seeing improvements in data quality
APIs have steadily become the backbone of AI systems, connecting data and tools seamlessly. Discover how they can drive scalable and secure training for AI models and intelligence automation. https://
Can your database handle a billion customers per month? https://stackoverflow.blog/2025/02/12/a-distributed-database-that-can-withstand-a-meteor-strike/
