• Evaluating LLMs with Chatbot Arena and Joseph E. Gonzalez

  • Dec 17 2024
  • Length: 56 mins
  • Podcast

Evaluating LLMs with Chatbot Arena and Joseph E. Gonzalez

Listen for free

View show details

  • Summary

  • In this episode of Gradient Dissent, Joseph E. Gonzalez, EECS Professor at UC Berkeley and Co-Founder at RunLLM, joins host Lukas Biewald to explore innovative approaches to evaluating LLMs.

    They discuss the concept of vibes-based evaluation, which examines not just accuracy but also the style and tone of model responses, and how Chatbot Arena has become a community-driven benchmark for open-source and commercial LLMs. Joseph shares insights on democratizing model evaluation, refining AI-human interactions, and leveraging human preferences to improve model performance. This episode provides a deep dive into the evolving landscape of LLM evaluation and its impact on AI development.

    🎙 Get our podcasts on these platforms:

    Apple Podcasts: http://wandb.me/apple-podcasts

    Spotify: http://wandb.me/spotify

    Google: http://wandb.me/gd_google

    YouTube: http://wandb.me/youtube


    Follow Weights & Biases:

    https://twitter.com/weights_biases

    https://www.linkedin.com/company/wandb


    Join the Weights & Biases Discord Server:

    https://discord.gg/CkZKRNnaf3
    Show More Show Less
Show More Show Less

What listeners say about Evaluating LLMs with Chatbot Arena and Joseph E. Gonzalez

Average Customer Ratings

Reviews - Please select the tabs below to change the source of reviews.

Audible.com.au reviews

Amazon Reviews
No Reviews are Available
In the spirit of reconciliation, Audible acknowledges the Traditional Custodians of country throughout Australia and their connections to land, sea and community. We pay our respect to their elders past and present and extend that respect to all Aboriginal and Torres Strait Islander peoples today.