• Abstracts: July 29, 2024

  • Jul 29 2024
  • Length: 8 mins
  • Podcast

Abstracts: July 29, 2024

  • Summary

  • A lack of appropriate data, decreased model performance, and other obstacles have made it difficult to expand the input language models can receive. Li Lyna Zhang introduces LongRoPE, a method capable of extending content windows to more than 2 million tokens.

    Read the paper

    Get the code

    Show More Show Less
activate_samplebutton_t1

What listeners say about Abstracts: July 29, 2024

Average Customer Ratings

Reviews - Please select the tabs below to change the source of reviews.

In the spirit of reconciliation, Audible acknowledges the Traditional Custodians of country throughout Australia and their connections to land, sea and community. We pay our respect to their elders past and present and extend that respect to all Aboriginal and Torres Strait Islander peoples today.