Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

Recipes to scale inference-time compute of open models

Submissions for LiveCodeBench

Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"

Train transformer language models with reinforcement learning.

Public repo for HF blog posts

The Python package installer

EvalPlus for rigourous evaluation of LLM-synthesized code

Automatically evaluate your LLMs in Google Colab

✨Argilla: the open-source data curation platform for LLMs

kloppy: standardizing soccer tracking- and event data

Changelog management tool

A Landing Page for the community and a vote-system for select the topic of the next MeetUp