pathlib api extended to use fsspec backends

A specification that python filesystems should adhere to.

Train transformer language models with reinforcement learning.

Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"

Apache PyIceberg

A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.

Everything about the SmolLM2 and SmolVLM family of models

A lightweight data processing framework built on DuckDB and 3FS.

Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more

Collection of eclectic utils for python.

Context aware, pluggable and customizable data protection and de-identification SDK for text and images

🤗 LeRobot: State-of-the-art Machine Learning for Real-World Robotics in Pytorch

Parallel computing with task scheduling

A framework for few-shot evaluation of language models.

Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.

PyTorch image models, scripts, pretrained weights -- ResNet, ResNeXT, EfficientNet, EfficientNetV2, NFNet, Vision Transformer, MixNet, MobileNet-V3/V2, RegNet, DPN, CSPNet, and more

Pre-compiled shared libraries for libsndfile

🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

Apache Beam is a unified programming model for Batch and Streaming data processing.

Official code for "Distributed Deep Learning in Open Collaborations"

Some notebooks for NLP

Automatically create READMEs for datasets

The lightweight PyTorch wrapper for high-performance AI research. Scale your models, not the boilerplate.

A Streamlit app to add structured tags to the datasets

🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.