Skip to content

@mlcommons MLCommons

Change the repository type filter

All

    Repositories list

    118 repositories

    • mlperf_inference_test_submissions_v5.0

      Public
      Mermaid
      •5•0•0•0•Updated Dec 24, 2025Dec 24, 2025

    • mlperf-automations

      Public
      This repository contains automation scripts designed to run MLPerf Inference benchmarks. Originally developed for the Collective Mind (CM) automation framework, these scripts have been adapted to leverage the MLC automation framework, maintained by the MLCommons Benchmark Infrastructure Working Group.
      automationmlperfmlperf-inferencemlcflowmlperf-automations
      Python
      •
      Apache License 2.0
      •24•11•64•3•Updated Dec 24, 2025Dec 24, 2025

    • mobile_app_open

      Public
      Mobile App Open
      C++
      •
      Apache License 2.0
      •30•66•52•5•Updated Dec 24, 2025Dec 24, 2025

    • inference_results_v5.1

      Public
      This repository contains the results and code for the MLPerf® Inference v5.1 benchmark.
      benchmarkingbenchmarkmachine-learning
      HTML
      •10•0•0•0•Updated Dec 23, 2025Dec 23, 2025

    • inference

      Public
      Reference implementations of MLPerf® inference benchmarks
      benchmarkmachine-learning
      Python
      •
      Apache License 2.0
      •599•1.5k•217•36•Updated Dec 23, 2025Dec 23, 2025

    • mlcflow

      Public
      MLCFlow: Simplifying MLPerf Automations
      automation-frameworkmlperfmlcflowmlperf-automations
      Python
      •
      Apache License 2.0
      •14•10•2•0•Updated Dec 22, 2025Dec 22, 2025

    • modelbench

      Public
      Run safety benchmarks against AI models and view detailed reports showing how well they performed.
      Python
      •
      Apache License 2.0
      •27•114•495•4•Updated Dec 22, 2025Dec 22, 2025

    • storage

      Public
      MLPerf® Storage Benchmark Suite
      benchmarkmachine-learningperformancestorage
      Python
      •
      Apache License 2.0
      •54•171•38•4•Updated Dec 22, 2025Dec 22, 2025

    • modelplane

      Public
      Python
      •
      Apache License 2.0
      •0•1•11•0•Updated Dec 19, 2025Dec 19, 2025

    • modellogger

      Public
      Python
      •0•0•0•0•Updated Dec 19, 2025Dec 19, 2025

    • croissant

      Public
      Croissant is a high-level format for machine learning datasets that brings together four rich layers.
      machine-learningschema-orgjson-lddatasets
      Jupyter Notebook
      •
      Apache License 2.0
      •95•773•169•35•Updated Dec 19, 2025Dec 19, 2025

    • algorithmic-efficiency

      Public
      MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvements in both training algorithms and models.
      Python
      •
      Apache License 2.0
      •76•404•26•7•Updated Dec 18, 2025Dec 18, 2025

    • logging

      Public
      MLPerf™ logging library
      Python
      •
      Apache License 2.0
      •54•37•41•1•Updated Dec 18, 2025Dec 18, 2025

    • ck

      Public
      Collective Knowledge (CK), Collective Mind (CM/CMX) and MLPerf automations: community-driven projects to facilitate collaborative and reproducible research and to learn how to run AI, ML, and other emerging workloads more efficiently and cost-effectively across diverse models, datasets, software, and hardware using MLPerf methodology and benchmarks
      metadataeducationbenchmarkingautomationoptimizationbest-practicescollaborationcmmodularityworkflows
      Python
      •
      Apache License 2.0
      •123•638•9•0•Updated Dec 18, 2025Dec 18, 2025

    • inference_policies

      Public
      Issues related to MLPerf® Inference policies, including rules and suggested changes
      Apache License 2.0
      •55•64•19•4•Updated Dec 16, 2025Dec 16, 2025

    • training

      Public
      Reference implementations of MLPerf® training benchmarks
      benchmarkmachine-learning
      Python
      •
      Apache License 2.0
      •587•1.7k•19•3•Updated Dec 16, 2025Dec 16, 2025

    • training_policies

      Public
      Issues related to MLPerf™ training policies, including rules and suggested changes
      Python
      •
      Apache License 2.0
      •70•95•45•2•Updated Dec 16, 2025Dec 16, 2025

    • policies

      Public
      General policies for MLPerf® benchmarks including submission rules, coding standards, etc.
      Python
      •
      Apache License 2.0
      •60•32•36•40•Updated Dec 16, 2025Dec 16, 2025

    • r2-infra

      Public
      MLC Cloudflare R2 Dataset Distribution Infrastructure Management
      HTML
      •
      Apache License 2.0
      •0•1•0•0•Updated Dec 15, 2025Dec 15, 2025

    • mobile_results_v5.0

      Public
      This repository contains the results and code for the MLPerf™ Mobile Inference v5.0 benchmark.
      Apache License 2.0
      •0•0•0•0•Updated Dec 3, 2025Dec 3, 2025

    • medperf

      Public
      An open benchmarking platform for medical artificial intelligence using Federated Evaluation.
      Python
      •
      Apache License 2.0
      •36•163•53•20•Updated Dec 3, 2025Dec 3, 2025

    • mlperf_automotive

      Public
      Python
      •
      Apache License 2.0
      •7•8•2•0•Updated Dec 1, 2025Dec 1, 2025

    • dynabench

      Public
      Python
      •
      MIT License
      •18•27•8•5•Updated Dec 1, 2025Dec 1, 2025

    • tiny

      Public
      MLPerf® Tiny is an ML benchmark suite for extremely low-power systems such as microcontrollers
      C
      •
      Apache License 2.0
      •109•437•14•9•Updated Dec 1, 2025Dec 1, 2025

    • mlcube

      Public
      MLCube® is a project that reduces friction for machine learning by ensuring that models are easily portable and reproducible.
      machine-learningmlperfmlcubemlcommons
      Python
      •
      Apache License 2.0
      •31•158•35•8•Updated Nov 26, 2025Nov 26, 2025

    • common-crawl-dmlr

      Public
      Rust
      •
      Apache License 2.0
      •0•0•0•0•Updated Nov 25, 2025Nov 25, 2025

    • training_results_v5.1

      Public
      This repository contains the results and code for the MLPerf® Training v5.1 benchmark.
      Python
      •
      Apache License 2.0
      •2•2•1•0•Updated Nov 24, 2025Nov 24, 2025

    • mlperf_client

      Public
      MLPerf Client is a benchmark for Windows, Linux and macOS, focusing on client form factors in ML inference scenarios.
      benchmarkingmachine-learningml
      C++
      •
      Apache License 2.0
      •4•63•2•1•Updated Nov 17, 2025Nov 17, 2025

    • mobile_models

      Public
      MLPerf™ Mobile models
      Apache License 2.0
      •10•26•4•0•Updated Nov 16, 2025Nov 16, 2025

    • inference_results_v5.0

      Public
      This repository contains the results and code for the MLPerf™ Inference v5.0 benchmark.
      benchmarkingbenchmarkmachine-learning
      HTML
      •13•10•4•3•Updated Nov 13, 2025Nov 13, 2025