Benchmark to estimate model sycophancy

LLM Arena by KCORES team

An example starter repo for Python projects

Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs

Evaluate AI models on biology benchmarks

future-proof vulnerability detection benchmark, based on CVEs in open-source repos

Inspect: A framework for large language model evaluations

Deep learning for dummies. All the practical details and useful utilities that go into working with real models.

A library for making RepE control vectors

An AI-aided tool to add to Community Notes to improve efficiency and help people write notes.

Every way to change your mind

idiosyncratic lecture notes on statistics

Big open puzzles that haven't been resolved yet.

Machine Learning Engineering Open Book

SWE-bench: Can Language Models Resolve Real-world Github Issues?

PyTorch-based library for various kinds of representational-similarity analysis

Resources for skilling up in AI alignment research engineering. Covers basics of deep learning, mechanistic interpretability, and RL.

Lab assignments for Introduction to Data-Centric AI, MIT IAP 2024 👩🏽‍💻

Official inference library for Mistral models

Linear algebra visualizations

Vim + LaTeX snippets setup

Collection of compatible forecasting datasets

An Infinitely Large Napkin