Commits

Branch selector

 main

User selector

edbeeching

Datepicker

All time

Commit History

Commits on Aug 29, 2024

• Adds experimental Liger support to SFT script (#1992)

  Show description for 4dd0dc2
  

  edbeeching

  and

  lewtun

  authored
  4dd0dc2

  Copy full SHA for 4dd0dc2

Commits on Jul 26, 2024

• fix online dpo example (#1879)

  edbeeching

  authored
  74e54b5

  Copy full SHA for 74e54b5

Commits on Apr 12, 2024

• VSFT hotfix - adds gen prompt to template and processor to hub (#1532)

  Show description for 1c0d8bc
  edbeeching

  authored
  1c0d8bc

  Copy full SHA for 1c0d8bc

Commits on Apr 11, 2024

• Adds VLM Training support to SFTTrainer + VSFT script (#1518)

  Show description for 346c99d
  

  edbeeching

  and

  younesbelkada

  authored
  346c99d

  Copy full SHA for 346c99d

Commits on Nov 30, 2023

• Fixes reward and text gathering in distributed training (#850)

  Show description for 481ef96
  

  3 peopleauthored
  481ef96

  Copy full SHA for 481ef96

Commits on Nov 6, 2023

• Adds model kwargs to SFT and DPO trainers (#951)

  Show description for c273b18
  edbeeching

  authored
  c273b18

  Copy full SHA for c273b18

Commits on Jul 27, 2023

• Computes the KL penalty using the entire distribution (#541)

  Show description for 31658b4
  edbeeching

  authored
  31658b4

  Copy full SHA for 31658b4

Commits on Jul 5, 2023

• Adds some options to stabilize the KL penalty (#486)

  Show description for 2b531b9
  

  3 peopleauthored
  2b531b9

  Copy full SHA for 2b531b9

Commits on Apr 5, 2023

• stack-llama (#273)

  Show description for d8ae4d0
  

  edbeeching

  and

  lvwerra

  authored
  d8ae4d0

  Copy full SHA for d8ae4d0

Commits on Mar 23, 2023

• adds early stopping (#238)

  Show description for 1620da3
  edbeeching

  authored
  1620da3

  Copy full SHA for 1620da3

Commits on Mar 16, 2023

• adds a missing detach to the ratio (#224)

  Show description for 90f0090
  edbeeching

  authored
  90f0090

  Copy full SHA for 90f0090

• Grad accumulation and memory bugfix (#220)

  Show description for 768c389
  edbeeching

  authored
  768c389

  Copy full SHA for 768c389

Commits on Mar 9, 2023

• adds sentiment example for a 20b model (#208)

  Show description for ddb6df3
  

  edbeeching

  and

  younesbelkada

  authored
  ddb6df3

  Copy full SHA for ddb6df3

Commits on Mar 7, 2023

• `peft` integration (#163)

  Show description for 679f29d
  

  edbeeching

  and

  younesbelkada

  authored
  679f29d

  Copy full SHA for 679f29d

Commits on Jan 25, 2023

• Convert notebook 05 (#80)

  Show description for 6b37618
  

  edbeeching

  and

  leandro

  authored
  6b37618

  Copy full SHA for 6b37618

Commits on Jan 5, 2023

• Merge pull request #70 from lvwerra/improvements-1a

  Show description for 7eba287
  edbeeching

  authored
  7eba287

  Copy full SHA for 7eba287

Commits on Jan 4, 2023

• make quality

  edbeeching

  committed
  74a650d

  Copy full SHA for 74a650d

• updates based on feedback to PR

  edbeeching

  committed
  e9ddf0d

  Copy full SHA for e9ddf0d

• fixed isort issue

  edbeeching

  committed
  db2fb06

  Copy full SHA for db2fb06

• more fixing isort

  edbeeching

  committed
  e30cd46

  Copy full SHA for e30cd46

• still debugging isort

  edbeeching

  committed
  f3c9ab6

  Copy full SHA for f3c9ab6

• debugging isort issue

  edbeeching

  committed
  c047e11

  Copy full SHA for c047e11

• updates gitignore for wandb files

  edbeeching

  committed
  9ff1510

  Copy full SHA for 9ff1510

• adds accelerate as a dependency

  edbeeching

  committed
  5286000

  Copy full SHA for 5286000

• Updates README

  edbeeching

  committed
  12b0e83

  Copy full SHA for 12b0e83

• adds relative imports, fixes a circular import

  edbeeching

  committed
  8b0b393

  Copy full SHA for 8b0b393

• updates setup.py, removes settings.ini

  edbeeching

  committed
  b4c5c01

  Copy full SHA for b4c5c01

Commits on Dec 21, 2022

• Merge pull request #55 from lvwerra/tests-and-github-actions

  Show description for 2b6dae8
  edbeeching

  authored
  2b6dae8

  Copy full SHA for 2b6dae8

• removes 3.6 from test suite, adds windows to test suite

  edbeeching

  committed
  a69b11c

  Copy full SHA for a69b11c

• updates test and transformers version

  edbeeching

  committed
  389bb27

  Copy full SHA for 389bb27

• adds test of gpt2 model trainer

  edbeeching

  committed
  44fef31

  Copy full SHA for 44fef31

• loosens transformer restriction

  edbeeching

  committed
  e9b980e

  Copy full SHA for e9b980e

• using ubuntu 20.04 as it supports python 3.6

  edbeeching

  committed
  0096534

  Copy full SHA for 0096534

• removed python 36 for the moment as it is not support on ubuntu 22

  edbeeching

  committed
  a571298

  Copy full SHA for a571298

• Adds github actions, a dummy tests and updates setup.py file with extra requirements

  edbeeching

  committed
  2dc7735

  Copy full SHA for 2dc7735