Commits

Branch selector

 v0.5.0

User selector

All users

Datepicker

All time

Commit History

Commits on Jan 9, 2025

• Merge pull request #208 from RobotSail/update-changelog

  Show description for e31d19b
  mergify[bot]

  authored
  e31d19b

  Copy full SHA for e31d19b

• chore: update changelog for 0.5.0

  Show description for ab37b54
  RobotSail

  committed
  ab37b54

  Copy full SHA for ab37b54

• Merge pull request #193 from RobotSail/add-ragas

  Show description for c437ef2
  mergify[bot]

  authored
  c437ef2

  Copy full SHA for c437ef2

Commits on Jan 8, 2025

• chore: decouple tests into more atomic units

  Show description for ab3d168
  RobotSail

  committed
  ab3d168

  Copy full SHA for ab3d168

• feat: update the Ragas evaluator to have the OpenAI client as something that gets passed in to __init__

  Show description for c6b5a70
  RobotSail

  committed
  c6b5a70

  Copy full SHA for c6b5a70

• chore: add unit tests for ragas evaluator

  Show description for 04117dd
  RobotSail

  committed
  04117dd

  Copy full SHA for 04117dd

• feat: add ability for answers to be generated from user questions

  Show description for 58880c3
  RobotSail

  committed
  58880c3

  Copy full SHA for 58880c3

• feat: add ability for ragas to read from a list

  Show description for 8568b13
  RobotSail

  committed
  8568b13

  Copy full SHA for 8568b13

• adds basic ragas eval

  Show description for 3443ffa
  RobotSail

  committed
  3443ffa

  Copy full SHA for 3443ffa

Commits on Dec 17, 2024

• Merge pull request #200 from RobotSail/add-discord-e2e

  Show description for 2e7e405
  mergify[bot]

  authored
  2e7e405

  Copy full SHA for 2e7e405

• feat: add discord e2e status reporting

  Show description for bc497ed
  RobotSail

  committed
  bc497ed

  Copy full SHA for bc497ed

• Merge pull request #199 from RobotSail/add-discord

  Show description for 0d44bbe
  mergify[bot]

  authored
  0d44bbe

  Copy full SHA for 0d44bbe

• Merge pull request #198 from instructlab/dependabot/github_actions/hynek/build-and-inspect-python-package-2.11.0

  Show description for 1aefd04
  mergify[bot]

  authored
  1aefd04

  Copy full SHA for 1aefd04

• Merge pull request #196 from instructlab/dependabot/github_actions/pypa/gh-action-pypi-publish-1.12.3

  Show description for a8bd84d
  mergify[bot]

  authored
  a8bd84d

  Copy full SHA for a8bd84d

• feat: update release-strategy to include discord

  Show description for 742e05a
  RobotSail

  committed
  742e05a

  Copy full SHA for 742e05a

Commits on Dec 16, 2024

• build(deps): bump hynek/build-and-inspect-python-package

  Show description for aeb500e
  dependabot[bot]

  authored
  aeb500e

  Copy full SHA for aeb500e

Commits on Dec 13, 2024

• Merge pull request #197 from RobotSail/fix-mmlu

  Show description for c086116
  mergify[bot]

  authored
  c086116

  Copy full SHA for c086116

• feat: introduce `results` attribute on MMLU evaluator

  Show description for ad12276
  RobotSail

  committed
  ad12276

  Copy full SHA for ad12276

• chore: update tests to include system prompt in MMLU evals

  Show description for fd78adf
  RobotSail

  committed
  fd78adf

  Copy full SHA for fd78adf

Commits on Dec 12, 2024

• feat: allow MMLU to pass `system_prompt` to lm_eval

  Show description for ab664b8
  RobotSail

  committed
  ab664b8

  Copy full SHA for ab664b8

Commits on Dec 10, 2024

• build(deps): bump pypa/gh-action-pypi-publish from 1.12.2 to 1.12.3

  Show description for 81ab1a9
  dependabot[bot]

  authored
  81ab1a9

  Copy full SHA for 81ab1a9

Commits on Dec 6, 2024

• Merge pull request #186 from instructlab/dependabot/github_actions/step-security/harden-runner-2.10.2

  Show description for 4cf3e14
  mergify[bot]

  authored
  4cf3e14

  Copy full SHA for 4cf3e14

• Merge pull request #192 from instructlab/dependabot/github_actions/actions/cache-4.2.0

  Show description for ce70503
  mergify[bot]

  authored
  ce70503

  Copy full SHA for ce70503

• Merge pull request #191 from danmcp/regionvar

  Show description for f9bd378
  mergify[bot]

  authored
  f9bd378

  Copy full SHA for f9bd378

• Merge pull request #190 from danmcp/diskcheck

  Show description for 1e8a52c
  mergify[bot]

  authored
  1e8a52c

  Copy full SHA for 1e8a52c

• build(deps): bump actions/cache from 4.1.2 to 4.2.0

  Show description for 2e2b8f6
  dependabot[bot]

  authored
  2e2b8f6

  Copy full SHA for 2e2b8f6

Commits on Dec 4, 2024

• Merge pull request #185 from danmcp/answersunittests

  Show description for ce8880f
  mergify[bot]

  authored
  ce8880f

  Copy full SHA for ce8880f

• Merge pull request #184 from danmcp/unittests

  Show description for e5d89c6
  mergify[bot]

  authored
  e5d89c6

  Copy full SHA for e5d89c6

• Merge pull request #183 from danmcp/nofailfast

  Show description for 046275f
  mergify[bot]

  authored
  046275f

  Copy full SHA for 046275f

• Merge pull request #182 from danmcp/slack

  Show description for 0b43e07
  mergify[bot]

  authored
  0b43e07

  Copy full SHA for 0b43e07

Commits on Nov 29, 2024

• Move AWS_REGION from using secret to var

  Show description for d8d6097
  danmcp

  committed
  d8d6097

  Copy full SHA for d8d6097

Commits on Nov 28, 2024

• Add disk check after tests run

  Show description for 552ce0c
  danmcp

  committed
  552ce0c

  Copy full SHA for 552ce0c

Commits on Nov 19, 2024

• build(deps): bump step-security/harden-runner from 2.10.1 to 2.10.2

  Show description for e71dcd7
  dependabot[bot]

  authored
  e71dcd7

  Copy full SHA for e71dcd7

Commits on Nov 18, 2024

• Add reorg answer file test

  Show description for 894e658
  danmcp

  committed
  894e658

  Copy full SHA for 894e658

• Add make judge single test

  Show description for 8989788
  danmcp

  committed
  8989788

  Copy full SHA for 8989788

Pagination

Previous

Next