Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: mistralai/mistral-evals
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: main
Choose a base ref
...
head repository: neuralmagic/mistral-evals
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: main
Choose a head ref
  • 17 commits
  • 4 files changed
  • 2 contributors

Commits on Oct 22, 2024

  1. Set trust_remote_code for vqav2 task

    @shubhra
    shubhra committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    33f7f42 View commit details
    Browse the repository at this point in the history

  2. Set ignore_verifications

    @shubhra
    shubhra committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    f2b8ff0 View commit details
    Browse the repository at this point in the history

  3. Handle repo card missing error

    @shubhra
    shubhra committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    fd48723 View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. Fix indentation

    @shubhra
    shubhra committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    fdf296c View commit details
    Browse the repository at this point in the history

Commits on Nov 19, 2024

  1. vqav2 metric calculation update

    @shubhra
    shubhra committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    7adb5fe View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2024

  1. Updated reference and model answer preprocessing for metric computation

    @shubhra
    shubhra committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    0fa3e94 View commit details
    Browse the repository at this point in the history

  2. Remove testing code

    @shubhra
    shubhra committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    36f38d4 View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2025

  1. Workaround mathvista crash

    @shubhra
    shubhra committed Jan 31, 2025
    Configuration menu
    Copy the full SHA
    564094b View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2025

  1. Change cache dir to network drive for vqav2

    @shubhra
    shubhra committed Feb 8, 2025
    Configuration menu
    Copy the full SHA
    6c0ba86 View commit details
    Browse the repository at this point in the history

  2. Change cache dir to network drive for vqav2

    @shubhra
    shubhra committed Feb 8, 2025
    Configuration menu
    Copy the full SHA
    ee0e972 View commit details
    Browse the repository at this point in the history

  3. Change cache dir to network drive for vqav2

    @shubhra
    shubhra committed Feb 8, 2025
    Configuration menu
    Copy the full SHA
    5187d32 View commit details
    Browse the repository at this point in the history

  4. Change cache dir to network drive for vqav2

    @shubhra
    shubhra committed Feb 8, 2025
    Configuration menu
    Copy the full SHA
    16e2875 View commit details
    Browse the repository at this point in the history

  5. Load vqav2 directly from path

    @shubhra
    shubhra committed Feb 8, 2025
    Configuration menu
    Copy the full SHA
    94a48f8 View commit details
    Browse the repository at this point in the history

  6. Load vqav2 directly from path

    @shubhra
    shubhra committed Feb 8, 2025
    Configuration menu
    Copy the full SHA
    d591f1d View commit details
    Browse the repository at this point in the history

  7. Remove logging

    @shubhra
    shubhra committed Feb 8, 2025
    Configuration menu
    Copy the full SHA
    71662be View commit details
    Browse the repository at this point in the history

Commits on Mar 20, 2025

  1. Merge branch 'shubhra/vqav2' 

    Update VQAv2
    Shubhra Pandit committed Mar 20, 2025
    Configuration menu
    Copy the full SHA
    febf207 View commit details
    Browse the repository at this point in the history

  2. Fix vqav2 load path

    Shubhra Pandit committed Mar 20, 2025
    Configuration menu
    Copy the full SHA
    a849bd1 View commit details
    Browse the repository at this point in the history
Loading