Search results

为什么推理的时候推多次总有100多条样本 答案为空

Status: Open.

#133 In THUDM/LongBench;

· llllllaz opened on Sep 28, 2025

Add evaluation script for memory-augmented models (A-Mem, Mem0, etc.) on LongBench & LongBench v2

Status: Open.

#132 In THUDM/LongBench;

· xcczach opened on Aug 7, 2025

Adapting pred.py to non-chat models.

Status: Open.

#131 In THUDM/LongBench;

· DragonEntropy opened on Aug 6, 2025

Important context information missing for some Qasper tasks in LongBench v1

Status: Open.

#130 In THUDM/LongBench;

· VisionTheta opened on Jun 24, 2025

o3?

Status: Open.

#129 In THUDM/LongBench;

· OverLordGoldDragon opened on Jun 6, 2025

数据集问题：ID 66f39ac5821e116aacb2da81 的答案无法在 context 中找到

enhancementNew feature or requestNew feature or request

Status: Open.

Bug

#128 In THUDM/LongBench;

· xcczach opened on May 13, 2025

怎么测试qwen2.5系列模型

Status: Open.

#127 In THUDM/LongBench;

· leileilin opened on May 12, 2025

[error need help] error to run longbench V1 following the document

Status: Open.

#125 In THUDM/LongBench;

· gaowayne opened on Apr 26, 2025

[bugs and help need] I followed main readme page guideline, there is connection error and model running error

Status: Open.

#124 In THUDM/LongBench;

· gaowayne opened on Apr 26, 2025

How you evaluate reasoning models like QwQ-32B, since the response time and token length is very long?

Status: Open.

#123 In THUDM/LongBench;

· txchen-USTC opened on Apr 21, 2025

Reproducibility Question

Status: Open.

#119 In THUDM/LongBench;

· qinchuanhui opened on Apr 3, 2025

A bug that has been mentioned many times: 'NoneType' object is not callable

Status: Open.

#118 In THUDM/LongBench;

· zZzZ9zZ9 opened on Apr 1, 2025