Commits

Branch selector

 main

User selector

KuntaiDu

Datepicker

All time

Commit History

Commits on Nov 6, 2025

• [Core][Hybrid allocator + connector 2/n] Unify `remove_skipped_blocks` by `get_last_useful_token` (#25431)

  Show description for efe73e9
  KuntaiDu

  authored
  efe73e9

  Copy full SHA for efe73e9

Commits on Nov 5, 2025

• [Hybrid allocator + kv connector] revert connector test changes related to hybrid allocator (#28011)

  Show description for 86dca07
  KuntaiDu

  authored
  86dca07

  Copy full SHA for 86dca07

Commits on Oct 30, 2025

• [Benchmark] Cleanup deprecated nightly benchmark and adjust the docstring for performance benchmark (#25786)

  Show description for 8bff831
  KuntaiDu

  authored
  8bff831

  Copy full SHA for 8bff831

Commits on Oct 28, 2025

• [Stability fix] turn off HMA allocator when connector is set (#27592)

  Show description for 255e34c
  KuntaiDu

  authored
  255e34c

  Copy full SHA for 255e34c

Commits on Oct 25, 2025

• [Core][Hybrid allocator + kv connector 1/n] Enable hybrid allocator + KV cache connector (#25712)

  Show description for b853540
  KuntaiDu

  authored
  b853540

  Copy full SHA for b853540

Commits on Jul 28, 2025

• Revert "[V1] Exception Handling when Loading KV Cache from Remote Store" (#21778)

  Show description for b18b417
  KuntaiDu

  authored
  b18b417

  Copy full SHA for b18b417

Commits on Jul 14, 2025

• [Docs] remove outdated performance benchmark (#20935)

  Show description for 55e1c66
  KuntaiDu

  authored
  55e1c66

  Copy full SHA for 55e1c66

Commits on Jul 10, 2025

• [Bugfix][Benchmark] Make sure the output length > 0 when testing prefill workload. (#20786)

  Show description for 5b6fe23
  

  KuntaiDu

  and

  gemini-code-assist[bot]

  authored
  5b6fe23

  Copy full SHA for 5b6fe23

Commits on Jul 1, 2025

• [Example] add one-click runnable example for P2P NCCL XpYd (#20246)

  Show description for 92ee7ba
  KuntaiDu

  authored
  92ee7ba

  Copy full SHA for 92ee7ba

Commits on May 11, 2025

• [Perf] Use small max_num_batched_tokens for A100 (#17885)

  Show description for 9112155
  KuntaiDu

  authored
  9112155

  Copy full SHA for 9112155

Commits on Apr 28, 2025

• [Doc] Fix wrong github link in LMCache examples (#17274)

  Show description for 9053d0b
  KuntaiDu

  authored
  9053d0b

  Copy full SHA for 9053d0b

Commits on Mar 4, 2025

• [Security] Serialize using safetensors instead of pickle in Mooncake Pipe (#14228)

  Show description for 288ca11
  KuntaiDu

  authored
  288ca11

  Copy full SHA for 288ca11

Commits on Mar 1, 2025

• [Documentation] Add more deployment guide for Kubernetes deployment (#13841)

  Show description for 8994dab
  KuntaiDu

  authored
  8994dab

  Copy full SHA for 8994dab

Commits on Jan 17, 2025

• [Bugfix] Fix a path bug in disaggregated prefill example script. (#12121)

  Show description for ebc73f2
  KuntaiDu

  authored
  ebc73f2

  Copy full SHA for ebc73f2

Commits on Jan 10, 2025

• Doc fix in `benchmark_long_document_qa_throughput.py` (#11933)

  Show description for 5959564
  KuntaiDu

  authored
  5959564

  Copy full SHA for 5959564

• [Docs] Fix docstring in `get_ip` function (#11932)

  Show description for f33e033
  KuntaiDu

  authored
  f33e033

  Copy full SHA for f33e033

Commits on Dec 29, 2024

• [Misc] KV cache transfer connector registry (#11481)

  Show description for faef77c
  KuntaiDu

  authored
  faef77c

  Copy full SHA for faef77c

Commits on Dec 15, 2024

• [Doc] add documentation for disaggregated prefilling (#11197)

  Show description for 38e599d
  KuntaiDu

  authored
  38e599d

  Copy full SHA for 38e599d

Commits on Dec 2, 2024

• [Core] Implement disagg prefill by StatelessProcessGroup (#10502)

  Show description for 0590ec3
  

  3 peopleauthored
  0590ec3

  Copy full SHA for 0590ec3

Commits on Oct 22, 2024

• [Core] Remove evictor_v1 (#9572)

  KuntaiDu

  authored
  ca30c3c

  Copy full SHA for ca30c3c

Commits on Oct 21, 2024

• [CI] Make format checker error message more user-friendly by using emoji (#9564)

  Show description for 575dceb
  KuntaiDu

  authored
  575dceb

  Copy full SHA for 575dceb

Commits on Oct 17, 2024

• [Core] Deprecating block manager v1 and make block manager v2 default (#8704)

  Show description for 81ede99
  KuntaiDu

  authored
  81ede99

  Copy full SHA for 81ede99

Commits on Oct 7, 2024

• [Doc] Include performance benchmark in README (#9135)

  KuntaiDu

  authored
  c0d9a98

  Copy full SHA for c0d9a98

Commits on Oct 4, 2024

• [CI] Update performance benchmark: upgrade trt-llm to r24.07, and add SGLang (#7412)

  KuntaiDu

  authored
  fbb7442

  Copy full SHA for fbb7442

Commits on Sep 19, 2024

• [Bugfix] fixing sonnet benchmark bug in benchmark_serving.py (#8616)

  KuntaiDu

  authored
  c52ec5f

  Copy full SHA for c52ec5f

Commits on Aug 20, 2024

• [CI] Organizing performance benchmark files (#7616)

  KuntaiDu

  authored
  3d8a5f0

  Copy full SHA for 3d8a5f0

Commits on Aug 16, 2024

• [CI] Fix crashes of performance benchmark (#7500)

  KuntaiDu

  authored
  6fc5b0f

  Copy full SHA for 6fc5b0f

Commits on Aug 3, 2024

• [CI] Temporarily turn off H100 performance benchmark (#7104)

  KuntaiDu

  authored
  67d745c

  Copy full SHA for 67d745c

Commits on Jul 25, 2024

• [Doc] Add documentations for nightly benchmarks (#6412)

  KuntaiDu

  authored
  6a1e25b

  Copy full SHA for 6a1e25b

Commits on Jul 11, 2024

• [CI/Build] Add nightly benchmarking for tgi, tensorrt-llm and lmdeploy (#5362)

  KuntaiDu

  authored
  a4feba9

  Copy full SHA for a4feba9

Commits on Jun 18, 2024

• [CI] Avoid naming different metrics with the same name in performance benchmark (#5615)

  KuntaiDu

  authored
  114d727

  Copy full SHA for 114d727

Commits on Jun 17, 2024

• [CI] the readability of benchmarking and prepare for dashboard (#5571)

  Show description for 9e4e6fe
  KuntaiDu

  authored
  9e4e6fe

  Copy full SHA for 9e4e6fe

Commits on Jun 14, 2024

• [CI/Build][Misc] Add CI that benchmarks vllm performance on those PRs with `perf-benchmarks` label (#5073)

  Show description for 319ad7f
  

  KuntaiDu

  and

  simon-mo

  authored
  319ad7f

  Copy full SHA for 319ad7f

Commits on Jun 11, 2024

• [Doc] Add an automatic prefix caching section in vllm documentation (#5324)

  Show description for 9fde251
  

  KuntaiDu

  and

  simon-mo

  authored
  9fde251

  Copy full SHA for 9fde251

Commits on May 20, 2024

• [Doc]Add documentation to benchmarking script when running TGI (#4920)

  KuntaiDu

  authored
  c3af447

  Copy full SHA for c3af447

Pagination

Previous

Next