Commits

Branch selector

 main

User selector

Jialin

Datepicker

All time

Commit History

Commits on Nov 13, 2025

• [n-gen] DO NOT repeatedly return finished child requests (#28591)

  Show description for a1d3866
  Jialin

  authored
  a1d3866

  Copy full SHA for a1d3866

Commits on Nov 11, 2025

• [Perf] Use np.ndarray instead of list[list[int]] to reduce GC overhead (#28245)

  Show description for 4228be7
  Jialin

  authored
  4228be7

  Copy full SHA for 4228be7

Commits on Nov 10, 2025

• [Perf] Move gc.freeze logic from EngineCoreProc to EngineCore for better coverage (#27896)

  Show description for b30372c
  Jialin

  authored
  b30372c

  Copy full SHA for b30372c

Commits on Nov 7, 2025

• [Perf] Introduce FlattenLogprobs to store logprobs results to reduce GC overhead (#28171)

  Show description for ccd98b5
  Jialin

  authored
  ccd98b5

  Copy full SHA for ccd98b5

Commits on Oct 30, 2025

• [Core][Perf] Only invoke save_new_computed_blocks when computed blocks are not empty (#27799)

  Show description for 4b68c4a
  Jialin

  authored
  4b68c4a

  Copy full SHA for 4b68c4a

• [Core][Bookkeeping] Update cu_num_accepted_tokens for all req_index (#27629)

  Show description for 4574d48
  Jialin

  authored
  4574d48

  Copy full SHA for 4574d48

Commits on Oct 29, 2025

• [Core] Early return in SlidingWindowManager.remove_skipped_blocks (#27673)

  Show description for 0b51c9b
  Jialin

  authored
  0b51c9b

  Copy full SHA for 0b51c9b

Commits on Oct 28, 2025

• [Core][Bookkeeping Optimization] Update against numpy view of is_token_ids tensor (#27618)

  Show description for b46e4a0
  Jialin

  authored
  b46e4a0

  Copy full SHA for b46e4a0

Commits on Oct 15, 2025

• [Easy] Get rid of unnecessary paraenthesis in kv_cache_manager (#26842)

  Show description for 7f83b4e
  Jialin

  authored
  7f83b4e

  Copy full SHA for 7f83b4e

• [Core][Easy] Use envs.__getattr__ for all Unify to environment variable access (#26810)

  Show description for 07ca70a
  Jialin

  authored
  07ca70a

  Copy full SHA for 07ca70a

Commits on Oct 14, 2025

• [Perf] Cache vllm.env.__getattr__ result to avoid recomputation (#26146)

  Show description for 380f175
  Jialin

  authored
  380f175

  Copy full SHA for 380f175

• [Core] Reuse empty block lists whenever possible in KVCacheBlocks to mitigate GC costs (#24964)

  Show description for acaa2c0
  Jialin

  authored
  acaa2c0

  Copy full SHA for acaa2c0

• [Easy] Fix env type check errors from VLLM_DEBUG_LOG_API_SERVER_RESPONSE (#26742)

  Show description for cfded80
  Jialin

  authored
  cfded80

  Copy full SHA for cfded80

Commits on Oct 13, 2025

• [ResponseAPI] Further polish message serialization and unit tests (#26728)

  Show description for 35bc22f
  Jialin

  authored
  35bc22f

  Copy full SHA for 35bc22f

• [ResponseAPI] Simplify input/output message serialization (#26620)

  Show description for 4073c82
  Jialin

  authored
  4073c82

  Copy full SHA for 4073c82

Commits on Oct 5, 2025

• [Perf][Easy] Early stop in request_block_hasher (#26112)

  Show description for 201c971
  Jialin

  authored
  201c971

  Copy full SHA for 201c971

Commits on Sep 27, 2025

• [Core] GC Debug callback (#24829)

  Show description for c216119
  

  Jialin

  and

  JialinOuyang-Meta

  authored
  c216119

  Copy full SHA for c216119

Commits on Sep 23, 2025

• [Core] Use KVCacheBlock as much as possible instead of dict[block_id, KVCacheBlock] (#24830)

  Show description for 4f8c4b8
  Jialin

  authored
  4f8c4b8

  Copy full SHA for 4f8c4b8

Commits on Sep 19, 2025

• [Core][Prefix Hash] Fix prefix hash metrics sliding window maintainance (#24990)

  Show description for 2506ce5
  Jialin

  authored
  2506ce5

  Copy full SHA for 2506ce5

Commits on Aug 13, 2025

• [Core] [N-gram SD Optimization][1/n] Propose tokens with a single KMP (#22437)

  Show description for 31a500c
  Jialin

  authored
  31a500c

  Copy full SHA for 31a500c

Commits on Jul 23, 2025

• [Core] Add basic unit test for maybe_evict_cached_block (#21400)

  Show description for a1f3610
  Jialin

  authored
  a1f3610

  Copy full SHA for a1f3610

Commits on Jul 22, 2025

• [Core] Introduce popleft_n and append_n in FreeKVCacheBlockQueue to further optimize block_pool (#21222)

  Show description for ed25054
  Jialin

  authored
  ed25054

  Copy full SHA for ed25054

• [benchmark] Port benchmark request sent optimization to benchmark_serving (#21209)

  Show description for 10904e6
  Jialin

  authored
  10904e6

  Copy full SHA for 10904e6

• [Core] Optimize update checks in LogitsProcessor (#21245)

  Show description for a322376
  Jialin

  authored
  a322376

  Copy full SHA for a322376

• [Core] Minimize number of dict lookup in _maybe_evict_cached_block (#21281)

  Show description for af376ca
  Jialin

  authored
  af376ca

  Copy full SHA for af376ca

Commits on Jul 18, 2025

• [benchmark] Sending request strictly follows the random intervals (#21108)

  Show description for 1bf6513
  Jialin

  authored
  1bf6513

  Copy full SHA for 1bf6513