Commits

Branch selector

 main

User selector

xiezhq-hermann

Datepicker

All time

Commit History

Commits on Jun 18, 2025

• Upstreaming hicache bug fixes (#7267)

  xiezhq-hermann

  authored
  e56685a

  Copy full SHA for e56685a

Commits on May 6, 2025

• Fix problem of large page size with chunked prefill (#6046)

  xiezhq-hermann

  authored
  b26cb1c

  Copy full SHA for b26cb1c

Commits on May 5, 2025

• Fix prefill OOM error in the case of large page size (#5081)

  xiezhq-hermann

  authored
  f8e4609

  Copy full SHA for f8e4609

Commits on Apr 21, 2025

• upstream hicache fixes (#5570)

  xiezhq-hermann

  authored
  70645f4

  Copy full SHA for 70645f4

Commits on Apr 20, 2025

• fix hicache write back (#5543)

  xiezhq-hermann

  authored
  e2574ee

  Copy full SHA for e2574ee

Commits on Apr 3, 2025

• fix deepgemm as well (#5030)

  xiezhq-hermann

  authored
  9d0b36c

  Copy full SHA for 9d0b36c

• update cutlass tag (#5011)

  xiezhq-hermann

  authored
  a2aea59

  Copy full SHA for a2aea59

Commits on Apr 2, 2025

• bug fix for hicache host eviction (#4989)

  xiezhq-hermann

  authored
  3fadc64

  Copy full SHA for 3fadc64

• Large page size aligned hierarchical caching (#4581)

  xiezhq-hermann

  authored
  e119f04

  Copy full SHA for e119f04

Commits on Apr 1, 2025

• Prevent memory leak of retract_decode when page_size > 1 (#4977)

  xiezhq-hermann

  authored
  12047f5

  Copy full SHA for 12047f5

Commits on Mar 31, 2025

• Fix oom error for large page size (#4913)

  Show description for a169b9f
  

  xiezhq-hermann

  and

  merrymercy

  authored
  a169b9f

  Copy full SHA for a169b9f

Commits on Mar 23, 2025

• Move mem_state update into debug mode (#4525)

  xiezhq-hermann

  authored
  4d25305

  Copy full SHA for 4d25305

Commits on Mar 22, 2025

• Bug fix for metrics counter (#4660)

  xiezhq-hermann

  authored
  ecbfe58

  Copy full SHA for ecbfe58

Commits on Mar 18, 2025

• Unit test for Hierarchical Caching (#4486)

  xiezhq-hermann

  authored
  a98290a

  Copy full SHA for a98290a

Commits on Mar 17, 2025

• Fix: Complete int32 to int64 conversion (#4465)

  xiezhq-hermann

  authored
  f5bbf60

  Copy full SHA for f5bbf60

Commits on Mar 13, 2025

• Hot fix for hicache with new page aligned radixtree (#4397)

  xiezhq-hermann

  authored
  fbdb505

  Copy full SHA for fbdb505

Commits on Mar 12, 2025

• Hierarchical Caching Refactoring and Fixing TP issue (#4082)

  xiezhq-hermann

  authored
  10b544a

  Copy full SHA for 10b544a

Commits on Mar 7, 2025

• Memory pool fix for upstream change about eagle (#4170)

  xiezhq-hermann

  authored
  9376ac3

  Copy full SHA for 9376ac3

Commits on Mar 6, 2025

• Add a pointer to the real KV cache pool (#4113)

  xiezhq-hermann

  authored
  aee3063

  Copy full SHA for aee3063

Commits on Feb 24, 2025

• Hierarchical Caching for SGLang (#2693)

  Show description for 6c7a152
  

  3 peopleauthored
  6c7a152

  Copy full SHA for 6c7a152

Commits on Jan 27, 2025

• Sanity check to prevent performance regression (#3171)

  Show description for 08104b5
  

  xiezhq-hermann

  and

  merrymercy

  authored
  08104b5

  Copy full SHA for 08104b5

Commits on Jan 18, 2025

• Query remaining memory dynamically for PrefillAdder (#2941)

  xiezhq-hermann

  authored
  8af7048

  Copy full SHA for 8af7048

• Multi-turn benchmark for hierarchical caching (#2942)

  xiezhq-hermann

  authored
  13387e6

  Copy full SHA for 13387e6

Commits on Jan 11, 2025

• Cache controller for hierarchical caching (#2804)

  xiezhq-hermann

  authored
  5d6e946

  Copy full SHA for 5d6e946

Commits on Jan 7, 2025

• Host memory pool for hierarchical caching (#2771)

  xiezhq-hermann

  authored
  51caee7

  Copy full SHA for 51caee7

Commits on Aug 29, 2024

• fix data racing due to mutable reference using deepcopy (#1255)

  xiezhq-hermann

  authored
  8153168

  Copy full SHA for 8153168

Commits on Aug 7, 2024

• misc: correct the int data type for token ids and indices (#969)

  xiezhq-hermann

  authored
  6db27f7

  Copy full SHA for 6db27f7