Commits

Branch selector

 main

User selector

NickLucche

Datepicker

All time

Commit History

Commits on Nov 12, 2025

• [Misc] Refactor Attention kv transfer methods into decorator (#27816)

  Show description for 728a9eb
  

  NickLucche

  and

  markmc

  authored
  728a9eb

  Copy full SHA for 728a9eb

Commits on Nov 11, 2025

• [NIXL] Generalize block-first backend layouts (FlashInfer-like) (#28282)

  NickLucche

  authored
  a7ef3eb

  Copy full SHA for a7ef3eb

Commits on Nov 9, 2025

• [CI] Fix flaky `test_eagle_correctness` test (#28364)

  Show description for 19d91ec
  NickLucche

  authored
  19d91ec

  Copy full SHA for 19d91ec

Commits on Nov 7, 2025

• Revert "[PerfFix] Avoid separate thread for MP executor shm spin (#28012)" (#28289)

  Show description for 68a72a5
  NickLucche

  authored
  68a72a5

  Copy full SHA for 68a72a5

Commits on Oct 29, 2025

• [KVConnector] Add metrics to Prometheus-Grafana dashboard (#26811)

  Show description for accb8fa
  

  NickLucche

  and

  markmc

  authored
  accb8fa

  Copy full SHA for accb8fa

• [CI] Fix flaky `test_two_responses_with_same_prev_id` test (#27745)

  Show description for 0f95a1c
  NickLucche

  authored
  0f95a1c

  Copy full SHA for 0f95a1c

Commits on Oct 22, 2025

• [P/D] Dynamic `kv_output_aggregator` collect size (#26734)

  Show description for 4dfdb82
  NickLucche

  authored
  4dfdb82

  Copy full SHA for 4dfdb82

• [CI] Nixl integration tests DP-EP (#27199)

  Show description for bfa59be
  NickLucche

  authored
  bfa59be

  Copy full SHA for bfa59be

Commits on Oct 21, 2025

• [Nixl] Minor refactor to handshake related metadata (#26410)

  Show description for 72f431e
  NickLucche

  authored
  72f431e

  Copy full SHA for 72f431e

Commits on Oct 20, 2025

• [Bugfix][CI] Fix `Distributed Tests (4 GPUs)` async_sched+ray test (#27195)

  Show description for f9e7ad5
  NickLucche

  authored
  f9e7ad5

  Copy full SHA for f9e7ad5

Commits on Oct 18, 2025

• [Misc] Refactor `get_kv_cache_spec` into `AttentionLayerBase` (#26587)

  Show description for b26b70b
  NickLucche

  authored
  b26b70b

  Copy full SHA for b26b70b

Commits on Oct 17, 2025

• [CI] Remove forbidden slash (#27112)

  Show description for 99722d5
  NickLucche

  authored
  99722d5

  Copy full SHA for 99722d5

• [CI] Nixl integration tests (#27010)

  Show description for 2ba60ec
  NickLucche

  authored
  2ba60ec

  Copy full SHA for 2ba60ec

Commits on Oct 8, 2025

• [Kernel] Centralize platform kernel import in `current_platform.import_kernels` (#26286)

  Show description for 4ebc910
  NickLucche

  authored
  4ebc910

  Copy full SHA for 4ebc910

Commits on Oct 4, 2025

• [Bugfix] Fix `_reqs_to_process` leak on abort (#26012)

  Show description for 2a6dc67
  NickLucche

  authored
  2a6dc67

  Copy full SHA for 2a6dc67

Commits on Oct 3, 2025

• [NIXL][Misc] Expose metrics from NIXL for logging to CLI (#25388)

  Show description for 48f3090
  NickLucche

  authored
  48f3090

  Copy full SHA for 48f3090

Commits on Sep 30, 2025

• [NIXL] Add support for MLA caches with different latent dim (#25902)

  Show description for 80608ba
  

  NickLucche

  and

  heheda12345

  authored
  80608ba

  Copy full SHA for 80608ba

Commits on Sep 29, 2025

• [NIXL] Increase default KV block eviction timeout on P (#25897)

  Show description for 2e4fe48
  NickLucche

  authored
  2e4fe48

  Copy full SHA for 2e4fe48

Commits on Sep 27, 2025

• [Bugfix][NIXL] Fix Async Scheduler timeout issue (#25808)

  Show description for da63274
  NickLucche

  authored
  da63274

  Copy full SHA for da63274

Commits on Sep 25, 2025

• [Misc] Remove cruft file in repo (#25678)

  Show description for 0754ac4
  NickLucche

  authored
  0754ac4

  Copy full SHA for 0754ac4

Commits on Sep 23, 2025

• [Bugfix] Fix missing `clear_connector_metadata` (#25397)

  Show description for 0901970
  NickLucche

  authored
  0901970

  Copy full SHA for 0901970

Commits on Sep 22, 2025

• [TPU] Deprecate `xm.mark_step` in favor of ``torch_xla.sync` (#25254)

  Show description for 4cf71cc
  

  NickLucche

  and

  yeqcharlotte

  authored
  4cf71cc

  Copy full SHA for 4cf71cc

• [TPU][Bugfix][CI] Fix broken tests/build dependency (#25255)

  Show description for a66d131
  NickLucche

  authored
  a66d131

  Copy full SHA for a66d131

Commits on Sep 19, 2025

• [P/D][Nixl] Introduce `KVTransferMetrics` and aggregation strategy (#22188)

  Show description for a3d087a
  NickLucche

  authored
  a3d087a

  Copy full SHA for a3d087a

Commits on Sep 18, 2025

• [Misc] Add kv-connector label (#25156)

  Show description for bc19d75
  NickLucche

  authored
  bc19d75

  Copy full SHA for bc19d75

Commits on Sep 15, 2025

• [XPU] Set consistent default KV cache layout (#24745)

  Show description for 2e41f5a
  NickLucche

  authored
  2e41f5a

  Copy full SHA for 2e41f5a

• [Misc] Own KVConnectors installation (#24867)

  Show description for a0d8b97
  NickLucche

  authored
  a0d8b97

  Copy full SHA for a0d8b97

Commits on Sep 11, 2025

• [Docs] Add transcription support to model (#24664)

  Show description for 404c85c
  NickLucche

  authored
  404c85c

  Copy full SHA for 404c85c

• [Misc] Add @NickLucche to codeowners (#24647)

  Show description for a1213fa
  NickLucche

  authored
  a1213fa

  Copy full SHA for a1213fa

Commits on Sep 9, 2025

• [Docs] Gemma3n `transcriptions` endpoint support (#24512)

  Show description for 3707cb2
  NickLucche

  authored
  3707cb2

  Copy full SHA for 3707cb2

Commits on Sep 4, 2025

• [Frontend] Skip unnecessary detokenization when token_id is requested (#24236)

  Show description for 65e0389
  NickLucche

  authored
  65e0389

  Copy full SHA for 65e0389

Commits on Sep 3, 2025

• [Nixl] Heterogeneous TP support FlashInfer (#20189)

  Show description for f0c503f
  NickLucche

  authored
  f0c503f

  Copy full SHA for f0c503f

Commits on Sep 2, 2025

• [Gemma3n] Fix audio batching (#24052)

  Show description for 0a74e9d
  NickLucche

  authored
  0a74e9d

  Copy full SHA for 0a74e9d

Commits on Sep 1, 2025

• [Frontend] Gemma3n audio `transcriptions`/`translations` endpoint (#23735)

  Show description for d46934b
  

  NickLucche

  and

  DarkLight1337

  authored
  d46934b

  Copy full SHA for d46934b

Commits on Aug 16, 2025

• [Kernel] Simplify `get_kv_cache_layout` and cache `use_trtllm_attention` env-dependent bit (#22735)

  Show description for 070da66
  NickLucche

  authored
  070da66

  Copy full SHA for 070da66

Pagination

Previous

Next