Commits

Branch selector

 main

User selector

njhill

Datepicker

All time

Commit History

Commits on Nov 13, 2025

• [BugFix] Fix `mm_encoder_attn_backend` arg type checking (#28599)

  Show description for 8832fff
  njhill

  authored
  8832fff

  Copy full SHA for 8832fff

Commits on Nov 9, 2025

• [Core] Simplify async KV output aggregation (#28327)

  Show description for 289eb6c
  njhill

  authored
  289eb6c

  Copy full SHA for 289eb6c

Commits on Nov 7, 2025

• [PerfFix] Avoid separate thread for MP executor shm spin (take 2) (#28319)

  Show description for 67a2da8
  njhill

  authored
  67a2da8

  Copy full SHA for 67a2da8

• [Core] Rework handling of async scheduling config (#28250)

  Show description for da786e3
  njhill

  authored
  da786e3

  Copy full SHA for da786e3

Commits on Nov 4, 2025

• [AsyncScheduling] Don't schedule past request max_tokens (#27922)

  Show description for 938a816
  njhill

  authored
  938a816

  Copy full SHA for 938a816

• [PerfFix] Avoid separate thread for MP executor shm spin (#28012)

  Show description for c9f66da
  njhill

  authored
  c9f66da

  Copy full SHA for c9f66da

• [BugFix] Fix incorrect preallocated sampled_token_ids tensor size (#28025)

  Show description for 5a0a6df
  njhill

  authored
  5a0a6df

  Copy full SHA for 5a0a6df

Commits on Nov 1, 2025

• [BugFix] Fix mixed penalties batch with async scheduling (#27910)

  Show description for c2ed069
  njhill

  authored
  c2ed069

  Copy full SHA for c2ed069

• [Core] Async scheduling + structured outputs compatibility (#26866)

  Show description for 0cdbe7b
  njhill

  authored
  0cdbe7b

  Copy full SHA for 0cdbe7b

Commits on Oct 31, 2025

• [Cleanup] Remove no-longer-used `SpeculativeConfig.enable_chunked_prefill` (#27826)

  Show description for 9e5bd30
  njhill

  authored
  9e5bd30

  Copy full SHA for 9e5bd30

Commits on Oct 30, 2025

• [BugFix] Fix broken import in initialize_ray_cluster() (#27838)

  Show description for c9791f1
  njhill

  authored
  c9791f1

  Copy full SHA for c9791f1

• [BugFix] Handle unscheduled requests properly when async scheduling (#27756)

  Show description for 2ce5c5d
  njhill

  authored
  2ce5c5d

  Copy full SHA for 2ce5c5d

Commits on Oct 29, 2025

• [BugFix] Fix handling of resumed reqs in `SharedStorageConnector` (#27719)

  Show description for d4aa144
  njhill

  authored
  d4aa144

  Copy full SHA for d4aa144

Commits on Oct 28, 2025

• [AsyncScheduling] Make async overlap work with logprobs (#27615)

  Show description for 4fe5895
  njhill

  authored
  4fe5895

  Copy full SHA for 4fe5895

• [V0 Deprecation] Remove vestigial V0 logits_processors.py file (#27601)

  Show description for 7a865f2
  njhill

  authored
  7a865f2

  Copy full SHA for 7a865f2

Commits on Oct 21, 2025

• [V0 Deprecation] Remove V0 executors (#27142)

  Show description for 647214f
  njhill

  authored
  647214f

  Copy full SHA for 647214f

• [V0 Deprecation] Remove V0 metrics code (#27215)

  Show description for a03cf9b
  njhill

  authored
  a03cf9b

  Copy full SHA for a03cf9b

Commits on Oct 18, 2025

• [Minor] Add some clarifying comments to recent changes (#27130)

  Show description for 3b45075
  njhill

  authored
  3b45075

  Copy full SHA for 3b45075

Commits on Oct 17, 2025

• [Core] Change `execute_model_with_error_logging()` to be a ctx manager (#27060)

  Show description for fe3b937
  njhill

  authored
  fe3b937

  Copy full SHA for fe3b937

• [Perf] Exploit out-of-band buffers in shm_broadcast (#26961)

  Show description for ab81379
  njhill

  authored
  ab81379

  Copy full SHA for ab81379

Commits on Oct 14, 2025

• [Core] Streamline some structured output related code (#26737)

  Show description for 4aed506
  njhill

  authored
  4aed506

  Copy full SHA for 4aed506

• [Minor] Group async_scheduling related fields in model runner init (#26736)

  Show description for ff4810b
  njhill

  authored
  ff4810b

  Copy full SHA for ff4810b

Commits on Oct 10, 2025

• [BugFix] Make penalties and bad_words work with async scheduling (#26467)

  Show description for 5bc26c4
  njhill

  authored
  5bc26c4

  Copy full SHA for 5bc26c4

• [BugFix] Fix async scheduling + request preemption (#26385)

  Show description for 949cb01
  njhill

  authored
  949cb01

  Copy full SHA for 949cb01

• [Core] Small simplification in `GPUModelRunner._update_states()` (#26508)

  Show description for aafb99a
  njhill

  authored
  aafb99a

  Copy full SHA for aafb99a

Commits on Oct 9, 2025

• [Core] Remove unused `prev_sampled_token_ids_invalid_indices` input batch field (#26514)

  Show description for 2e54db4
  njhill

  authored
  2e54db4

  Copy full SHA for 2e54db4

• [Misc] Misc code simplifications (#26450)

  Show description for ddcbc2f
  njhill

  authored
  ddcbc2f

  Copy full SHA for ddcbc2f

• [Bugfix] Catch and log invalid token ids in detokenizer #2 (#26445)

  Show description for bb6d8c2
  njhill

  authored
  bb6d8c2

  Copy full SHA for bb6d8c2

Commits on Oct 8, 2025

• [Core] Simplify setting new_token_ids in CachedRequestData (#26388)

  Show description for 067da2d
  njhill

  authored
  067da2d

  Copy full SHA for 067da2d

Commits on Oct 2, 2025

• [Misc] Make handling of SamplingParams clearer in n>1 case (#26032)

  Show description for 169313b
  njhill

  authored
  169313b

  Copy full SHA for 169313b

Commits on Sep 26, 2025

• [Misc] Remove unnecessary memoryviews in shm_broadcast.py (#25721)

  Show description for 983056e
  njhill

  authored
  983056e

  Copy full SHA for 983056e

• [Misc] Don't log shm dequeue delay warning on worker side (#25720)

  Show description for 8b77328
  njhill

  authored
  8b77328

  Copy full SHA for 8b77328

Commits on Sep 20, 2025

• [BugFix] Exclude self when checking for port collision (#25286)

  Show description for b7f186b
  njhill

  authored
  b7f186b

  Copy full SHA for b7f186b

• [Misc] Support more collective_rpc return types (#25294)

  Show description for 535d800
  njhill

  authored
  535d800

  Copy full SHA for 535d800

• [BugFix] Ensure appropriate guards in destructors (#25284)

  Show description for a25ade5
  

  njhill

  and

  gemini-code-assist[bot]

  authored
  a25ade5

  Copy full SHA for a25ade5

Pagination

Previous

Next