Commits

Branch selector

 main

User selector

njhill

Datepicker

All time

Commit History

Commits on May 22, 2025

• [BugFix][DP] Send DP wave completion only from `dp_rank==0` (#18502)

  Show description for cf5984b
  

  njhill

  and

  kouroshHakha

  authored
  cf5984b

  Copy full SHA for cf5984b

Commits on May 19, 2025

• [BugFix] Fix handling of num_computed_tokens with connector (#18232)

  Show description for 1b15df2
  

  njhill

  and

  NickLucche

  authored
  1b15df2

  Copy full SHA for 1b15df2

Commits on May 16, 2025

• [BugFix] Fix ordering of KVConnector finished send/rcv sets (#18211)

  Show description for 0ceaebf
  njhill

  authored
  0ceaebf

  Copy full SHA for 0ceaebf

• [BugFix] Fix multi async save in MultiConnector (#18246)

  Show description for 1db4f47
  njhill

  authored
  1db4f47

  Copy full SHA for 1db4f47

Commits on May 14, 2025

• [KVConnector] Keep KVTransferParams as a dict (#18033)

  njhill

  authored
  59dd311

  Copy full SHA for 59dd311

• [P/D] Add some more debug logs to `NixlConnector` (#18102)

  Show description for d5af47a
  njhill

  authored
  d5af47a

  Copy full SHA for d5af47a

Commits on May 13, 2025

• [V1] DP scale-out (2/N): Decouple engine process management and comms (#15977)

  Show description for 55aa7af
  njhill

  authored
  55aa7af

  Copy full SHA for 55aa7af

• [BugFix] Fix 4-GPU RLHF tests (#18007)

  Show description for ee5be83
  njhill

  authored
  ee5be83

  Copy full SHA for ee5be83

Commits on May 8, 2025

• [BugFix] Fix `--disable-log-stats` in V1 server mode (#17600)

  Show description for 3d13ca0
  njhill

  authored
  3d13ca0

  Copy full SHA for 3d13ca0

Commits on May 7, 2025

• [BugFix] Avoid secondary missing `MultiprocExecutor.workers` error (#17811)

  Show description for ed5272c
  njhill

  authored
  ed5272c

  Copy full SHA for ed5272c

Commits on May 5, 2025

• [BugFix] Increase timeout for startup failure test (#17642)

  Show description for 5ea5c51
  njhill

  authored
  5ea5c51

  Copy full SHA for 5ea5c51

Commits on Apr 28, 2025

• [Misc] Validate `stop_token_ids` contents (#17268)

  Show description for 8262a3e
  njhill

  authored
  8262a3e

  Copy full SHA for 8262a3e

Commits on Apr 26, 2025

• [Core] Remove prompt string from engine core data structures (#17214)

  Show description for df6f3ce
  njhill

  authored
  df6f3ce

  Copy full SHA for df6f3ce

• [BugFix] Avoid race conditions in zero-copy tensor transmission (#17203)

  Show description for b07bf83
  njhill

  authored
  b07bf83

  Copy full SHA for b07bf83

Commits on Apr 25, 2025

• [BugFix][Frontend] Fix `LLM.chat()` tokenization (#16081)

  Show description for 7011645
  njhill

  authored
  7011645

  Copy full SHA for 7011645

Commits on Apr 23, 2025

• [V1] Avoid socket errors during shutdown when requests are in in-flight (#16807)

  Show description for b2f195c
  njhill

  authored
  b2f195c

  Copy full SHA for b2f195c

• [V1][DP] More robust DP/EP dummy request coordination (#16277)

  Show description for 1e013fa
  njhill

  authored
  1e013fa

  Copy full SHA for 1e013fa

Commits on Apr 22, 2025

• [BugFix] Remove default multiproc executor `collective_rpc` timeout (#17000)

  Show description for 5175b88
  njhill

  authored
  5175b88

  Copy full SHA for 5175b88

• [BugFix] Fix incremental detokenization perf issue (#16963)

  Show description for e4d6144
  njhill

  authored
  e4d6144

  Copy full SHA for e4d6144

Commits on Apr 17, 2025

• [MLA] Simplification to batch P/D reordering (#16673)

  Show description for 0377b83
  njhill

  authored
  0377b83

  Copy full SHA for 0377b83

• [V1][Perf] Faster incremental detokenization (#15137)

  Show description for 05fcd1b
  njhill

  authored
  05fcd1b

  Copy full SHA for 05fcd1b

Commits on Apr 12, 2025

• [BugFix] Handle non-contiguous tensors properly when serializing (#16492)

  Show description for 41cc883
  njhill

  authored
  41cc883

  Copy full SHA for 41cc883

Commits on Apr 10, 2025

• [V1] Zero-copy tensor/ndarray serialization/transmission (#13790)

  Show description for dd143ef
  njhill

  authored
  dd143ef

  Copy full SHA for dd143ef

Commits on Apr 7, 2025

• [V1][BugFix] Exit properly if engine core fails during startup (#16137)

  Show description for 7f6d47c
  njhill

  authored
  7f6d47c

  Copy full SHA for 7f6d47c

Commits on Apr 4, 2025

• [V1] DP scale-out (1/N): Use zmq ROUTER/DEALER sockets for input queue (#15906)

  Show description for 651cf0f
  njhill

  authored
  651cf0f

  Copy full SHA for 651cf0f

Commits on Mar 29, 2025

• [Misc][V1] Misc code streamlining (#15723)

  Show description for 6d531ad
  njhill

  authored
  6d531ad

  Copy full SHA for 6d531ad

Commits on Mar 27, 2025

• [V1] AsyncLLM data parallel (#13923)

  Show description for 15dac21
  njhill

  authored
  15dac21

  Copy full SHA for 15dac21

Commits on Mar 26, 2025

• [V1][Sampler] Faster top-k only implementation (#15478)

  Show description for 35fad35
  njhill

  authored
  35fad35

  Copy full SHA for 35fad35

Commits on Mar 25, 2025

• [V1][Minor] Use `SchedulerInterface` type for engine scheduler field (#15499)

  Show description for 6aa196c
  njhill

  authored
  6aa196c

  Copy full SHA for 6aa196c

Commits on Mar 24, 2025

• [BugFix][V1] Quick fix for min_tokens with multiple EOS (#15407)

  Show description for 623e2ed
  njhill

  authored
  623e2ed

  Copy full SHA for 623e2ed

• [V1][Perf] Simpler request output queues (#15156)

  Show description for 9d72daf
  

  njhill

  and

  robertgshaw2-redhat

  authored
  9d72daf

  Copy full SHA for 9d72daf

• [V1] Aggregate chunked prompt logprobs in model runner (#14875)

  Show description for 3aee657
  njhill

  authored
  3aee657

  Copy full SHA for 3aee657

Commits on Mar 21, 2025

• [V1] Avoid redundant input processing in n>1 case (#14985)

  Show description for da6ea29
  njhill

  authored
  da6ea29

  Copy full SHA for da6ea29

Commits on Mar 20, 2025

• [BugFix] Lazily import XgrammarBackend to avoid early cuda init (#15171)

  Show description for c47aafa
  njhill

  authored
  c47aafa

  Copy full SHA for c47aafa

Commits on Mar 19, 2025

• [FrontEnd][Perf] `merge_async_iterators` fast-path for single-prompt requests (#15150)

  Show description for 22d33ba
  njhill

  authored
  22d33ba

  Copy full SHA for 22d33ba

Pagination

Previous

Next