Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: pytorch/rl
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: v0.8.0
Choose a base ref
...
head repository: pytorch/rl
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: v0.8.1
Choose a head ref
  • 20 commits
  • 52 files changed
  • 4 contributors

Commits on May 16, 2025

  1. [Versioning] 0.8.1

    Vincent Moens committed May 16, 2025
    Configuration menu
    Copy the full SHA
    70e3b35 View commit details
    Browse the repository at this point in the history

  2. [Feature] collector.start(), test and doc 

    ghstack-source-id: e44aa87
Pull-Request-resolved: #2935
(cherry picked from commit 6ef7f64)
    Vincent Moens committed May 16, 2025
    Configuration menu
    Copy the full SHA
    81d70f2 View commit details
    Browse the repository at this point in the history

  3. [Quality] Local dtype maps 

    ghstack-source-id: 26eb314
Pull-Request-resolved: #2936
(cherry picked from commit 3dbd84c)
    Vincent Moens committed May 16, 2025
    Configuration menu
    Copy the full SHA
    be6c3a4 View commit details
    Browse the repository at this point in the history

  4. [Minor] typo in "Multi-Agent Reinforcement Learning (PPO) with TorchR… 

    …L Tutorial" docs (#2938)

(cherry picked from commit 795e362)
    @sendhil
    sendhil authored and Vincent Moens committed May 16, 2025
    Configuration menu
    Copy the full SHA
    8c7a7da View commit details
    Browse the repository at this point in the history

  5. [BugFix] Multiagent PPO tutorial (#2940) 

    (cherry picked from commit 46ccbae)
    @matteobettini
    matteobettini authored and Vincent Moens committed May 16, 2025
    Configuration menu
    Copy the full SHA
    372bd03 View commit details
    Browse the repository at this point in the history

  6. [BugFix] Fix single action pass to gym when action key is not "action" 

    ghstack-source-id: b91b9e1
Pull-Request-resolved: #2942
(cherry picked from commit 3bad905)
    Vincent Moens committed May 16, 2025
    Configuration menu
    Copy the full SHA
    91996e9 View commit details
    Browse the repository at this point in the history

  7. [BugFix] Fix encode overrides 

    ghstack-source-id: 2b7710a
Pull-Request-resolved: #2943
(cherry picked from commit ccadb67)
    Vincent Moens committed May 16, 2025
    Configuration menu
    Copy the full SHA
    693aa6f View commit details
    Browse the repository at this point in the history

  8. [BugFix] NonTensor.encode must return a NonTensorData 

    ghstack-source-id: 36fc87c
Pull-Request-resolved: #2944
(cherry picked from commit 7deff86)
    Vincent Moens committed May 16, 2025
    Configuration menu
    Copy the full SHA
    a4ea483 View commit details
    Browse the repository at this point in the history

  9. [Quality] Longer warmup for cudagraph within sota implementations 

    ghstack-source-id: 140ba6e
Pull-Request-resolved: #2945
(cherry picked from commit ccc31b5)
    Vincent Moens committed May 16, 2025
    Configuration menu
    Copy the full SHA
    517e34c View commit details
    Browse the repository at this point in the history

  10. [Algorithm] Async SAC 

    ghstack-source-id: 84d845d
Pull-Request-resolved: #2946
(cherry picked from commit cb06ea3)
    Vincent Moens committed May 16, 2025
    Configuration menu
    Copy the full SHA
    6746105 View commit details
    Browse the repository at this point in the history

  11. [Example] RayReplayBuffer usage 

    ghstack-source-id: ab39a46
Pull-Request-resolved: #2949
(cherry picked from commit a31dca3)
    Vincent Moens committed May 16, 2025
    Configuration menu
    Copy the full SHA
    9d9a89d View commit details
    Browse the repository at this point in the history

  12. [BugFix] Robust torch.cuda.is_current_stream_capturing calls 

    ghstack-source-id: 8335587
Pull-Request-resolved: #2950
(cherry picked from commit 6b48e08)
    Vincent Moens committed May 16, 2025
    Configuration menu
    Copy the full SHA
    daf6c65 View commit details
    Browse the repository at this point in the history

  13. [BugFix] Fix get_original_weights in collectors 

    ghstack-source-id: bf77b22
Pull-Request-resolved: #2951
(cherry picked from commit 01399e0)
    Vincent Moens committed May 16, 2025
    Configuration menu
    Copy the full SHA
    7d1aa66 View commit details
    Browse the repository at this point in the history

  14. [BugFix] Better make_composite_from_td 

    ghstack-source-id: c99dfa6
Pull-Request-resolved: #2952
(cherry picked from commit 231555d)
    Vincent Moens committed May 16, 2025
    Configuration menu
    Copy the full SHA
    c5e63d9 View commit details
    Browse the repository at this point in the history

  15. [BugFix] Fix shifted value computation with an LSTM 

    ghstack-source-id: 9ccbf82
Pull-Request-resolved: #2941
(cherry picked from commit 1813e8e)
    Vincent Moens committed May 16, 2025
    Configuration menu
    Copy the full SHA
    203dfff View commit details
    Browse the repository at this point in the history

  16. [Minor] gitignore ipynb 

    ghstack-source-id: 6460761
Pull-Request-resolved: #2954
(cherry picked from commit 36f34da)
    Vincent Moens committed May 16, 2025
    Configuration menu
    Copy the full SHA
    3797132 View commit details
    Browse the repository at this point in the history

  17. [BugFix] Fix behavior or partial, nested dones in PEnv and TEnv 

    ghstack-source-id: e36d1c8
Pull-Request-resolved: #2959
(cherry picked from commit 6ae8d43)
    Vincent Moens committed May 16, 2025
    Configuration menu
    Copy the full SHA
    c6ca5af View commit details
    Browse the repository at this point in the history

  18. [BugFix] Remove to(device) for clip_value usage as it's a buffer already 

    ghstack-source-id: ec50cf8
Pull-Request-resolved: #2960
(cherry picked from commit f61078d)
    Vincent Moens committed May 16, 2025
    Configuration menu
    Copy the full SHA
    7dc870f View commit details
    Browse the repository at this point in the history

  19. Upgrade tensordict requirement

    Vincent Moens committed May 16, 2025
    Configuration menu
    Copy the full SHA
    55f6074 View commit details
    Browse the repository at this point in the history

  20. [Environment] Complete PettingZooWrapper state support (#2953) 

    Co-authored-by: Vincent Moens <[email protected]>
(cherry picked from commit d882ea2)
    @jeguzzi
    jeguzzi and Vincent Moens committed May 16, 2025
    Configuration menu
    Copy the full SHA
    24c9d74 View commit details
    Browse the repository at this point in the history
Loading