Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Distributed multi-GPU and multi-node learning (PyTorch implementation) #162

Merged
merged 21 commits into from
Jun 24, 2024
Merged

Distributed multi-GPU and multi-node learning (PyTorch implementation) #162

merged 21 commits into from
Jun 24, 2024

Commits on Jun 19, 2024

  1. Add PyTorch framework configuration

    @Toni-SM
    Toni-SM committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    cea621f View commit details
    Browse the repository at this point in the history

  2. Initialize distributed process in trainer base class

    @Toni-SM
    Toni-SM committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    b9c7645 View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2024

  1. Improve property annotation and docstrings

    @Toni-SM
    Toni-SM committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    b0deb24 View commit details
    Browse the repository at this point in the history

  2. Add PyTorch framework config to docs

    @Toni-SM
    Toni-SM committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    42f9f57 View commit details
    Browse the repository at this point in the history

  3. Increase seed according to worker rank in distributed runs

    @Toni-SM
    Toni-SM committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    e06dcfd View commit details
    Browse the repository at this point in the history

  4. Update agent and trainer configuration to avoid duplicated data in di… 

    …stributed runs
    @Toni-SM
    Toni-SM committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    5abed23 View commit details
    Browse the repository at this point in the history

  5. Add method to broadcast and reduce distributed model parameters

    @Toni-SM
    Toni-SM committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    4f8e3d8 View commit details
    Browse the repository at this point in the history

  6. Setup distributed runs

    @Toni-SM
    Toni-SM committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    104313d View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2024

  1. Add distributed implementation to PPO agent

    @Toni-SM
    Toni-SM committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    36d4a57 View commit details
    Browse the repository at this point in the history

  2. Fix torch deprecated warning

    @Toni-SM
    Toni-SM committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    9f265af View commit details
    Browse the repository at this point in the history

  3. Reduce and broadcast learning rate across all workers/processes

    @Toni-SM
    Toni-SM committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    391506d View commit details
    Browse the repository at this point in the history

  4. Merge branch 'develop' into toni/distributed_torch

    @Toni-SM
    Toni-SM committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    f2aca29 View commit details
    Browse the repository at this point in the history

  5. Update CHANGELOG

    @Toni-SM
    Toni-SM committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    734221e View commit details
    Browse the repository at this point in the history

Commits on Jun 23, 2024

  1. Merge branch 'develop' into toni/distributed_torch

    @Toni-SM
    Toni-SM committed Jun 23, 2024
    Configuration menu
    Copy the full SHA
    ffd6503 View commit details
    Browse the repository at this point in the history

  2. Implement distributed runs for on-policy agents

    @Toni-SM
    Toni-SM committed Jun 23, 2024
    Configuration menu
    Copy the full SHA
    a336bbd View commit details
    Browse the repository at this point in the history

  3. Add distributed implementation to agent features

    @Toni-SM
    Toni-SM committed Jun 23, 2024
    Configuration menu
    Copy the full SHA
    1954ab3 View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2024

  1. Implement distributed runs for off-policy agents

    @Toni-SM
    Toni-SM committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    b821879 View commit details
    Browse the repository at this point in the history

  2. Update off-policy agents features table in docs

    @Toni-SM
    Toni-SM committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    de86f51 View commit details
    Browse the repository at this point in the history

  3. Unify code style for distributed implementation

    @Toni-SM
    Toni-SM committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    c739b75 View commit details
    Browse the repository at this point in the history

  4. Implement distributed runs for multi-agents

    @Toni-SM
    Toni-SM committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    c6301fb View commit details
    Browse the repository at this point in the history

  5. Update multi-agents features table in docs

    @Toni-SM
    Toni-SM committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    e09d7fd View commit details
    Browse the repository at this point in the history