Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Hindsight Experience Replay Buffer #84

Open
wants to merge 48 commits into
base: master
Choose a base branch
from
Open

Hindsight Experience Replay Buffer #84

wants to merge 48 commits into from

Commits on Jul 10, 2020

  1. Adds basic code for bitflip DQN and adds basic code for HER

    @prabhatnagarajan
    prabhatnagarajan committed Jul 10, 2020
    Configuration menu
    Copy the full SHA
    52cec56 View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2020

  1. Adds hindsight to bit flip

    @prabhatnagarajan
    prabhatnagarajan committed Jul 11, 2020
    Configuration menu
    Copy the full SHA
    6859259 View commit details
    Browse the repository at this point in the history

  2. removes null_goals

    @prabhatnagarajan
    prabhatnagarajan committed Jul 11, 2020
    Configuration menu
    Copy the full SHA
    120cfa5 View commit details
    Browse the repository at this point in the history

  3. modifies total steps

    @prabhatnagarajan
    prabhatnagarajan committed Jul 11, 2020
    Configuration menu
    Copy the full SHA
    3360faf View commit details
    Browse the repository at this point in the history

  4. Updates space sampling

    @prabhatnagarajan
    prabhatnagarajan committed Jul 11, 2020
    Configuration menu
    Copy the full SHA
    1e57205 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2020

  1. Merge branch 'master' into her

    @prabhatnagarajan
    prabhatnagarajan committed Jul 17, 2020
    Configuration menu
    Copy the full SHA
    cc06b25 View commit details
    Browse the repository at this point in the history

  2. Cleans hindsight buffer code

    @prabhatnagarajan
    prabhatnagarajan committed Jul 17, 2020
    Configuration menu
    Copy the full SHA
    a60e1f5 View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2020

  1. Modifies experiment params

    @prabhatnagarajan
    prabhatnagarajan committed Jul 19, 2020
    Configuration menu
    Copy the full SHA
    eece248 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2020

  1. Merge branch 'master' into her

    @prabhatnagarajan
    prabhatnagarajan committed Jul 31, 2020
    Configuration menu
    Copy the full SHA
    2111563 View commit details
    Browse the repository at this point in the history

Commits on Oct 28, 2020

  1. Merge branch 'master' into her

    @prabhatnagarajan
    prabhatnagarajan committed Oct 28, 2020
    Configuration menu
    Copy the full SHA
    d9cd9eb View commit details
    Browse the repository at this point in the history

  2. Merges with eval_stats_collector

    @prabhatnagarajan
    prabhatnagarajan committed Oct 28, 2020
    Configuration menu
    Copy the full SHA
    5a2dfd8 View commit details
    Browse the repository at this point in the history

  3. Applies black to pfrl

    @prabhatnagarajan
    prabhatnagarajan committed Oct 28, 2020
    Configuration menu
    Copy the full SHA
    e38e0d0 View commit details
    Browse the repository at this point in the history

  4. Updates docstring

    @prabhatnagarajan
    prabhatnagarajan committed Oct 28, 2020
    Configuration menu
    Copy the full SHA
    d89c788 View commit details
    Browse the repository at this point in the history

  5. Implements step function and success rate calculation

    @prabhatnagarajan
    prabhatnagarajan committed Oct 28, 2020
    Configuration menu
    Copy the full SHA
    080916f View commit details
    Browse the repository at this point in the history

  6. Updates agent, explorer, replay start size, and phi

    @prabhatnagarajan
    prabhatnagarajan committed Oct 28, 2020
    Configuration menu
    Copy the full SHA
    c363dc7 View commit details
    Browse the repository at this point in the history

  7. Applies black

    @prabhatnagarajan
    prabhatnagarajan committed Oct 28, 2020
    Configuration menu
    Copy the full SHA
    4e15a76 View commit details
    Browse the repository at this point in the history

  8. Updates optimizer, and target update interval

    @prabhatnagarajan
    prabhatnagarajan committed Oct 28, 2020
    Configuration menu
    Copy the full SHA
    71809a5 View commit details
    Browse the repository at this point in the history

  9. Fixes minor errors

    @prabhatnagarajan
    prabhatnagarajan committed Oct 28, 2020
    Configuration menu
    Copy the full SHA
    8c616e5 View commit details
    Browse the repository at this point in the history

Commits on Oct 29, 2020

  1. Applies black

    @prabhatnagarajan
    prabhatnagarajan committed Oct 29, 2020
    Configuration menu
    Copy the full SHA
    9721d1a View commit details
    Browse the repository at this point in the history

  2. Addresses flakes

    @prabhatnagarajan
    prabhatnagarajan committed Oct 29, 2020
    Configuration menu
    Copy the full SHA
    8643e0d View commit details
    Browse the repository at this point in the history

  3. Cleans up code

    @prabhatnagarajan
    prabhatnagarajan committed Oct 29, 2020
    Configuration menu
    Copy the full SHA
    4d34f1e View commit details
    Browse the repository at this point in the history

  4. Update examples/her/train_dqn_bit_flip.py 

    Co-authored-by: Justin DuJardin <[email protected]>
    @prabhatnagarajan @justindujardin
    prabhatnagarajan and justindujardin committed Oct 29, 2020
    Configuration menu
    Copy the full SHA
    f5a1bfa View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2020

  1. experiment and hyperparameter update

    @prabhatnagarajan
    prabhatnagarajan committed Oct 30, 2020
    Configuration menu
    Copy the full SHA
    3812384 View commit details
    Browse the repository at this point in the history

  2. Switches parse args

    @prabhatnagarajan
    prabhatnagarajan committed Oct 30, 2020
    Configuration menu
    Copy the full SHA
    5cd21e0 View commit details
    Browse the repository at this point in the history

  3. Applies black

    @prabhatnagarajan
    prabhatnagarajan committed Oct 30, 2020
    Configuration menu
    Copy the full SHA
    035ad63 View commit details
    Browse the repository at this point in the history

Commits on Nov 5, 2020

  1. Adds HER to the Repo readme

    @prabhatnagarajan
    prabhatnagarajan committed Nov 5, 2020
    Configuration menu
    Copy the full SHA
    e481b85 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into her

    @prabhatnagarajan
    prabhatnagarajan committed Nov 5, 2020
    Configuration menu
    Copy the full SHA
    573c7a2 View commit details
    Browse the repository at this point in the history

  3. Applies isort

    @prabhatnagarajan
    prabhatnagarajan committed Nov 5, 2020
    Configuration menu
    Copy the full SHA
    ed4ae2e View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2020

  1. Make DDPG HER work for FetchReach-v1

    @muupan
    muupan committed Nov 6, 2020
    Configuration menu
    Copy the full SHA
    9841438 View commit details
    Browse the repository at this point in the history

Commits on Nov 9, 2020

  1. Start updates earlier to match performance of baselines

    @muupan
    muupan committed Nov 9, 2020
    Configuration menu
    Copy the full SHA
    d61d1dc View commit details
    Browse the repository at this point in the history

Commits on Nov 10, 2020

  1. Merge pull request #2 from muupan/her-fetch 

    Her fetch
    @prabhatnagarajan
    prabhatnagarajan committed Nov 10, 2020
    Configuration menu
    Copy the full SHA
    1c9d308 View commit details
    Browse the repository at this point in the history

  2. Adds Fetch DDPG to readme

    @prabhatnagarajan
    prabhatnagarajan committed Nov 10, 2020
    Configuration menu
    Copy the full SHA
    18177a4 View commit details
    Browse the repository at this point in the history

  3. Updates descriptions for args in bit flip

    @prabhatnagarajan
    prabhatnagarajan committed Nov 10, 2020
    Configuration menu
    Copy the full SHA
    383585f View commit details
    Browse the repository at this point in the history

  4. Updates docs in DDPG Fetch example

    @prabhatnagarajan
    prabhatnagarajan committed Nov 10, 2020
    Configuration menu
    Copy the full SHA
    88380f0 View commit details
    Browse the repository at this point in the history

  5. Minor cleanup of hindsight replay strategies

    @prabhatnagarajan
    prabhatnagarajan committed Nov 10, 2020
    Configuration menu
    Copy the full SHA
    453b04b View commit details
    Browse the repository at this point in the history

  6. Merge branch 'her' into her_fetch_updates

    @prabhatnagarajan
    prabhatnagarajan committed Nov 10, 2020
    Configuration menu
    Copy the full SHA
    3c41b85 View commit details
    Browse the repository at this point in the history

Commits on Nov 12, 2020

  1. Merge branch 'master' into her

    @prabhatnagarajan
    prabhatnagarajan committed Nov 12, 2020
    Configuration menu
    Copy the full SHA
    33c2d09 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'her' into her_fetch_updates

    @prabhatnagarajan
    prabhatnagarajan committed Nov 12, 2020
    Configuration menu
    Copy the full SHA
    35b07ce View commit details
    Browse the repository at this point in the history

  3. Adds bit flip to examples tests

    @prabhatnagarajan
    prabhatnagarajan committed Nov 12, 2020
    Configuration menu
    Copy the full SHA
    0a2efc6 View commit details
    Browse the repository at this point in the history

  4. Applies black

    @prabhatnagarajan
    prabhatnagarajan committed Nov 12, 2020
    Configuration menu
    Copy the full SHA
    eaa01e4 View commit details
    Browse the repository at this point in the history

  5. Fixes merge conflicts

    @prabhatnagarajan
    prabhatnagarajan committed Nov 12, 2020
    Configuration menu
    Copy the full SHA
    977993e View commit details
    Browse the repository at this point in the history

Commits on Jan 7, 2021

  1. Merge branch 'master' into her

    @prabhatnagarajan
    prabhatnagarajan committed Jan 7, 2021
    Configuration menu
    Copy the full SHA
    5e67f4a View commit details
    Browse the repository at this point in the history

Commits on Jan 29, 2021

  1. Merge branch 'master' into her

    @prabhatnagarajan
    prabhatnagarajan committed Jan 29, 2021
    Configuration menu
    Copy the full SHA
    e3e99f6 View commit details
    Browse the repository at this point in the history

Commits on Mar 12, 2021

  1. Merge branch 'master' into her

    @prabhatnagarajan
    prabhatnagarajan committed Mar 12, 2021
    Configuration menu
    Copy the full SHA
    4150555 View commit details
    Browse the repository at this point in the history

Commits on Mar 22, 2021

  1. Adds HER readme and tests

    @prabhatnagarajan
    prabhatnagarajan committed Mar 22, 2021
    Configuration menu
    Copy the full SHA
    ef230a4 View commit details
    Browse the repository at this point in the history

Commits on Mar 30, 2021

  1. Applies black

    @prabhatnagarajan
    prabhatnagarajan committed Mar 30, 2021
    Configuration menu
    Copy the full SHA
    ac952f3 View commit details
    Browse the repository at this point in the history

  2. Adds HER to replay buffer tests

    @prabhatnagarajan
    prabhatnagarajan committed Mar 30, 2021
    Configuration menu
    Copy the full SHA
    35f085c View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2021

  1. Merge branch 'master' into her

    @prabhatnagarajan
    prabhatnagarajan committed Jul 17, 2021
    Configuration menu
    Copy the full SHA
    15d8a21 View commit details
    Browse the repository at this point in the history