-
Notifications
You must be signed in to change notification settings - Fork 126
Interleaved Test Epoch Controller
VinF edited this page Mar 21, 2016
·
2 revisions
A controller that interleaves a test epoch between training epochs of the agent.
- id [int] - The identifier (>= 0) of the mode each test epoch triggered by this controller will belong to. Can be used to discriminate between datasets in your Environment subclass (this is the argument that will be given to your environment's reset() method when starting the test epoch).
- epochLength [float] - The total number of transitions that will occur during a test epoch. This means that this epoch could feature several episodes if a terminal transition is reached before this budget is exhausted.
- controllersToDisable [list of int] - A list of controllers to disable when this controller wants to start a test epoch. These same controllers will be reactivated after this controller has finished dealing with its test epoch.
- periodicity [int] - How many epochs are necessary before a test epoch is ran (these controller's epochs included: "1 test epoch on [periodicity] epochs"). Minimum value: 2.
- showScore [bool] - Whether to print an informative message on stdout at the end of each test epoch, about the total reward obtained in the course of the test epoch.
- summarizeEvery [int] - How many of this controller's test epochs are necessary before the attached agent's summarizeTestPerformance() method is called. Give a value <= 0 for "never". If > 0, the first call will occur just after the first test epoch.