Add section on hyperparameter tuning #437
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
❌ DANGER ❌This pull request has modified workflows that created output. Close this now. |
…-intro into hyperparameter-tuning
carschno
approved these changes
Apr 29, 2024
episodes/4-advanced-layer-types.Rmd
Outdated
| The goal is to show that hyperparameter tuning can be done easily with `keras_tuner`, not to memorize all the exact syntax of how to do it. This will probably save you half an hour of participants typing over code that they already know from before. In addition, on really slow machines running the grid search could possibly take more than 10 minutes. | ||
| ::: | ||
|
|
||
| In general if you are varying hyperparameters (such as the dropout rate) to find the combination of hyperparameters with the best model performance this is called hyperparameter tuning. A naive way to do this is to write a for-loop and train a slightly different model in every cycle. |
There was a problem hiding this comment.
I think a sentence with a general reminder to define what hyperparameters are would be useful.
There was a problem hiding this comment.
Fixed in c38b110
Co-authored-by: Carsten Schnober <[email protected]>
Co-authored-by: Carsten Schnober <[email protected]>
Co-authored-by: Carsten Schnober <[email protected]>
Fix path to image: remove leading slash.
…-intro into hyperparameter-tuning Conflicts: episodes/4-advanced-layer-types.Rmd
|
I made the results reflect the new dollarstreet dataset, since I didn't change any content since @carschno' review, I will merge this now. |
github-actions bot
pushed a commit
that referenced
this pull request
May 20, 2024
Auto-generated via {sandpaper}
Source : 9da1b65
Branch : main
Author : Sven van der Burg <[email protected]>
Time : 2024-05-20 11:47:51 +0000
Message : Add section on hyperparameter tuning (#437)
* Add section on hyperparameter tuning
* Fix path to image: remove leading slash.
* Update episodes/4-advanced-layer-types.Rmd
Co-authored-by: Carsten Schnober <[email protected]>
* Update episodes/4-advanced-layer-types.Rmd
Co-authored-by: Carsten Schnober <[email protected]>
* Update episodes/4-advanced-layer-types.Rmd
Co-authored-by: Carsten Schnober <[email protected]>
* Improve explanations of hyperparameter tuning
* Update hyperparamter tuning section for dollar street dataset
---------
Co-authored-by: Carsten Schnober <[email protected]>
Co-authored-by: Carsten Schnober <[email protected]>
github-actions bot
pushed a commit
that referenced
this pull request
May 20, 2024
Auto-generated via {sandpaper}
Source : 176e0c8
Branch : md-outputs
Author : GitHub Actions <[email protected]>
Time : 2024-05-20 11:48:40 +0000
Message : markdown source builds
Auto-generated via {sandpaper}
Source : 9da1b65
Branch : main
Author : Sven van der Burg <[email protected]>
Time : 2024-05-20 11:47:51 +0000
Message : Add section on hyperparameter tuning (#437)
* Add section on hyperparameter tuning
* Fix path to image: remove leading slash.
* Update episodes/4-advanced-layer-types.Rmd
Co-authored-by: Carsten Schnober <[email protected]>
* Update episodes/4-advanced-layer-types.Rmd
Co-authored-by: Carsten Schnober <[email protected]>
* Update episodes/4-advanced-layer-types.Rmd
Co-authored-by: Carsten Schnober <[email protected]>
* Improve explanations of hyperparameter tuning
* Update hyperparamter tuning section for dollar street dataset
---------
Co-authored-by: Carsten Schnober <[email protected]>
Co-authored-by: Carsten Schnober <[email protected]>
github-actions bot
pushed a commit
that referenced
this pull request
May 21, 2024
Auto-generated via {sandpaper}
Source : 9da1b65
Branch : main
Author : Sven van der Burg <[email protected]>
Time : 2024-05-20 11:47:51 +0000
Message : Add section on hyperparameter tuning (#437)
* Add section on hyperparameter tuning
* Fix path to image: remove leading slash.
* Update episodes/4-advanced-layer-types.Rmd
Co-authored-by: Carsten Schnober <[email protected]>
* Update episodes/4-advanced-layer-types.Rmd
Co-authored-by: Carsten Schnober <[email protected]>
* Update episodes/4-advanced-layer-types.Rmd
Co-authored-by: Carsten Schnober <[email protected]>
* Improve explanations of hyperparameter tuning
* Update hyperparamter tuning section for dollar street dataset
---------
Co-authored-by: Carsten Schnober <[email protected]>
Co-authored-by: Carsten Schnober <[email protected]>
github-actions bot
pushed a commit
that referenced
this pull request
May 21, 2024
Auto-generated via {sandpaper}
Source : 1535d4b
Branch : md-outputs
Author : GitHub Actions <[email protected]>
Time : 2024-05-21 00:53:10 +0000
Message : markdown source builds
Auto-generated via {sandpaper}
Source : 9da1b65
Branch : main
Author : Sven van der Burg <[email protected]>
Time : 2024-05-20 11:47:51 +0000
Message : Add section on hyperparameter tuning (#437)
* Add section on hyperparameter tuning
* Fix path to image: remove leading slash.
* Update episodes/4-advanced-layer-types.Rmd
Co-authored-by: Carsten Schnober <[email protected]>
* Update episodes/4-advanced-layer-types.Rmd
Co-authored-by: Carsten Schnober <[email protected]>
* Update episodes/4-advanced-layer-types.Rmd
Co-authored-by: Carsten Schnober <[email protected]>
* Improve explanations of hyperparameter tuning
* Update hyperparamter tuning section for dollar street dataset
---------
Co-authored-by: Carsten Schnober <[email protected]>
Co-authored-by: Carsten Schnober <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Fixes #351
@Reviewer: This is now in episode 4, I was thinking to maybe put it together with transfer learning in the new episode 5 (See #349). Episode 5 could then be called 'advanced deep learning concepts'.