dr_domi/udlbook
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Merge pull request #192 from SwayStar123/patch-2

Browse Source 
Fix typo in 6_5_Adam.ipynb
This commit is contained in:
udlbook
2024-05-22 15:15:28 -04:00
committed by GitHub
parent a547fee3f4 35b6f67bbf
commit 7c4cc1ddb4
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
Notebooks/Chap06/6_5_Adam.ipynb
View File

@@ -221,7 +221,7 @@
{ {
"cell_type": "markdown", "cell_type": "markdown",
"source": [ "source": [
"This moves towards the minimum at a sensible speed, but we never actually converge -- the solution just bounces back and forth between the last two points. To make it converge, we add momentum to both the estimates of the gradient and the pointwise squared gradient. We also modify the statistics by a factor that depends on the time to make sure the progress is now slow to start with." "This moves towards the minimum at a sensible speed, but we never actually converge -- the solution just bounces back and forth between the last two points. To make it converge, we add momentum to both the estimates of the gradient and the pointwise squared gradient. We also modify the statistics by a factor that depends on the time to make sure the progress is not slow to start with."
], ],
"metadata": { "metadata": {
"id": "_6KoKBJdGGI4" "id": "_6KoKBJdGGI4"