physgrad sin images as jpgs
This commit is contained in:
parent
7278a04cf1
commit
deaf4c5066
3
intro.md
3
intro.md
@ -103,14 +103,13 @@ Chloe Paillard,
|
|||||||
Kiwon Um,
|
Kiwon Um,
|
||||||
and all github contributors!
|
and all github contributors!
|
||||||
|
|
||||||
|
|
||||||
## Citation
|
## Citation
|
||||||
|
|
||||||
If you find this book useful, please cite it via:
|
If you find this book useful, please cite it via:
|
||||||
```
|
```
|
||||||
@book{thuerey2021pbdl,
|
@book{thuerey2021pbdl,
|
||||||
title={Physics-based Deep Learning},
|
title={Physics-based Deep Learning},
|
||||||
author={N. Thuerey and B. Holzschuh and P. Holl and G. Kohl and M. Lino andP. Schnell and F. Trost},
|
author={N. Thuerey and B. Holzschuh and P. Holl and G. Kohl and M. Lino and Q. Liu and P. Schnell and F. Trost},
|
||||||
url={https://physicsbaseddeeplearning.org},
|
url={https://physicsbaseddeeplearning.org},
|
||||||
year={2021},
|
year={2021},
|
||||||
publisher={WWW}
|
publisher={WWW}
|
||||||
|
@ -126,7 +126,7 @@ The value of $\xi$ determines the conditioning of $\mathcal P$ with large $\xi$
|
|||||||
|
|
||||||
Here's an example of the resulting loss landscape for $y^*=(0.3, -0.5)$, $\xi=1$, $\phi=15^\circ$ that shows the entangling of the sine function for $x_1$ and linear change for $x_2$:
|
Here's an example of the resulting loss landscape for $y^*=(0.3, -0.5)$, $\xi=1$, $\phi=15^\circ$ that shows the entangling of the sine function for $x_1$ and linear change for $x_2$:
|
||||||
|
|
||||||
```{figure} resources/physgrad-sin-loss.png
|
```{figure} resources/physgrad-sin-loss.jpg
|
||||||
---
|
---
|
||||||
height: 200px
|
height: 200px
|
||||||
name: physgrad-sin-loss
|
name: physgrad-sin-loss
|
||||||
@ -137,7 +137,7 @@ Next we train a fully-connected neural network to invert this problem via equati
|
|||||||
We'll compare SIP training using a saddle-free Newton solver to various state-of-the-art network optimizers.
|
We'll compare SIP training using a saddle-free Newton solver to various state-of-the-art network optimizers.
|
||||||
For fairness, the best learning rate is selected independently for each optimizer.
|
For fairness, the best learning rate is selected independently for each optimizer.
|
||||||
When choosing $\xi=1$ the problem is perfectly conditioned. In this case all network optimizers converge, with Adam having a slight advantage. This is shown in the left graph:
|
When choosing $\xi=1$ the problem is perfectly conditioned. In this case all network optimizers converge, with Adam having a slight advantage. This is shown in the left graph:
|
||||||
```{figure} resources/physgrad-sin-time-graphs.png
|
```{figure} resources/physgrad-sin-time-graphs.jpg
|
||||||
---
|
---
|
||||||
height: 180px
|
height: 180px
|
||||||
name: physgrad-sin-time-graphs
|
name: physgrad-sin-time-graphs
|
||||||
@ -154,7 +154,7 @@ While the evaluation of the Hessian inherently requires more computations, the p
|
|||||||
By increasing $\xi$ while keeping $\phi=0$ fixed we can show how the conditioning continually influences the different methods,
|
By increasing $\xi$ while keeping $\phi=0$ fixed we can show how the conditioning continually influences the different methods,
|
||||||
as shown on the left here:
|
as shown on the left here:
|
||||||
|
|
||||||
```{figure} resources/physgrad-sin-add-graphs.png
|
```{figure} resources/physgrad-sin-add-graphs.jpg
|
||||||
---
|
---
|
||||||
height: 180px
|
height: 180px
|
||||||
name: physgrad-sin-add-graphs
|
name: physgrad-sin-add-graphs
|
||||||
|
BIN
resources/physgrad-sin-add-graphs.jpg
Normal file
BIN
resources/physgrad-sin-add-graphs.jpg
Normal file
Binary file not shown.
After Width: | Height: | Size: 123 KiB |
BIN
resources/physgrad-sin-loss.jpg
Normal file
BIN
resources/physgrad-sin-loss.jpg
Normal file
Binary file not shown.
After Width: | Height: | Size: 31 KiB |
BIN
resources/physgrad-sin-time-graphs.jpg
Normal file
BIN
resources/physgrad-sin-time-graphs.jpg
Normal file
Binary file not shown.
After Width: | Height: | Size: 157 KiB |
Loading…
Reference in New Issue
Block a user