diff --git a/intro.md b/intro.md index 5497be8..dcc2e94 100644 --- a/intro.md +++ b/intro.md @@ -103,14 +103,13 @@ Chloe Paillard, Kiwon Um, and all github contributors! - ## Citation If you find this book useful, please cite it via: ``` @book{thuerey2021pbdl, title={Physics-based Deep Learning}, - author={N. Thuerey and B. Holzschuh and P. Holl and G. Kohl and M. Lino andP. Schnell and F. Trost}, + author={N. Thuerey and B. Holzschuh and P. Holl and G. Kohl and M. Lino and Q. Liu and P. Schnell and F. Trost}, url={https://physicsbaseddeeplearning.org}, year={2021}, publisher={WWW} diff --git a/physgrad-nn.md b/physgrad-nn.md index d2a1608..d21a590 100644 --- a/physgrad-nn.md +++ b/physgrad-nn.md @@ -126,7 +126,7 @@ The value of $\xi$ determines the conditioning of $\mathcal P$ with large $\xi$ Here's an example of the resulting loss landscape for $y^*=(0.3, -0.5)$, $\xi=1$, $\phi=15^\circ$ that shows the entangling of the sine function for $x_1$ and linear change for $x_2$: -```{figure} resources/physgrad-sin-loss.png +```{figure} resources/physgrad-sin-loss.jpg --- height: 200px name: physgrad-sin-loss @@ -137,7 +137,7 @@ Next we train a fully-connected neural network to invert this problem via equati We'll compare SIP training using a saddle-free Newton solver to various state-of-the-art network optimizers. For fairness, the best learning rate is selected independently for each optimizer. When choosing $\xi=1$ the problem is perfectly conditioned. In this case all network optimizers converge, with Adam having a slight advantage. This is shown in the left graph: -```{figure} resources/physgrad-sin-time-graphs.png +```{figure} resources/physgrad-sin-time-graphs.jpg --- height: 180px name: physgrad-sin-time-graphs @@ -154,7 +154,7 @@ While the evaluation of the Hessian inherently requires more computations, the p By increasing $\xi$ while keeping $\phi=0$ fixed we can show how the conditioning continually influences the different methods, as shown on the left here: -```{figure} resources/physgrad-sin-add-graphs.png +```{figure} resources/physgrad-sin-add-graphs.jpg --- height: 180px name: physgrad-sin-add-graphs diff --git a/resources/physgrad-sin-add-graphs.jpg b/resources/physgrad-sin-add-graphs.jpg new file mode 100644 index 0000000..b94bd5f Binary files /dev/null and b/resources/physgrad-sin-add-graphs.jpg differ diff --git a/resources/physgrad-sin-loss.jpg b/resources/physgrad-sin-loss.jpg new file mode 100644 index 0000000..cf287ed Binary files /dev/null and b/resources/physgrad-sin-loss.jpg differ diff --git a/resources/physgrad-sin-time-graphs.jpg b/resources/physgrad-sin-time-graphs.jpg new file mode 100644 index 0000000..651aec7 Binary files /dev/null and b/resources/physgrad-sin-time-graphs.jpg differ