updates, airfoils test
This commit is contained in:
@@ -8,7 +8,8 @@ logo: resources/logo.png
|
|||||||
# Force re-execution of notebooks on each build.
|
# Force re-execution of notebooks on each build.
|
||||||
# See https://jupyterbook.org/content/execute.html
|
# See https://jupyterbook.org/content/execute.html
|
||||||
execute:
|
execute:
|
||||||
execute_notebooks: force
|
# Whether to execute notebooks at build time. Must be one of ("auto", "force", "cache", "off")
|
||||||
|
execute_notebooks: off
|
||||||
|
|
||||||
# Define the name of the latex output file for PDF builds
|
# Define the name of the latex output file for PDF builds
|
||||||
latex:
|
latex:
|
||||||
|
|||||||
2
_toc.yml
2
_toc.yml
@@ -4,6 +4,8 @@
|
|||||||
- file: intro
|
- file: intro
|
||||||
- file: overview
|
- file: overview
|
||||||
- file: supervised
|
- file: supervised
|
||||||
|
sections:
|
||||||
|
- file: supervised-airfoils
|
||||||
- file: physicalloss
|
- file: physicalloss
|
||||||
sections:
|
sections:
|
||||||
- file: physicalloss-code
|
- file: physicalloss-code
|
||||||
|
|||||||
6
intro.md
6
intro.md
@@ -9,14 +9,15 @@ As much as possible, the algorithms will come with hands-on code examples to qui
|
|||||||
Beyond standard _supervised_ learning from data, we'll look at loss constraints, and
|
Beyond standard _supervised_ learning from data, we'll look at loss constraints, and
|
||||||
more tightly coupled learning algorithms with differentiable simulations.
|
more tightly coupled learning algorithms with differentiable simulations.
|
||||||
|
|
||||||
|
```{figure} resources/teaser.png
|
||||||
```{figure} ./resources/teaser.png
|
|
||||||
---
|
---
|
||||||
height: 220px
|
height: 220px
|
||||||
name: pbdl-teaser
|
name: pbdl-teaser
|
||||||
---
|
---
|
||||||
Some examples ... preview teaser ...
|
Some examples ... preview teaser ...
|
||||||
```
|
```
|
||||||
|
% Teaser, simple version:
|
||||||
|
% 
|
||||||
|
|
||||||
|
|
||||||
As a _sneak preview_, in the next chapters we'll show:
|
As a _sneak preview_, in the next chapters we'll show:
|
||||||
@@ -82,6 +83,7 @@ a b c
|
|||||||
See also... Test link: {doc}`supervised`
|
See also... Test link: {doc}`supervised`
|
||||||
```
|
```
|
||||||
|
|
||||||
|
✅ Do this , ❌ Don't do this
|
||||||
|
|
||||||
% ----------------
|
% ----------------
|
||||||
---
|
---
|
||||||
|
|||||||
36
overview.md
36
overview.md
@@ -1,29 +1,31 @@
|
|||||||
Overview
|
Overview
|
||||||
============================
|
============================
|
||||||
|
|
||||||
The following "book" of targets _"Physics-Based Deep Learning"_ techniques
|
The following "book" of targets _"Physics-Based Deep Learning"_ techniques,
|
||||||
(PBDL), i.e., the field of methods with combinations of physical modeling and
|
i.e., methods that combine physical modeling and numerical simulations with
|
||||||
deep learning (DL) techniques. Here, DL will typically refer to methods based
|
deep learning (DL). Here, DL will typically refer to methods based
|
||||||
on artificial neural networks. The general direction of PBDL represents a very
|
on artificial neural networks. The general direction of
|
||||||
|
Physics-Based Deep Learning represents a very
|
||||||
active, quickly growing and exciting field of research.
|
active, quickly growing and exciting field of research.
|
||||||
|
|
||||||
## Motivation
|
## Motivation
|
||||||
|
|
||||||
From weather forecasts (? ) to quantum physics (? ),
|
From weather forecasts (? ) over X, Y,
|
||||||
... more ...
|
... more ...
|
||||||
|
to quantum physics (? ),
|
||||||
using numerical analysis to obtain solutions for physical models has
|
using numerical analysis to obtain solutions for physical models has
|
||||||
become an integral part of science.
|
become an integral part of science.
|
||||||
|
|
||||||
|
At the same time, machine learning technologies and deep neural networks in particular,
|
||||||
|
have led to impressive achievements in a variety of field.
|
||||||
Among others, GPT-3
|
Among others, GPT-3
|
||||||
has recently demonstrated that learning models can
|
has recently demonstrated that learning models can
|
||||||
achieve astounding accuracy for processing natural language.
|
achieve astounding accuracy for processing natural language.
|
||||||
Also: AlphaGO, closer to physics: protein folding...
|
Also: AlphaGO, closer to physics: protein folding...
|
||||||
This is a vibrant, quickly developing field with vast possibilities.
|
This is a vibrant, quickly developing field with vast possibilities.
|
||||||
|
|
||||||
At the same time, machine
|
The successes of DL approaches have given rise to concerns that this technology has
|
||||||
learning technologies and deep neural networks in particular,
|
the potential to replace the traditional, simulation-driven approach to
|
||||||
have given rise to concerns that this technology has the poten-
|
|
||||||
tial to replace the traditional, simulation-driven approach to
|
|
||||||
science. Instead of relying on models that are carefully crafted
|
science. Instead of relying on models that are carefully crafted
|
||||||
from first principles, can data collections of sufficient size
|
from first principles, can data collections of sufficient size
|
||||||
be processed to provide the correct answers instead?
|
be processed to provide the correct answers instead?
|
||||||
@@ -34,8 +36,7 @@ Given the current state of the art, these clear breakthroughs
|
|||||||
are outstanding, the proposed techniques are novel,
|
are outstanding, the proposed techniques are novel,
|
||||||
sometimes difficult to apply, and
|
sometimes difficult to apply, and
|
||||||
significant difficulties combing physics and DL persist.
|
significant difficulties combing physics and DL persist.
|
||||||
Also, many
|
Also, many fundamental theoretical questions remain unaddressed, most importantly
|
||||||
fundamental theoretical questions remain unaddressed, most importantly
|
|
||||||
regarding data efficienty and generalization.
|
regarding data efficienty and generalization.
|
||||||
|
|
||||||
Over the course of the last decades,
|
Over the course of the last decades,
|
||||||
@@ -111,6 +112,19 @@ starting points with code examples, and illustrate pros and cons of the
|
|||||||
different approaches. In particular, it's important to know in which scenarios
|
different approaches. In particular, it's important to know in which scenarios
|
||||||
each of the different techniques is particularly useful.
|
each of the different techniques is particularly useful.
|
||||||
|
|
||||||
|
## A brief history of PBDL in the context of Fluids
|
||||||
|
|
||||||
|
First:
|
||||||
|
|
||||||
|
Tompson, seminal...
|
||||||
|
|
||||||
|
Chu, descriptors, early but not used
|
||||||
|
|
||||||
|
Ling et al. isotropic turb, small FC, unused?
|
||||||
|
|
||||||
|
PINNs ... and more ...
|
||||||
|
|
||||||
|
|
||||||
## Deep Learning and Neural Networks
|
## Deep Learning and Neural Networks
|
||||||
|
|
||||||
Very brief intro, basic equations... approximate $f(x)=y$ with NN ...
|
Very brief intro, basic equations... approximate $f(x)=y$ with NN ...
|
||||||
|
|||||||
@@ -5,3 +5,50 @@ Using the equations now, but no numerical methods!
|
|||||||
|
|
||||||
Still interesting, leverages analytic derivatives of NNs, but lots of problems
|
Still interesting, leverages analytic derivatives of NNs, but lots of problems
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
Some notation from SoL:
|
||||||
|
|
||||||
|
The following PDEs typically work with a continuous
|
||||||
|
velocity field $\mathbf{u}$ with $d$ dimensions and components, i.e.,
|
||||||
|
$\mathbf{u}(\mathbf{x},t): \mathbb{R}^d \rightarrow \mathbb{R}^d $.
|
||||||
|
For discretized versions below, $d_{i,j}$ will denote the dimensionality
|
||||||
|
of a field such as the velocity,
|
||||||
|
with domain size $d_{x},d_{y},d_{z}$ for source and reference in 3D.
|
||||||
|
|
||||||
|
% with $i \in \{s,r\}$ denoting source/inference manifold and reference manifold, respectively.
|
||||||
|
%This yields $\vc{} \in \mathbb{R}^{d \times d_{s,x} \times d_{s,y} \times d_{s,z} }$ and $\vr{} \in \mathbb{R}^{d \times d_{r,x} \times d_{r,y} \times d_{r,z} }$
|
||||||
|
%Typically, $d_{r,i} > d_{s,i}$ and $d_{z}=1$ for $d=2$.
|
||||||
|
|
||||||
|
For all PDEs, we use non-dimensional parametrizations as outlined below,
|
||||||
|
and the components of the velocity vector are typically denoted by $x,y,z$ subscripts, i.e.,
|
||||||
|
$\mathbf{u} = (u_x,u_y,u_z)^T$ for $d=3$.
|
||||||
|
|
||||||
|
Burgers' equation in 2D. It represents a well-studied advection-diffusion PDE:
|
||||||
|
|
||||||
|
$\frac{\partial u_x}{\partial{t}} + \mathbf{u} \cdot \nabla u_x =
|
||||||
|
\nu \nabla\cdot \nabla u_x + g_x(t),
|
||||||
|
\\
|
||||||
|
\frac{\partial u_y}{\partial{t}} + \mathbf{u} \cdot \nabla u_y =
|
||||||
|
\nu \nabla\cdot \nabla u_y + g_y(t)
|
||||||
|
$,
|
||||||
|
|
||||||
|
where $\nu$ and $\mathbf{g}$ denote diffusion constant and external forces, respectively.
|
||||||
|
|
||||||
|
Burgers' equation in 1D without forces with $u_x = u$:
|
||||||
|
%\begin{eqnarray}
|
||||||
|
$\frac{\partial u}{\partial{t}} + u \nabla u = \nu \nabla \cdot \nabla u $ .
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
Later on, Navier-Stokes, in 2D:
|
||||||
|
|
||||||
|
$
|
||||||
|
\frac{\partial u_x}{\partial{t}} + \mathbf{u} \cdot \nabla u_x =
|
||||||
|
- \frac{1}{\rho}\nabla{p} + \nu \nabla\cdot \nabla u_x \\
|
||||||
|
\frac{\partial u_y}{\partial{t}} + \mathbf{u} \cdot \nabla u_y =
|
||||||
|
- \frac{1}{\rho}\nabla{p} + \nu \nabla\cdot \nabla u_y \\
|
||||||
|
\text{subject to} \quad \nabla \cdot \mathbf{u} = 0,
|
||||||
|
$
|
||||||
|
|
||||||
|
|
||||||
|
|||||||
1018
supervised-airfoils.ipynb
Normal file
1018
supervised-airfoils.ipynb
Normal file
File diff suppressed because one or more lines are too long
Reference in New Issue
Block a user