Verkauf durch Sack Fachmedien

Koonce

Verified Deep Learning with Lean4

Formal Backpropagation from MLP to Attention, via MLIR

Medium: Buch
ISBN: 979-8-8688-3647-3
Verlag: APRESS L.P.
Erscheinungstermin: 01.12.2027
vorbestellbar, Erscheinungstermin ca. November 2027

This book teaches you how backpropagation actually works. You have called '.backward()' a thousand times. Here you open the hood and check the math, layer by layer.Backpropagation is one operation, the vector-Jacobian product, composed by three rules: the chain rule, additive fan-in, and multiplicative fan-in. Five structural tricks handle the layers whose Jacobians look dense: elementwise activations, convolution, max pooling, the normalizations and softmax, and the weight gradient of a dense layer. Every architecture in this book is a combination of those eight things. So is every architecture in its catalog of forty-six more, from U-Net to Mamba to Stable Diffusion. There is no ninth.Each chapter adds one primitive and climbs one rung: a linear classifier on MNIST, then an MLP, a CNN, BatchNorm on CIFAR-10, ResNet-34, MobileNetV2, EfficientNet, ConvNeXt, and the Vision Transformer. For each layer, you derive the backward pass by hand, state it as a theorem in Lean 4 and check it, read the MLIR it compiles to, and train the network on real data with one command. From ResNet onward, every chapter also trains its ImageNet recipe twice, once through a JAX reference and once through the verified trainer, and scores the two against each other.The gradients are theorems. The compiler and the GPU are trusted, and cross-checked against JAX. Three views of one computation: the math, the proof, and the code that runs. They agree, and this book is about why.What You Will Learn:- Derive the backward pass of every layer in the modern vision stack, from dense layers to self-attention- Read and check Lean 4 theorems that the gradients are correct, with no prior Lean- Follow a network from a fifteen-line spec through MLIR to the GPU, and know what each stage preserves- Reduce an unfamiliar architecture to known primitives and write its specification yourself- Know exactly what the proofs cover and what they leave to the training runWho It Is For:For readers who have trained a neural network and want to know what '.backward()' computed. It assumes derivatives, matrices, and a rough idea of convolution. It assumes no Lean, MLIR, compilers, or formal verification. Skip every Lean snippet and you still get a complete book on backpropagation.


Produkteigenschaften


  • Artikelnummer: 9798868836473
  • Medium: Buch
  • ISBN: 979-8-8688-3647-3
  • Verlag: APRESS L.P.
  • Erscheinungstermin: 01.12.2027
  • Sprache(n): Englisch
  • Auflage: 1. Auflage 2027
  • Produktform: Kartoniert
  • Format (B x H): 178 x 254 mm
  • Ausgabetyp: Kein, Unbekannt
Autoren/Hrsg.

Autoren

Part 1: The Framework.- Chapter 1: MNIST, Linear Classifier — Softmax Cross-Entropy and the Training Step.- Chapter 2: MNIST, 1D MLP — Dense Layers and the Chain Rule.- Chapter 3: MNIST, 2D CNN — Convolution and Max Pooling As Sparse Jacobians.- Chapter 4: CIFAR with Batchnorm — The Normalization Backward.- Chapter 5: Resnet-34 — Skip Connections and Additive Fan-In.- Chapter 6: Mobilenetv2 — Depthwise Convolution and Inverted Residuals.- Chapter 7: Efficientnet — Squeeze-And-Excitation and Multiplicative Fan-In.- Chapter 8: Convnext — Layernorm, GELU and Layer Scale.- Chapter 9: Vision Transformer — Attention as the Capstone.- Part 2: The Bestiary.- Chapter 10: The Kit — The Primitives the Bestiary Adds.- Chapter 11: The Chapter Nets At Work — Detection, Inspection, Agriculture, Remote Sensing, Segmentation.- Chapter 12: Beyond Recognition — Language, Generation, Diffusion, Physics, Signals, Structure.- Chapter 13: Game Theory — DQN, Deep CFR, Alphazero and Muzero Against Solved Games.- Appendix A: Toolchain and Platforms.- Appendix B: On Verification.- Appendix C: The Imagenet Tier.- Appendix D: Data Availability.