It's not every day you see a research paper named "Alice's Adventures in a Differentiable Wonderland," and when you open it, it's a 281-page book!
text
It's not every day you see a research paper named "Alice's Adventures in a Differentiable Wonderland," and when you open it, it's a 281-page book!
new_line
new_line
I haven't completed it yet, but this amazing work, written by Simone Scardapane, is a fascinating introduction to deep neural networks and differentiable programming. 
text
I haven't completed it yet, but this amazing work, written by Simone Scardapane, is a fascinating introduction to deep neural networks and differentiable programming. 
new_line
new_line
Some key technical highlights:
text
Some key technical highlights:
new_line
new_line
• Covers core concepts like automatic differentiation, stochastic optimization, and activation functions in depth
text
• Covers core concepts like automatic differentiation, stochastic optimization, and activation functions in depth
new_line
new_line
• Explains modern architectures like convolutional networks, transformers, and graph neural networks
text
• Explains modern architectures like convolutional networks, transformers, and graph neural networks
new_line
new_line
• Provides mathematical foundations including linear algebra, gradients, and probability theory
text
• Provides mathematical foundations including linear algebra, gradients, and probability theory
new_line
new_line
• Discusses implementation details in PyTorch and JAX
text
• Discusses implementation details in PyTorch and JAX
new_line
new_line
• Explores advanced topics like Bayesian neural networks and neural scaling laws
text
• Explores advanced topics like Bayesian neural networks and neural scaling laws
new_line
new_line
The book takes a unique approach, framing neural networks as compositions of differentiable primitives rather than biological analogs. It provides both theoretical insights and practical coding examples.
text
The book takes a unique approach, framing neural networks as compositions of differentiable primitives rather than biological analogs. It provides both theoretical insights and practical coding examples.
new_line
new_line
I especially enjoyed the sections on:
text
I especially enjoyed the sections on:
new_line
new_line
• Vector-Jacobian products and reverse-mode autodiff
text
• Vector-Jacobian products and reverse-mode autodiff
new_line
• Stochastic gradient descent and mini-batch optimization  
text
• Stochastic gradient descent and mini-batch optimization  
new_line
• ReLU, GELU, and other modern activation functions
text
• ReLU, GELU, and other modern activation functions
new_line
• Universal approximation capabilities of MLPs
text
• Universal approximation capabilities of MLPs
new_line
new_line
Whether you're new to deep learning or an experienced practitioner, this book offers valuable insights into the fundamentals and latest developments. Highly recommended for anyone working with neural networks!
text
Whether you're new to deep learning or an experienced practitioner, this book offers valuable insights into the fundamentals and latest developments. Highly recommended for anyone working with neural networks!
It's not every day you see a research paper named "Alice's Adventures in a Differentiable Wonderland," and when you open it, it's a 281-page book!

I haven't completed it yet, but this amazing work, written by Simone Scardapane, is a fascinating introduction to deep neural networks and differentiable programming. 

Some key technical highlights:

• Covers core concepts like automatic differentiation, stochastic optimization, and activation functions in depth

• Explains modern architectures like convolutional networks, transformers, and graph neural networks

• Provides mathematical foundations including linear algebra, gradients, and probability theory

• Discusses implementation details in PyTorch and JAX

• Explores advanced topics like Bayesian neural networks and neural scaling laws

The book takes a unique approach, framing neural networks as compositions of differentiable primitives rather than biological analogs. It provides both theoretical insights and practical coding examples.

I especially enjoyed the sections on:

• Vector-Jacobian products and reverse-mode autodiff
• Stochastic gradient descent and mini-batch optimization  
• ReLU, GELU, and other modern activation functions
• Universal approximation capabilities of MLPs

Whether you're new to deep learning or an experienced practitioner, this book offers valuable insights into the fundamentals and latest developments. Highly recommended for anyone working with neural networks!
👀
John6666 RogerioFreitas Fik louisbrulenaudet
❤️
RogerioFreitas Fik allknowingroger timrbula
👍
fsommers Fik Zmu StevenTu
😎
Fik
🔥
marielena42