Content-type: text/html Downes.ca ~ Stephen's Web ~ The Matrix Calculus You Need For Deep Learning

Stephen Downes

Knowledge, Learning, Community

The mathematics of neural networks is daunting for most people (including me). This paper is an attempt to give readers a grounding in the basics. "This material is for those who are already familiar with the basics of neural networks, and wish to deepen their understanding of the underlying math." You'll have to read this strategically. Start at the bottom, in the section titled 'Notation'. Also review the Wikipedia article on index notation. Then go back, skim the introduction, and begin in-depth reading at the section "Review: Scalar derivative rules." Plan to spend the day. Related: Irving Wladawsky-Berger, Getting on the AI Learning Curve: A Pragmatic, Incremental Approach.

Today: 7 Total: 29 [Direct link] [Share]


Stephen Downes Stephen Downes, Casselman, Canada
stephen@downes.ca

Copyright 2024
Last Updated: Nov 15, 2024 2:19 p.m.

Canadian Flag Creative Commons License.

Force:yes