MatrixCalculus.org – Computing Derivatives of Matrix and Tensor Expressions

Abstract

Computing derivatives of matrix and tensor expressions is an integral part of developing and implementing optimization algorithms in machine learning. However, it is a time-consuming and error-prone task when done by hand. Here, we present the first system that performs matrix and tensor calculus automatically.