What I Read: Engineering Trade-Offs in Automatic Differentiation

Posted on 2022-03-08 :: Tags: machine learning, neural network, automatic differentiation, TensorFlow, PyTorch, Jax, Julia, graph, static, dynamic, software engineering, Python, compiler

https://www.stochasticlifestyle.com/engineering-trade-offs-in-automatic-differentiation-from-tensorflow-and-pytorch-to-jax-and-julia/
Engineering Trade-Offs in Automatic Differentiation: from TensorFlow and PyTorch to Jax and Julia
December 25 2021
Author: Christopher Rackauckas
“To understand the differences between automatic differentiation libraries, let’s talk about the engineering trade-offs that were made.”