Linear Algebra
Chameleon
PaStiX
PaStiX (Parallel Sparse matriX package) is a scientific library that provides a high performance parallel solver for very large sparse linear systems based on direct methods. This solver also provides some low-rank compression methods to reduce the memory footprint and/or the time-to-solution.
Learning
Rotor: Rematerializing Optimally with pyTORch
Rotor is a tool designed to
train very large deep neural networks networks on limited memory by
optimally selecting which activations should be kept and which should
be recomputed. This code is meant to replace the checkpoint.py
utility
available in pytorch
, by providing more efficient rematerialization
strategies. The algorithm is easier to tune: the only required
parameter is the available memory, instead of the number of segments.