Linear Algebra

Chameleon

PaStiX

PaStiX (Parallel Sparse matriX package) is a scientific library that provides a high performance parallel solver for very large sparse linear systems based on direct methods. This solver also provides some low-rank compression methods to reduce the memory footprint and/or the time-to-solution.

Learning

Rotor: Rematerializing Optimally with pyTORch

Rotor is a tool designed to train very large deep neural networks networks on limited memory by optimally selecting which activations should be kept and which should be recomputed. This code is meant to replace the checkpoint.py utility available in pytorch, by providing more efficient rematerialization strategies. The algorithm is easier to tune: the only required parameter is the available memory, instead of the number of segments.