linear_operator - Structured Linear Algebra in PyTorchLinear Operator at PyTorch Conference 2022 Better Transformer: Accelerating Transformer Inference in PyTorch at PyTorch Conference 2022 Two Dimensional Parallelism Using Distributed Tensors at PyTorch Conference 2022 xFormers: Building Blocks for Efficient Transformers at PyTorch Conference 2022 Functorch: Composable Function Transforms in Pytorch at PyTorch Conference 2022 PiPPy: Automated Pipeline Parallelism for PyTorch Model Preparation Federated Learning and Device Computation