Implementation of LVSM, SOTA Large View Synthesis with Minimal 3d Inductive Bias, from Adobe Research

Implementation of E2-TTS, "Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS", in Pytorch

Implementation of π₀, the robotic foundation model architecture proposed by Physical Intelligence

Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI

Explorations into the proposed Streaming Deep Reinforcement Learning, from University of Alberta

Implementation of rectified flow and some of its followup research / improvements in Pytorch

A concise but complete full-attention transformer with a set of promising experimental features from various papers

Implementation of Autoregressive Diffusion in Pytorch

Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAI

Implementation of Alphafold 3 in Pytorch

Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch

An implementation of Phasic Policy Gradient, a proposed improvement of Proximal Policy Gradients, in Pytorch

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch

Implementation of the proposed Spline-Based Transformer from Disney Research

Implementation of the proposed MaskBit from Bytedance AI

Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch

Vector (and Scalar) Quantization, in Pytorch

Implementation of the proposed minGRU in Pytorch

A simple way to keep track of an Exponential Moving Average (EMA) version of your Pytorch model

Explorations into improving ViTArc with Slot Attention

Implementation of Soft Actor Critic and some of its improvements in Pytorch

Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts

Implementation of MagViT2 Tokenizer in Pytorch

My attempts at applying Soundstream design on learned tokenization of text and then applying hierarchical attention to text generation

Implementation of MeshGPT, SOTA Mesh generation using Attention, in Pytorch

Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch

Implementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorch

Implementation of Denoising Diffusion Probabilistic Model in Pytorch