Bay.Area.AI: Tensor and 2D Parallelism -- Junjie Wang, Xilun Wu,Iris Zhang

ai.bythebay.io Nov 2025, Oakland, full-stack AI conference Tensor and 2D Parallelism -- Junjie Wang, Xilun Wu, Iris Zhang, Meta Junjie Wang, Software Engineer, Meta Junjie is a software engineer working on PyTorch distributed, especially Tensor Parallel and Sequence Parallel. Working on multiple projects within Meta but eventually found passion in PyTorch. Xilun Wu, Software Engineer, Meta Xilun is a software engineer on PyTorch Distributed at Meta Platforms. He has been actively contributing to PyTorch Distributed components including DTensor and TCPStore, as well as third-party dependencies like Gloo. His most recent focus is on scaling TCPStore and ProcessGroup for large training clusters. Iris Zhang, Software Engineer, Meta Iris is a software engineer from PyTorch Distributed team at Meta. Iris works on PyTorch DeviceMesh based Distributed APIs as well as Distributed Checkpointing.