A Decentralized Trained Open-Weight Diffusion Model.

The world's first open-weight diffusion model trained entirely through decentralized computation. The model consists of 8 expert diffusion models (129M-605M parameters each) trained in complete isolation with no gradient, parameter, or intermediate activation synchronization, achieving superior parallelism efficiency over traditional methods while using 14× less data and 16× less compute than baselines.

• Paris: A Decentralized Trained Open-Weight Diffusion Model @ GitHub.

Related contents:

• Introducing Paris @ BagelLABS.