Improving the Efficiency of Distributed Training Using Sparse Parameter Averaging

I am now officially a published author.

The research work I did for Exo Labs on enhancing distributed training techniques using sparse parameter sharing methods is now being published in the MCDC this year. Exciting! Stay tuned to see the final paper.

Here's a blog post about it:

Exo Labs

And here's the openreview:

Open Review