AICurious Logo

What is: Distributed Any-Batch Mirror Descent?

Year2020
Data SourceCC BY-SA - https://paperswithcode.com

Distributed Any-Batch Mirror Descent (DABMD) is based on distributed Mirror Descent but uses a fixed per-round computing time to limit the waiting by fast nodes to receive information updates from slow nodes. DABMD is characterized by varying minibatch sizes across nodes. It is applicable to a broader range of problems compared with existing distributed online optimization methods such as those based on dual averaging, and it accommodates time-varying network topology.