Question

[Data mining / web mining / cloud computing]

1. What are the advantages and disadvantages of bulk synchronous parallel?

2. Briefly compare synchronous vs. asynchronous distributed deep learning.

3. Briefly explain the execution steps followed by the Ring Allreduce in the communication phase. Can we apply this technique in asynchronous approach? Why?

Answer 1

`Hey,

Note: Brother if you have any queries related the answer please do comment. I would be very happy to resolve all your queries.

Note: Brother According to HomeworkLib's policy we are only allowed to answer first part if there are many. So, I request you to post other part as separate posts

Kindly revert for any queries

Thanks.