Embedding parameter placement in NMT model #2
Description
Things to Change
According to NMT, embedding parameter goes to a worker if the number of embedding partitions is one. It happens in the Parallax, too.
Current Behavior
PS fails when the number of embedding partitions is one.
Expected Behavior
Work well regardless of the number of embedding partitions.
Failure Information (for bugs)
Failure Logs
How to Reproduce
Run NMT example with "num_embedding_partitions=1"