Intra-machine between-graph replication for PS #1
Description
Things to Change
Since current in-graph replication logic makes both system and user-API complicated,
we can explore if between-graph replication for PS would make sense in terms of performance.
Current Behavior
In-Graph replication with replica operation names in a single worker
Expected Behavior
Compare the performance and choose between-graph if it does not slow the performance