Judicious Use of Communication for Inherently Parallel Optimization