This adds logic to put segments into batches and retry them. Change-Id: I86450e2f5ab13edb3ae9a5d5b9417e0cced2892b
Implements creating roughly load-balanced set of batched that can be used to make multiple requests. Change-Id: I349b276176dcb8ba9163e7e06a94509d73fa5ddc