Listing 67 Billion Objects in 1 Bucket
Pure Storage
MAY 27, 2022
It has been republished with permission from the author. In this post, I look at what it takes to list all keys in a single bucket with 67 billion objects and build a simple list benchmark program in Golang. Second, I develop parallelized list benchmarks in Python and Golang, measuring their relative performance on a small bucket.
Let's personalize your content