Remove Authorization Remove Benchmark Remove Blog Remove Capacity
article thumbnail

Listing 67 Billion Objects in 1 Bucket

Pure Storage

It has been republished with permission from the author. In this post, I look at what it takes to list all keys in a single bucket with 67 billion objects and build a simple list benchmark program in Golang. Second, I develop parallelized list benchmarks in Python and Golang, measuring their relative performance on a small bucket.

article thumbnail

Simplify Elastic Operations without Compromising Data Searchability Using FlashBlade

Pure Storage

This article originally appeared on Medium.com and is republished with permission from the author. Hadoop) means that growing capacity requires higher node counts and therefore growing complexity. Hadoop) means that growing capacity requires higher node counts and therefore growing complexity.