Improving Python S3 Client Performance with Rust
Pure Storage
MAY 20, 2022
Recall that download_fileobj is significantly faster with large objects than the basic Boto3 get_object function. Build the Rust-FastS3 library using maturin , which packages the Rust code and pyo3 bindings into a Python wheel. As a result, FastS3 is at least 3x faster than Boto3’s get_object. maturin build --release.
59 
Let's personalize your content