Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

S3 performance benchmarking on AWS #295

Open
kmgowda opened this issue Feb 22, 2022 · 2 comments
Open

S3 performance benchmarking on AWS #295

kmgowda opened this issue Feb 22, 2022 · 2 comments

Comments

@kmgowda
Copy link
Owner

kmgowda commented Feb 22, 2022

Describe the Issue (Bug/Feature)
Publish the performance benchmarking results of aws S3 storage using SBK

To Reproduce
use sbk -class minio for S3 performance benchmarking
MinIO SBK driver is S3 compatible APIs

Expected behavior
SBK write and read performance results on AWS S3 interface

Additional context
run the SBK in AWS , use -minio option , see the command examples here: https://github.com/kmgowda/SBK/tree/master/driver-minio

@kmgowda kmgowda changed the title S3 peformance benchmarking on aws s3 S3 performance benchmarking on AWS Feb 22, 2022
@thatsdone
Copy link
Contributor

Hi, recently I did performance measurements against AWS S3 using minio driver.
But, it was a very limited pattern in question at that time.

What test cases (measurement patterns) are you expecting? For example:

  • size
  • seconds
  • readers/writers combination patterns
  • etc.

@kmgowda
Copy link
Owner Author

kmgowda commented Jun 4, 2022

@thatsdone size could be range from 10, 100, 1000, 10000, 1000000
instead of seconds .. you can use the -records 1000000
with single writer , 10 writers , single reader and 10 readers

with single writer and reader (for end to end latency benchmarking)

you can update the aws results in the README.md of the minio driver page : https://github.com/kmgowda/SBK/tree/master/driver-minio

while adding results make sure you add the steps on how do setup the s3 in aws ; even though trivial steps , it should be recorded for any new users who want to learn about the setting s3 in aws and conducting the performance benchmarking.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants