Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Changing to Mongo driver library #229

Open
wants to merge 15 commits into
base: master
Choose a base branch
from
Open

Changing to Mongo driver library #229

wants to merge 15 commits into from

Commits on Jun 7, 2023

  1. adding args to connect to mongo 

    adding username and password to mongo tsbs_load options
    @Hadrien-Cornier
    Hadrien-Cornier authored and Ramon Ribeiro committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    ac54534 View commit details
    Browse the repository at this point in the history

  2. Changed the mongo files to use the official mongo golang driver : htt… 

    …ps://pkg.go.dev/go.mongodb.org/mongo-driver Which is stil being maintained instead of the unmaintained mgo driver which does not connect to mongo v.4.4
    @Hadrien-Cornier
    Hadrien-Cornier authored and Ramon Ribeiro committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    09adf90 View commit details
    Browse the repository at this point in the history

  3. removed credentials and changed them also

    @Hadrien-Cornier
    Hadrien-Cornier authored and Ramon Ribeiro committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    31ddb0f View commit details
    Browse the repository at this point in the history

  4. upgraded mongo-driver dependency

    @Hadrien-Cornier
    Hadrien-Cornier authored and Ramon Ribeiro committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    2b490f0 View commit details
    Browse the repository at this point in the history

  5. added formatting

    @Hadrien-Cornier
    Hadrien-Cornier authored and Ramon Ribeiro committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    558a111 View commit details
    Browse the repository at this point in the history

  6. removed user and pass because we can pass it into the url instead

    @Hadrien-Cornier
    Hadrien-Cornier authored and Ramon Ribeiro committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    547f8f8 View commit details
    Browse the repository at this point in the history

  7. corrected collection logging bug

    @Hadrien-Cornier
    Hadrien-Cornier authored and Ramon Ribeiro committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    f6f4a77 View commit details
    Browse the repository at this point in the history

  8. tested, the mongo loader works when using pre-generated data

    @Hadrien-Cornier
    Hadrien-Cornier authored and Ramon Ribeiro committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    823f493 View commit details
    Browse the repository at this point in the history

  9. changed to official Go mongo driver that can connect to the latest ve… 

    …rsion of mongo (4.4) and added batchsize option to the query executor (going from 1 to 1000 batchsize can speed queries by a factor of 30) as well as an indicator of number of queries executed
    @Hadrien-Cornier
    Hadrien-Cornier authored and Ramon Ribeiro committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    98a4c0c View commit details
    Browse the repository at this point in the history

  10. added some logging and error handling to the timestream loader

    @Hadrien-Cornier
    Hadrien-Cornier authored and Ramon Ribeiro committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    df86d33 View commit details
    Browse the repository at this point in the history

  11. Update cmd/tsbs_load_mongo/creator.go 

    Co-authored-by: Jônatas Davi Paganini <jonatas.paganini@toptal.com>
    @Hadrien-Cornier
    2 people authored and Ramon Ribeiro committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    249678c View commit details
    Browse the repository at this point in the history

  12. Update cmd/tsbs_load_mongo/creator.go 

    Co-authored-by: Jônatas Davi Paganini <jonatas.paganini@toptal.com>
    @Hadrien-Cornier
    2 people authored and Ramon Ribeiro committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    b563ff5 View commit details
    Browse the repository at this point in the history

  13. Update cmd/tsbs_load_mongo/document_per_loader.go 

    Co-authored-by: Jônatas Davi Paganini <jonatas.paganini@toptal.com>
    @Hadrien-Cornier
    2 people authored and Ramon Ribeiro committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    ddd8824 View commit details
    Browse the repository at this point in the history

  14. Update cmd/tsbs_load_mongo/document_per_loader.go 

    Co-authored-by: Jônatas Davi Paganini <jonatas.paganini@toptal.com>
    @Hadrien-Cornier
    2 people authored and Ramon Ribeiro committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    e9a575f View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2023

  1. Fix closing brackets on tsbs_mongo_load

    @ramonhpr
    ramonhpr authored and Ramon Ribeiro committed Jun 8, 2023
    Configuration menu
    Copy the full SHA
    a4b6940 View commit details
    Browse the repository at this point in the history