Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(CTS): add retry on tests #672

Merged
merged 2 commits into from
Mar 31, 2021
Merged

chore(CTS): add retry on tests #672

merged 2 commits into from
Mar 31, 2021

Conversation

chloelbn
Copy link
Contributor

Q A
Bug fix? no
New feature? no
BC breaks? no
Related Issue Fix #669 & #668
Need Doc update no

Describe your change

Adds a retry strategy to prevent flakiness

@chloelbn chloelbn force-pushed the chore/add-retry-on-tests branch 4 times, most recently from d7f919f to e163670 Compare March 26, 2021 12:28
Copy link
Collaborator

@DevinCodes DevinCodes left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a lot cleaner, it looks very nice! 😄 Let me know what you think of my comments.

tests/Integration/AnalyticsClientTest.php Outdated Show resolved Hide resolved
tests/TestHelper.php Outdated Show resolved Hide resolved
Copy link
Collaborator

@DevinCodes DevinCodes left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It seems like the tests are failing. Could you please check why?

@chloelbn
Copy link
Contributor Author

@DevinCodes I'm doing this as we speak

tests/TestHelper.php Outdated Show resolved Hide resolved
Copy link
Collaborator

@DevinCodes DevinCodes left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I approved because the changes look good, but the CI is failing for (it seems) unrelated things. Could you quickly take a look please? 🙂 Thank you in advance!

@chloelbn chloelbn merged commit 1862d2c into master Mar 31, 2021
@chloelbn chloelbn deleted the chore/add-retry-on-tests branch March 31, 2021 13:54
chloelbn added a commit that referenced this pull request Apr 5, 2021
* chore(cts): fix api keys test

* chore(CTS): fix flakiness
chloelbn added a commit that referenced this pull request Apr 5, 2021
* feat: add custom dictionary methods (tests still WIP)

* chore: add docblocks

* feat: update tests

* debug: use API key dealer

* Revert "debug: use API key dealer"

This reverts commit dcf05df.

* feat: refactor tests to rely on objectID checks instead of nbHits

* feat: finzalize CTS

* chore: address feedback

* chore: remove unused method

* Add missing part of the url for stopABTest() method (#666)

* Handling of param array in the $queries array for multipleQueries method (#663)

* Add Algolia CTS (#665)

* Indexing and Settings tests for SearchIndexTest.php

* Add SearchTest method

* Add SynonymsTest method

* Add testQueryRules method

* Add testBatching method

* Add testReplacing and testExists methods + move sample data

* Add SearchClientTest.php

* Add multiQueries test

* Adding AccountTest.php and remove usage of SyncClient

* Adding SecuredApiKeysTest

* Adding AnalyticsClientTest.php

* Adding AnalyticsClientTest.php

* Adding InsightsClientTest.php

* Adding RecommendationClientTest.php + CS fixer

* Adding Mcm tests

* Add stopAbTest() test

* Remove unnecessary files

* Handling of param array in the $queries array for multipleQueries method (#663)

* Remove unnecessary files

* First required changes

* Removing self::assert* notations

* fix(cts): delete indexes initialisation

* Using wait() on saveObject() rather than multiResponse

* Removing all static arrays for indices

* Removing unwanted setPersonalizationStrategy call

* use secured index name

* Required changes after code review

* Adding loop to check if indices exist before additing the A/B Tests

* Adding security into loops

* Set cpts to 10

* Set cpts to 20

* Set cpts to 10

* Set cpts to 10

Co-authored-by: Chloe Liban <chloe.liban@gmail.com>

* chore(CTS): add retry on tests (#672)

* chore(cts): fix api keys test

* chore(CTS): fix flakiness

* Revert "feat: custom dictionaries (#662)"

This reverts commit d4e3112.

* chore: address feedback

* chore: remove unused method

* chore(test): fix helper call

* fix: rebase

Co-authored-by: Devin Beeuwkes <devin.beeuwkes@algolia.com>
Co-authored-by: Damien Couchez <damien.couchez@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Fix flakiness for testApiKeys
2 participants