Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue1476 cypress tests for vocab home page tempate statistics #1558

Draft
wants to merge 5 commits into
base: main
Choose a base branch
from

Conversation

miguelvaara
Copy link
Contributor

Reasons for creating this PR

All tests pass (including the new ones related to statistics), except for the "alphabetical index letters are clickable" test, which fails randomly. It sometimes passes if the entire vocab-home test is run again, but after making changes to the test, it sometimes fails and sometimes does not when run separately. I suspect it is related to some clicking issue.

This is an early-stage draft PR, so it does not aim to meet code formatting requirements or have sufficient descriptions. The code will be commented later.

Link to relevant issue(s), if any

  • Closes #

Description of the changes in this PR

Known problems or uncertainties in this PR

Checklist

  • phpUnit tests pass locally with my changes
  • I have added tests that show that the new code works, or tests are not relevant for this PR (e.g. only HTML/CSS changes)
  • The PR doesn't reduce accessibility of the front-end code (e.g. tab focus, scaling to different resolutions, use of .sr-only class, color contrast)
  • The PR doesn't introduce unintended code changes (e.g. empty lines or useless reindentation)

Copy link

codecov bot commented Nov 22, 2023

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (b54607b) 70.53% compared to head (77defeb) 70.53%.

Additional details and impacted files
@@             Coverage Diff              @@
##             skosmos-3    #1558   +/-   ##
============================================
  Coverage        70.53%   70.53%           
  Complexity        1643     1643           
============================================
  Files               32       32           
  Lines             4313     4313           
============================================
  Hits              3042     3042           
  Misses            1271     1271           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link

sonarcloud bot commented Nov 22, 2023

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
0.0% 0.0% Duplication

@osma
Copy link
Member

osma commented Nov 22, 2023

All tests pass (including the new ones related to statistics), except for the "alphabetical index letters are clickable" test, which fails randomly.

I looked at this and was able to replicate the occasional text failure. Here is example log output from Cypress:

image

It looks like this test revealed a race condition in the alphabetical index Vue component. It starts loading the index entries for the letter A, but the user (here simulated by Cypress) clicks on D before that operation has finished. This leads to a race condition with both requests (for A and D) happening in parallel, and depending on the order in which they finish, the index will contain either 8 or 33 entries. The test expects 8, so it will fail if there are 33 entries.

This is probably a more general problem with all kinds of asynchronous operations performed by Vue components. We should have some sort of queue mechanism, or a way to cancel/invalidate previous operations. In this case, when the user clicks on D before the request for A has finished, it would make sense to cancel the request for A.

@osma
Copy link
Member

osma commented Nov 22, 2023

In Skosmos 2, similar cancellations and race conditions were handled by using a queue for Ajax requests. This implementation of course relies on jQuery functionality, which doesn't exist in Skosmos 3, so another solution is needed.

/*
* Ajax query queue that keeps track of ongoing queries
* so they can be cancelled if a another event is triggered.
* originally taken from https://stackoverflow.com/a/11612641
*/
$.ajaxQ = (function(){
var id = 0, Q = {};
$(document).ajaxSend(function(e, jqXHR, settings){
jqXHR._id = ++id;
jqXHR['req_kind'] = settings.req_kind !== undefined ? settings.req_kind: $.ajaxQ.requestKind.PLUGIN;
Q[jqXHR._id] = jqXHR;
});
$(document).ajaxComplete(function(e, jqXHR){
delete Q[jqXHR._id];
});
return {
abortAll: function(){
var r = [];
$.each(Q, function(i, jqXHR){
r.push(jqXHR._id);
jqXHR.abort();
});
return r;
},
abortContentQueries: function(){
// includes the ones generated by plugins
var r = [];
$.each(Q, function(i, jqXHR){
r.push(jqXHR._id);
if (jqXHR.req_kind == $.ajaxQ.requestKind.CONTENT || jqXHR.req_kind == $.ajaxQ.requestKind.PLUGIN) {
jqXHR.abort();
}
});
return r;
},
abortSidebarQueries: function(all=false){
var r = [];
$.each(Q, function(i, jqXHR){
r.push(jqXHR._id);
if (jqXHR.req_kind == $.ajaxQ.requestKind.SIDEBAR || all && jqXHR.req_kind == $.ajaxQ.requestKind.SIDEBAR_PRIVILEGED) {
jqXHR.abort();
}
});
return r;
},
requestKind: {GLOBAL: 0, SIDEBAR: 1, SIDEBAR_PRIVILEGED: 2, CONTENT: 3, PLUGIN: 4}
}
})();

@osma osma added this to In progress in Skosmos 3.0 Backlog Nov 23, 2023
@miguelvaara miguelvaara moved this from In progress to Done (verified in test.dev.finto.fi, set Milestone 3.0 for both issue & PR) in Skosmos 3.0 Backlog Nov 23, 2023
@miguelvaara miguelvaara moved this from Done (verified in test.dev.finto.fi, set Milestone 3.0 for both issue & PR) to Needs review in Skosmos 3.0 Backlog Nov 28, 2023
@osma osma moved this from Needs review to Reviewed - further actions needed in Skosmos 3.0 Backlog Nov 28, 2023
@osma osma moved this from Reviewed - further actions needed to Skosmos 3.0 Backlog (not this sprint) in Skosmos 3.0 Backlog Jan 24, 2024
@miguelvaara miguelvaara moved this from Skosmos 3.0 Backlog (not this sprint) to In progress in Skosmos 3.0 Backlog Jan 24, 2024
@miguelvaara
Copy link
Contributor Author

I think we now have four different ways to proceed with this problem:

  • building now some kind of queuing mechanism to eliminate the root cause
  • separating the statistical tests of the vocabulary page from this test
  • accepting that errors will occur occasionally (then implementing TDD rather poorly)
  • postponing the developing of the statistical tests (I think we should have them) until the competition situation issue is fixed

Which approach would you suggest @osma ?

@osma
Copy link
Member

osma commented Jan 24, 2024

I think we need a new issue for the race condition. It is unrelated to the tests in this PR, so we can proceed with finishing up this PR.

@miguelvaara miguelvaara moved this from In progress to Skosmos 3.0 Backlog (not this sprint) in Skosmos 3.0 Backlog Jan 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Skosmos 3.0 Backlog
  
Skosmos 3.0 Backlog (not this sprint)
Development

Successfully merging this pull request may close these issues.

None yet

2 participants