“This study run is invalid” #283

St-ZFeng · 2023-03-20T12:53:19Z

Hi.
Sometimes my participants say that during the experiment, the center of the screen displays “This study run is invalid”.This can happen even when only one participant is experimenting.

The sudden instability can indeed have a significant impact. I don't know if this is due to the stability problem of my server.

Thank anyone for any help and answers.

St-ZFeng · 2023-03-20T13:04:00Z

like this

kristian-lange · 2023-03-20T14:56:53Z

Hi,
This error can happen when the JATOS server side closes the batch session expectantly. This is definitely not a normal thing to happen. Maybe your server runs unstable? Can you monitor the server? Did it crash at one point? How is CPU, memory and disk doing at the server?

St-ZFeng · 2023-03-20T15:57:27Z

Hi, This error can happen when the JATOS server side closes the batch session expectantly. This is definitely not a normal thing to happen. Maybe your server runs unstable? Can you monitor the server? Did it crash at one point? How is CPU, memory and disk doing at the server?

When this happens on a participant's page, the experiment administrator interface appears to be all right, and the pages of other participants who are conducting the experiment at the same time also appear to be all right. Therefore, I think this problem may only occur in the page transmission of a single participant.

Thank you for your reply. This server is not owned by me personally, but I will try to inquire about the server's operational status later. By the way, it is indeed a very lightweight server, possibly with only 2 cores and 2G of memory.

kristian-lange · 2023-03-20T16:15:02Z

2GB should be okay for a small JATOS instance with not too many users and participants. Do you have access to JATOS administration page, /jatos/admin? If yes, then check the logs: click Logs and then "application.log". Search for any exceptions and errors.

St-ZFeng · 2023-03-20T16:23:07Z

I will try this tomorrow.

St-ZFeng · 2023-03-21T04:58:28Z

2GB should be okay for a small JATOS instance with not too many users and participants. Do you have access to JATOS administration page, /jatos/admin? If yes, then check the logs: click Logs and then "application.log". Search for any exceptions and errors.

I don't know what happen. There seems to be a lot of warnings. But the time stamp seems to be inconsistent with the time in my area. It is difficult to see which warning is related to the failed participant.

St-ZFeng · 2023-03-21T05:41:25Z

After time conversion, I found that the last error should have occurred around 3.20 8:00 on the JATOS server time.

kristian-lange · 2023-03-21T09:27:02Z

There is a lot going on in your log. Can you please copy-paste it here as text (instead of a screenshot). I can comment easier on text.

St-ZFeng · 2023-03-21T09:29:35Z

Here.

2023-03-20 07:54:20,376 [WARN] - c.g.a.AuthenticationAction - Authentication failed: remote address 31.56.55.118 tried to access page /
2023-03-20 07:54:41,164 [INFO] - publix_access - GET /publix/0bbd00c6-56d1-43c7-ac00-3872039dfa43/719651a6-5300-47c1-8b83-dfdae2c1933d/initData
2023-03-20 07:54:41,164 [INFO] - c.p.PublixInterceptor - .getInitData: studyResultId 577, componentId 14
2023-03-20 07:54:41,364 [INFO] - publix_access - POST /publix/0bbd00c6-56d1-43c7-ac00-3872039dfa43/heartbeat
2023-03-20 07:54:41,365 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 577
2023-03-20 07:54:41,456 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 577
2023-03-20 07:56:15,908 [INFO] - publix_access - GET /publix/G6AlWNVoorM
2023-03-20 07:56:15,908 [INFO] - c.p.PublixInterceptor - .run: studyCode G6AlWNVoorM
2023-03-20 07:56:15,909 [INFO] - c.p.w.GeneralMultiplePublix - .startStudy: studyCode G6AlWNVoorM, studyResultId578, studyId 13, batchId 38, workerId 570
2023-03-20 07:56:15,944 [INFO] - publix_access - GET /publix/233317f7-7c6d-444a-83a3-a6a653e67322/719651a6-5300-47c1-8b83-dfdae2c1933d/start
2023-03-20 07:56:15,945 [INFO] - c.p.PublixInterceptor - .startComponent: studyResultId 578, componentId 14
2023-03-20 07:56:18,708 [INFO] - publix_access - GET /publix/233317f7-7c6d-444a-83a3-a6a653e67322/719651a6-5300-47c1-8b83-dfdae2c1933d/initData
2023-03-20 07:56:18,708 [INFO] - c.p.PublixInterceptor - .getInitData: studyResultId 578, componentId 14
2023-03-20 07:56:18,750 [INFO] - publix_access - POST /publix/233317f7-7c6d-444a-83a3-a6a653e67322/heartbeat
2023-03-20 07:56:18,751 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 578
2023-03-20 07:56:18,776 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:56:41,493 [INFO] - publix_access - POST /publix/0bbd00c6-56d1-43c7-ac00-3872039dfa43/heartbeat
2023-03-20 07:56:41,494 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 577
2023-03-20 07:56:56,847 [INFO] - publix_access - GET /publix/G6AlWNVoorM
2023-03-20 07:56:56,847 [INFO] - c.p.PublixInterceptor - .run: studyCode G6AlWNVoorM
2023-03-20 07:56:56,848 [INFO] - c.p.w.GeneralMultiplePublix - .startStudy: studyCode G6AlWNVoorM, studyResultId579, studyId 13, batchId 38, workerId 571
2023-03-20 07:56:56,884 [INFO] - publix_access - GET /publix/d65d8734-f075-4c94-b1ee-9c993521c40a/719651a6-5300-47c1-8b83-dfdae2c1933d/start
2023-03-20 07:56:56,885 [INFO] - c.p.PublixInterceptor - .startComponent: studyResultId 579, componentId 14
2023-03-20 07:56:58,929 [INFO] - publix_access - GET /publix/0bbd00c6-56d1-43c7-ac00-3872039dfa43/719651a6-5300-47c1-8b83-dfdae2c1933d/initData
2023-03-20 07:56:58,930 [INFO] - c.p.PublixInterceptor - .getInitData: studyResultId 577, componentId 14
2023-03-20 07:57:03,372 [INFO] - publix_access - GET /publix/d65d8734-f075-4c94-b1ee-9c993521c40a/719651a6-5300-47c1-8b83-dfdae2c1933d/initData
2023-03-20 07:57:03,374 [INFO] - c.p.PublixInterceptor - .getInitData: studyResultId 579, componentId 14
2023-03-20 07:57:03,409 [INFO] - publix_access - POST /publix/d65d8734-f075-4c94-b1ee-9c993521c40a/heartbeat
2023-03-20 07:57:03,409 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 579
2023-03-20 07:57:03,443 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 579
2023-03-20 07:57:30,280 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/H.png but it seems you have no access rights.
2023-03-20 07:57:30,451 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/H.png but it seems you have no access rights.
2023-03-20 07:57:30,573 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/H.png but it seems you have no access rights.
2023-03-20 07:57:30,770 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/H.png but it seems you have no access rights.
2023-03-20 07:58:18,806 [INFO] - publix_access - POST /publix/233317f7-7c6d-444a-83a3-a6a653e67322/heartbeat
2023-03-20 07:58:18,807 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 578
2023-03-20 07:58:29,031 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/BOTH.png but it seems you have no access rights.
2023-03-20 07:58:29,216 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/BOTH.png but it seems you have no access rights.
2023-03-20 07:58:29,460 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/BOTH.png but it seems you have no access rights.
2023-03-20 07:58:29,624 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/BOTH.png but it seems you have no access rights.
2023-03-20 07:58:33,271 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/ft.png but it seems you have no access rights.
2023-03-20 07:58:33,633 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/ft.png but it seems you have no access rights.
2023-03-20 07:58:34,314 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/ft.png but it seems you have no access rights.
2023-03-20 07:58:34,434 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/ft.png but it seems you have no access rights.
2023-03-20 07:58:41,694 [INFO] - publix_access - POST /publix/0bbd00c6-56d1-43c7-ac00-3872039dfa43/heartbeat
2023-03-20 07:58:41,695 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 577
2023-03-20 07:59:03,486 [INFO] - publix_access - POST /publix/d65d8734-f075-4c94-b1ee-9c993521c40a/heartbeat
2023-03-20 07:59:03,487 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 579
2023-03-20 07:59:09,729 [INFO] - publix_access - GET /publix/233317f7-7c6d-444a-83a3-a6a653e67322/719651a6-5300-47c1-8b83-dfdae2c1933d/start
2023-03-20 07:59:09,730 [INFO] - c.p.PublixInterceptor - .startComponent: studyResultId 578, componentId 14
2023-03-20 07:59:09,901 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/jspsych/jspsych.js but it seems you have no access rights.
2023-03-20 07:59:09,938 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/jspsych/plugin-html-button-response.js but it seems you have no access rights.
2023-03-20 07:59:09,974 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/jspsych/plugin-preload.js but it seems you have no access rights.
2023-03-20 07:59:10,011 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/jspsych/plugin-html-keyboard-response.js but it seems you have no access rights.
2023-03-20 07:59:10,048 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/jspsych/plugin-cloze.js but it seems you have no access rights.
2023-03-20 07:59:10,085 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/jspsych/plugin-survey.js but it seems you have no access rights.
2023-03-20 07:59:10,122 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/jspsych/plugin-html-slider-response.js but it seems you have no access rights.
2023-03-20 07:59:10,406 [INFO] - publix_access - GET /publix/233317f7-7c6d-444a-83a3-a6a653e67322/719651a6-5300-47c1-8b83-dfdae2c1933d/start
2023-03-20 07:59:10,407 [INFO] - c.p.PublixInterceptor - .startComponent: studyResultId 578, componentId 14
2023-03-20 07:59:13,273 [INFO] - publix_access - GET /publix/233317f7-7c6d-444a-83a3-a6a653e67322/719651a6-5300-47c1-8b83-dfdae2c1933d/initData
2023-03-20 07:59:13,273 [INFO] - c.p.PublixInterceptor - .getInitData: studyResultId 578, componentId 14
2023-03-20 07:59:13,409 [INFO] - publix_access - POST /publix/233317f7-7c6d-444a-83a3-a6a653e67322/heartbeat
2023-03-20 07:59:13,409 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 578
2023-03-20 07:59:13,507 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:13,780 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:14,032 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:14,294 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:14,563 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:14,941 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:15,219 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:15,474 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:15,726 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 08:00:08,980 [INFO] - g.ErrorHandler - not found: Requested page /jatos/import/studyConfirmed couldn't be found.
2023-03-20 08:00:18,844 [INFO] - publix_access - POST /publix/233317f7-7c6d-444a-83a3-a6a653e67322/heartbeat
2023-03-20 08:00:18,844 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 578
2023-03-20 08:00:38,574 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/overlap.png but it seems you have no access rights.
2023-03-20 08:00:38,773 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/overlap.png but it seems you have no access rights.
2023-03-20 08:00:38,889 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/overlap.png but it seems you have no access rights.
2023-03-20 08:00:39,025 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/overlap.png but it seems you have no access rights.
2023-03-20 08:00:41,824 [INFO] - publix_access - POST /publix/0bbd00c6-56d1-43c7-ac00-3872039dfa43/heartbeat
2023-03-20 08:00:41,825 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 577
2023-03-20 08:00:42,602 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/ft.png but it seems you have no access rights.
2023-03-20 08:00:42,932 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/ft.png but it seems you have no access rights.
2023-03-20 08:00:43,125 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/ft.png but it seems you have no access rights.
2023-03-20 08:00:43,245 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/ft.png but it seems you have no access rights.
2023-03-20 08:01:03,568 [INFO] - publix_access - POST /publix/d65d8734-f075-4c94-b1ee-9c993521c40a/heartbeat
2023-03-20 08:01:03,568 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 579
2023-03-20 08:01:11,723 [WARN] - c.g.a.AuthenticationAction - Authentication failed: remote address 193.32.162.159 tried to access page /
2023-03-20 08:02:18,894 [INFO] - publix_access - POST /publix/233317f7-7c6d-444a-83a3-a6a653e67322/heartbeat
2023-03-20 08:02:18,894 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 578
2023-03-20 08:02:41,935 [INFO] - publix_access - POST /publix/0bbd00c6-56d1-43c7-ac00-3872039dfa43/heartbeat
2023-03-20 08:02:41,936 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 577
2023-03-20 08:03:03,651 [INFO] - publix_access - POST /publix/d65d8734-f075-4c94-b1ee-9c993521c40a/heartbeat
2023-03-20 08:03:03,652 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 579
2023-03-20 08:04:18,940 [INFO] - publix_access - POST /publix/233317f7-7c6d-444a-83a3-a6a653e67322/heartbeat
2023-03-20 08:04:18,941 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 578
2023-03-20 08:04:42,048 [INFO] - publix_access - POST /publix/0bbd00c6-56d1-43c7-ac00-3872039dfa43/heartbeat
2023-03-20 08:04:42,049 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 577
2023-03-20 08:05:03,739 [INFO] - publix_access - POST /publix/d65d8734-f075-4c94-b1ee-9c993521c40a/heartbeat
2023-03-20 08:05:03,740 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 579
2023-03-20 08:05:24,065 [INFO] - publix_access - POST /publix/d65d8734-f075-4c94-b1ee-9c993521c40a/719651a6-5300-47c1-8b83-dfdae2c1933d/resultData
2023-03-20 08:05:24,066 [INFO] - c.p.PublixInterceptor - .submitOrAppendResultData: studyResultId 579, componentId 14
2023-03-20 08:05:24,101 [INFO] - publix_access - GET /publix/d65d8734-f075-4c94-b1ee-9c993521c40a/end?successful=true&message=con-mqb-725
2023-03-20 08:05:24,101 [INFO] - c.p.PublixInterceptor - .finishStudy: studyResultId 579, successful true
2023-03-20 08:05:49,878 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/News2.png but it seems you have no access rights.
2023-03-20 08:05:50,303 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/News2.png but it seems you have no access rights.
2023-03-20 08:05:50,463 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/News2.png but it seems you have no access rights.
2023-03-20 08:05:50,598 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/News2.png but it seems you have no access rights.
2023-03-20 08:06:10,294 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/1441607667576727.gif but it seems you have no access rights.
2023-03-20 08:06:10,464 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/1441607667576727.gif but it seems you have no access rights.
2023-03-20 08:06:10,595 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/1441607667576727.gif but it seems you have no access rights.
2023-03-20 08:06:10,716 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/1441607667576727.gif but it seems you have no access rights.
2023-03-20 08:06:18,997 [INFO] - publix_access - POST /publix/233317f7-7c6d-444a-83a3-a6a653e67322/heartbeat
2023-03-20 08:06:18,997 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 578
2023-03-20 08:06:42,248 [INFO] - publix_access - POST /publix/0bbd00c6-56d1-43c7-ac00-3872039dfa43/heartbeat
2023-03-20 08:06:42,248 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 577
2023-03-20 08:08:19,037 [INFO] - publix_access - POST /publix/233317f7-7c6d-444a-83a3-a6a653e67322/heartbeat
2023-03-20 08:08:19,038 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 578
2023-03-20 08:08:42,386 [INFO] - publix_access - POST /publix/0bbd00c6-56d1-43c7-ac00-3872039dfa43/heartbeat
2023-03-20 08:08:42,387 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 577

kristian-lange · 2023-03-21T09:59:12Z

I cannot find anything in the log that explains the error “This study run is invalid”.

There are no hints for a lack of memory or disk space (CPU is usually not a problem with JATOS). But this doesn't mean that memory or disk is not a problem.

But there are a couple of strange log messages:

2023-03-20 07:57:30,280 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/H.png but it seems you have no access rights.

Your study run cannot access an image with the path Study2-empathy/H.png. Maybe the path is wrong? Check the component with the UUID 719651a6-5300-47c1-8b83-dfdae2c1933d.

2023-03-20 07:58:29,031 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/BOTH.png but it seems you have no access rights.
...
2023-03-20 07:58:33,271 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/ft.png but it seems you have no access rights.
...
2023-03-20 07:59:09,938 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/jspsych/plugin-html-button-response.js but it seems you have no access rights.
2023-03-20 07:59:09,974 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/jspsych/plugin-preload.js but it seems you have no access rights.
2023-03-20 07:59:10,011 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/jspsych/plugin-html-keyboard-response.js but it seems you have no access rights.
2023-03-20 07:59:10,048 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/jspsych/plugin-cloze.js but it seems you have no access rights.
2023-03-20 07:59:10,085 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/jspsych/plugin-survey.js but it seems you have no access rights.
2023-03-20 07:59:10,122 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/jspsych/plugin-html-slider-response.js but it seems you have no access rights.

Same with these paths.

2023-03-20 07:59:13,507 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:13,780 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:14,032 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:14,294 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:14,563 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:14,941 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:15,219 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:15,474 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578
2023-03-20 07:59:15,726 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 578

The batch channel for one study run got opened 10 times in short succession. Usually only once. Strange! Maybe reloads?

2023-03-20 08:00:08,980 [INFO] - g.ErrorHandler - not found: Requested page /jatos/import/studyConfirmed couldn't be found.

That is a strange error. The endpoint exists for a HTTP POST. Do you call this endpoint somehow manually with a different HTTP method? Why? Better use the JATOS API.

That's all I can say about the log. Have you got any monitoring of your server? And which version of JATOS do you run?

St-ZFeng · 2023-03-21T11:17:22Z

2023-03-21 10:12:35,818 [INFO] - gui_access - GET /jatos/logs/application.log?reverse=true (admin)
2023-03-21 10:12:19,490 [INFO] - c.p.PublixInterceptor - .finishStudy: studyResultId 587, successful true
2023-03-21 10:12:19,490 [INFO] - publix_access - GET /publix/677c03f4-150e-4322-a4ae-d5eb86bc9f96/end?successful=true&message=con-507-523
2023-03-21 10:12:18,444 [INFO] - c.p.PublixInterceptor - .submitOrAppendResultData: studyResultId 587, componentId 14
2023-03-21 10:12:18,443 [INFO] - publix_access - POST /publix/677c03f4-150e-4322-a4ae-d5eb86bc9f96/719651a6-5300-47c1-8b83-dfdae2c1933d/resultData
2023-03-21 10:12:09,883 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 587
2023-03-21 10:12:09,883 [INFO] - publix_access - POST /publix/677c03f4-150e-4322-a4ae-d5eb86bc9f96/heartbeat
2023-03-21 10:11:58,192 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 587
2023-03-21 10:11:35,235 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 587
2023-03-21 10:11:11,230 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 587
2023-03-21 10:10:54,419 [INFO] - gui_access - GET /jatos/login (null)
2023-03-21 10:10:54,321 [WARN] - c.g.a.AuthenticationAction - Authentication failed: remote address 220.196.160.61 tried to access page /jatos/13/14/run
2023-03-21 10:10:48,277 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 587
2023-03-21 10:10:25,314 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 587
2023-03-21 10:10:22,823 [INFO] - gui_access - GET /jatos/login (null)
2023-03-21 10:10:22,701 [WARN] - c.g.a.AuthenticationAction - Authentication failed: remote address 220.196.160.151 tried to access page /jatos/13/studyLinks
2023-03-21 10:10:15,080 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 589
2023-03-21 10:10:14,833 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 589
2023-03-21 10:10:14,581 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 589
2023-03-21 10:10:14,326 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 589
2023-03-21 10:10:13,944 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 589
2023-03-21 10:10:13,702 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 589
2023-03-21 10:10:13,450 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 589
2023-03-21 10:10:13,185 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 589
2023-03-21 10:10:12,920 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 589
2023-03-21 10:10:12,833 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 589
2023-03-21 10:10:12,832 [INFO] - publix_access - POST /publix/c683f26f-938f-466a-a0c3-46f7e3896c94/heartbeat
2023-03-21 10:10:12,693 [INFO] - c.p.PublixInterceptor - .getInitData: studyResultId 589, componentId 14
2023-03-21 10:10:12,693 [INFO] - publix_access - GET /publix/c683f26f-938f-466a-a0c3-46f7e3896c94/719651a6-5300-47c1-8b83-dfdae2c1933d/initData
2023-03-21 10:10:09,616 [INFO] - c.p.PublixInterceptor - .startComponent: studyResultId 589, componentId 14
2023-03-21 10:10:09,615 [INFO] - publix_access - GET /publix/c683f26f-938f-466a-a0c3-46f7e3896c94/719651a6-5300-47c1-8b83-dfdae2c1933d/start
2023-03-21 10:10:09,486 [INFO] - c.p.w.GeneralMultiplePublix - .startStudy: studyCode G6AlWNVoorM, studyResultId589, studyId 13, batchId 38, workerId 579
2023-03-21 10:10:09,485 [INFO] - c.p.PublixInterceptor - .run: studyCode G6AlWNVoorM
2023-03-21 10:10:09,485 [INFO] - publix_access - GET /publix/G6AlWNVoorM
2023-03-21 10:10:09,195 [INFO] - g.ErrorHandler - not found: Requested page  /publix/jspsych/plugin-html-slider-response.js couldn't be found.
2023-03-21 10:10:09,161 [INFO] - g.ErrorHandler - not found: Requested page  /publix/jspsych/plugin-survey.js couldn't be found.
2023-03-21 10:10:09,126 [INFO] - g.ErrorHandler - not found: Requested page  /publix/jspsych/plugin-cloze.js couldn't be found.
2023-03-21 10:10:09,092 [INFO] - g.ErrorHandler - not found: Requested page  /publix/jspsych/plugin-html-keyboard-response.js couldn't be found.
2023-03-21 10:10:09,058 [INFO] - g.ErrorHandler - not found: Requested page  /publix/jspsych/plugin-preload.js couldn't be found.
2023-03-21 10:10:09,023 [INFO] - g.ErrorHandler - not found: Requested page  /publix/jspsych/plugin-html-button-response.js couldn't be found.
2023-03-21 10:10:08,989 [INFO] - g.ErrorHandler - not found: Requested page  /publix/jspsych/jspsych.js couldn't be found.
2023-03-21 10:10:08,921 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 587
2023-03-21 10:10:08,920 [INFO] - publix_access - POST /publix/677c03f4-150e-4322-a4ae-d5eb86bc9f96/heartbeat
2023-03-21 10:10:08,871 [INFO] - c.p.PublixInterceptor - .startComponent: studyResultId 588, componentId 14
2023-03-21 10:10:08,870 [INFO] - publix_access - GET /publix/5d4ab8c2-4a1c-4994-bcbc-c474a79241a3/719651a6-5300-47c1-8b83-dfdae2c1933d/start
2023-03-21 10:10:08,747 [INFO] - c.p.w.GeneralMultiplePublix - .startStudy: studyCode G6AlWNVoorM, studyResultId588, studyId 13, batchId 38, workerId 578
2023-03-21 10:10:08,746 [INFO] - c.p.PublixInterceptor - .run: studyCode G6AlWNVoorM
2023-03-21 10:10:08,746 [INFO] - publix_access - GET /publix/G6AlWNVoorM
2023-03-21 10:10:01,331 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 587
2023-03-21 10:09:37,320 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 587
2023-03-21 10:09:20,871 [INFO] - c.p.PublixInterceptor - .getInitData: studyResultId 587, componentId 14
2023-03-21 10:09:20,869 [INFO] - publix_access - GET /publix/677c03f4-150e-4322-a4ae-d5eb86bc9f96/719651a6-5300-47c1-8b83-dfdae2c1933d/initData
2023-03-21 10:09:19,942 [INFO] - gui_access - GET /jatos/login (null)
2023-03-21 10:09:19,813 [WARN] - c.g.a.AuthenticationAction - Authentication failed: remote address 220.196.160.101 tried to access page /jatos/13/14/tableData
2023-03-21 10:09:14,343 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 587
2023-03-21 10:09:10,662 [INFO] - gui_access - GET /jatos/logs/application.log?reverse=true (admin)
2023-03-21 10:08:55,601 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/external_page.html but it seems you have no access rights.
2023-03-21 10:08:52,414 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 587
2023-03-21 10:08:51,091 [INFO] - g.ErrorHandler - PublixException during call /publix/646d97c7-e6be-4468-90d8-3204f1213f91/719651a6-5300-47c1-8b83-dfdae2c1933d/initData: Worker 1 is not allowed to do study 13.
2023-03-21 10:08:51,091 [INFO] - c.p.PublixInterceptor - .getInitData: studyResultId 586, componentId 14
2023-03-21 10:08:51,090 [INFO] - publix_access - GET /publix/646d97c7-e6be-4468-90d8-3204f1213f91/719651a6-5300-47c1-8b83-dfdae2c1933d/initData
2023-03-21 10:08:29,353 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 587
2023-03-21 10:08:16,364 [INFO] - gui_access - GET /jatos/logs/application.log?reverse=true (admin)
2023-03-21 10:08:08,565 [INFO] - gui_access - GET /jatos/sidebarStudyList (admin)
2023-03-21 10:08:07,954 [INFO] - c.p.GeneralMultipleBatchChannel - .open: studyResult 587
2023-03-21 10:08:07,950 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 587
2023-03-21 10:08:07,949 [INFO] - publix_access - POST /publix/677c03f4-150e-4322-a4ae-d5eb86bc9f96/heartbeat
2023-03-21 10:08:07,922 [INFO] - gui_access - GET /jatos/releaseInfo? (admin)
2023-03-21 10:08:07,910 [INFO] - gui_access - GET /jatos/status (admin)
2023-03-21 10:08:06,972 [INFO] - c.p.PublixInterceptor - .getInitData: studyResultId 587, componentId 14
2023-03-21 10:08:06,972 [INFO] - publix_access - GET /publix/677c03f4-150e-4322-a4ae-d5eb86bc9f96/719651a6-5300-47c1-8b83-dfdae2c1933d/initData
2023-03-21 10:08:06,326 [INFO] - gui_access - GET /jatos/admin (admin)
2023-03-21 10:07:52,271 [INFO] - c.p.PublixInterceptor - .startComponent: studyResultId 587, componentId 14
2023-03-21 10:07:52,270 [INFO] - publix_access - GET /publix/677c03f4-150e-4322-a4ae-d5eb86bc9f96/719651a6-5300-47c1-8b83-dfdae2c1933d/start
2023-03-21 10:07:51,272 [INFO] - c.p.w.GeneralMultiplePublix - .startStudy: studyCode G6AlWNVoorM, studyResultId587, studyId 13, batchId 38, workerId 577
2023-03-21 10:07:51,270 [INFO] - c.p.PublixInterceptor - .run: studyCode G6AlWNVoorM
2023-03-21 10:07:51,270 [INFO] - publix_access - GET /publix/G6AlWNVoorM
2023-03-21 10:07:38,435 [INFO] - gui_access - GET /jatos/13/batch/38/generalMultipleRun (admin)
2023-03-21 10:07:34,968 [INFO] - gui_access - GET /jatos/13/batch/38/studyLinksSetupData (admin)
2023-03-21 10:07:32,436 [INFO] - gui_access - GET /jatos/sidebarStudyList (admin)
2023-03-21 10:07:32,435 [INFO] - gui_access - GET /jatos/13/batch/38/studyLinksSetupData (admin)
2023-03-21 10:07:31,472 [INFO] - gui_access - GET /jatos/13/batches?_=1679393248964 (admin)
2023-03-21 10:07:28,664 [INFO] - gui_access - GET /jatos/13/studyLinks (admin)
2023-03-21 10:07:26,515 [INFO] - gui_access - GET /jatos/13/componentsTableData?_=1679393245122 (admin)
2023-03-21 10:07:22,960 [INFO] - gui_access - GET /jatos/13/14/tableData?_=1679393241184 (admin)
2023-03-21 10:07:22,887 [INFO] - gui_access - GET /jatos/sidebarStudyList (admin)
2023-03-21 10:07:20,824 [INFO] - gui_access - GET /jatos/13/14/results (admin)
2023-03-21 10:07:10,308 [INFO] - gui_access - GET /jatos/13/componentsTableData?_=1679393229199 (admin)

I just ran a complete study during this time and some of the problems disappeared and some remained. The problem of opening the batch channel multiple times in a short period of time should always be present. It is not clear what is causing these problems. However, there is nothing unusual about the experimental run page or the administrator interface, except for two extra data records (albeit records without data files).

I built this JATOS server four months ago following a tutorial I found on the web, and have not opened the server backend since then. Everything is done on the web page. I don't know if these problems stem from the server side build process. Maybe I should take the time to rebuild the server? I don't know much about this aspect of server building.

Thanks for going out of your way to answer this. The exceptions are indeed not related to the "invalid" exception. My JATOS version is 3.7.4. system information is attached below.

This is probably a very tricky problem. If you find any solution to this problem, thank you for suggesting it. I will check the log file in time the next time the "invalid" is displayed.

JATOS configuration
Version: 3.7.4
URL host: http://soc......
URL basepath: /
URL host + basepath: http://soc......
Local basepath: /opt/docker
Study assets root path: /opt/docker/study_assets_root
Result data max size: 5.0 MB
Result uploads allowed: true
Result uploads path: /opt/docker/result_uploads
Result uploads max file size: 30.0 MB
Result uploads limit per study run: 50.0 MB
Study logs allowed: true
Study logs path: /opt/docker/study_logs
Uses in-memory DB: false
User session validation: false
User session timeout: 1440
User session inactivity: 60
DB URL: jdbc:h2:./database/jatos;MODE=MYSQL;DATABASE_TO_UPPER=FALSE;IGNORECASE=TRUE;DEFAULT_LOCK_TIMEOUT=10000;SELECT_FOR_UPDATE_MVCC=FALSE
DB driver: org.h2.Driver
JPA unit: mysqlPersistenceUnit
Google OAuth allowed: false
LDAP URL: 
LDAP base DN: []
LDAP admin DN: 
LDAP timeout: 5000
Max results DB query size: 10

OS info
OS name: Linux
OS version: 5.4.0-77-generic
System load average: 0.01
Available processors: 2

JVM info
Uptime: 2570h 49m 24.53s
Name: 14@cf5fac895732
PID: 14
Java name: OpenJDK 64-Bit Server VM
Java version: 11.0.15
Thread count: 33
Peak thread count: 55
Total memory: 230.7 MB
Free memory: 71.9 MB
Used memory: 158.8 MB
Max memory: 1.0 GB
Heap memory used: 150 MB
Non-heap memory used: 197 MB

kristian-lange · 2023-03-21T15:29:55Z

Good to know, your server did not crash recently (Uptime: 2570h 49m 24.53s) :)

Max memory: 1.0 GB - 1 GB just for JATOS should be enough for running just one experiment

You could consider updating your JATOS to 3.8.1. I don't think this will fix your issue but there are some performance improvements in the recent releases that might help especially since you have only 1GB memory on your server.

And what's about those file access issues? Did you check the paths in your study? E.g.

2023-03-20 07:57:30,280 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/H.png but it seems you have no access rights.

But my main concern are these multiple c.p.GeneralMultipleBatchChannel - .open. There should only be one. And I do not really have an idea what's going on here.

St-ZFeng · 2023-03-22T03:05:03Z

Fortunately, these issues will not affect my experimental operation.

St-ZFeng · 2023-03-22T08:30:08Z

2023-03-22 08:08:49,387 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 623
2023-03-22 08:08:49,387 [INFO] - publix_access - POST /publix/d9fdcfb9-a3e1-4cb1-acb9-2a38c51eccfe/heartbeat
2023-03-22 08:08:03,267 [INFO] - c.p.PublixInterceptor - .finishStudy: studyResultId 616, successful true
2023-03-22 08:08:03,267 [INFO] - publix_access - GET /publix/044c9a87-0c86-44b2-bd2c-8250aeabf38a/end?successful=true&message=con-89p-266
2023-03-22 08:08:03,165 [INFO] - c.p.PublixInterceptor - .submitOrAppendResultData: studyResultId 616, componentId 14
2023-03-22 08:08:03,164 [INFO] - publix_access - POST /publix/044c9a87-0c86-44b2-bd2c-8250aeabf38a/719651a6-5300-47c1-8b83-dfdae2c1933d/resultData
2023-03-22 08:07:39,161 [INFO] - c.p.PublixInterceptor - .finishStudy: studyResultId 619, successful true
2023-03-22 08:07:39,160 [INFO] - publix_access - GET /publix/046bc236-262d-4e20-9e91-c9fc364d8238/end?successful=true&message=con-0vy-911
2023-03-22 08:07:39,073 [INFO] - c.p.PublixInterceptor - .submitOrAppendResultData: studyResultId 619, componentId 14
2023-03-22 08:07:39,072 [INFO] - publix_access - POST /publix/046bc236-262d-4e20-9e91-c9fc364d8238/719651a6-5300-47c1-8b83-dfdae2c1933d/resultData
2023-03-22 08:07:28,082 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 619
2023-03-22 08:07:28,082 [INFO] - publix_access - POST /publix/046bc236-262d-4e20-9e91-c9fc364d8238/heartbeat
2023-03-22 08:07:02,343 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/N.png but it seems you have no access rights.
2023-03-22 08:07:02,180 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/N.png but it seems you have no access rights.
2023-03-22 08:07:02,004 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/N.png but it seems you have no access rights.
2023-03-22 08:07:01,744 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/N.png but it seems you have no access rights.
2023-03-22 08:06:56,593 [INFO] - gui_access - GET /jatos/13/batch/38/tableData?workerType=GeneralMultiple&_=1679472415325 (admin)
2023-03-22 08:06:56,546 [INFO] - gui_access - GET /jatos/sidebarStudyList (admin)
2023-03-22 08:06:54,921 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 618
2023-03-22 08:06:54,920 [INFO] - publix_access - POST /publix/e39039d6-3bc6-43a3-82ed-3ee54f3e5277/heartbeat
2023-03-22 08:06:54,417 [INFO] - gui_access - GET /jatos/13/batch/38/results?workerType=GeneralMultiple (admin)
2023-03-22 08:06:51,090 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 617
2023-03-22 08:06:51,090 [INFO] - publix_access - POST /publix/01f92197-6eaa-4e42-b19a-9bf25a5a29b1/heartbeat
2023-03-22 08:06:49,337 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 623
2023-03-22 08:06:49,337 [INFO] - publix_access - POST /publix/d9fdcfb9-a3e1-4cb1-acb9-2a38c51eccfe/heartbeat
2023-03-22 08:06:28,550 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/overlap.png but it seems you have no access rights.
2023-03-22 08:06:28,436 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/overlap.png but it seems you have no access rights.
2023-03-22 08:06:28,313 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/overlap.png but it seems you have no access rights.
2023-03-22 08:06:28,132 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/overlap.png but it seems you have no access rights.
2023-03-22 08:06:10,174 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 616
2023-03-22 08:06:10,174 [INFO] - publix_access - POST /publix/044c9a87-0c86-44b2-bd2c-8250aeabf38a/heartbeat
2023-03-22 08:06:05,868 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/BOTH.png but it seems you have no access rights.
2023-03-22 08:06:05,267 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/BOTH.png but it seems you have no access rights.
2023-03-22 08:06:04,519 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/BOTH.png but it seems you have no access rights.
2023-03-22 08:06:04,344 [INFO] - c.p.StudyAssets - .viaAssetsPath: You tried to access the file Study2-empathy/BOTH.png but it seems you have no access rights.
2023-03-22 08:05:27,930 [INFO] - c.p.PublixInterceptor - .heartbeat: studyResultId 619

Just now this issue happened again——a participant's screen displayed "invalid". I checked the logs during this period and didn't see any strange exceptions. I have already checked the path issue, it doesn't occur in my local running, but it happens after importing the experimental file to the server. Tonight I will try to update the JATOS server to the latest version. Ideally, it would be best to rebuild the server directly.

St-ZFeng · 2023-03-23T14:31:28Z

My god! When I updated to the latest version, the structure of the data I collected changed dramatically, which meant that I had to refactor my data analysis code. Is this a normal change after the update? Or did I make a mistake somewhere.

St-ZFeng · 2023-03-23T14:35:55Z

The line break seems to have disappeared.

kristian-lange · 2023-03-28T09:11:23Z

Sorry for the late reply. Can you please elaborate on how the structure of your data changed? What was it before and how does it look now. You say the line breaks disappeared?

St-ZFeng · 2023-03-28T10:45:58Z

Never mind, I have already solved this problem.

Yes, the line breaks did disappear. I wrote a program using JSPsych, and after updating JATOS to the latest version, the line breaks in the data were removed, resulting in all the CSV data being in a single row (there should have been multiple rows, with one row of data for each component). The same thing did not happen in version 3.7.4, so I have now reverted back to that version.

I wrote a Python program to deal with the line break issue, but the process was a bit convoluted, especially since my HTML page contained a lot of nested quotes.

I didn't do any further testing, so I don't know if this problem is caused by issues with the latest version or compatibility issues between two versions. Perhaps it only occurs in my study.

kristian-lange · 2023-03-28T20:57:26Z

Never mind, I have already solved this problem.

Would you care to share how you solve it? Maybe someone else has the same problem and can use your expertise.

Yes, the line breaks did disappear. I wrote a program using JSPsych, and after updating JATOS to the latest version, the line breaks in the data were removed, resulting in all the CSV data being in a single row (there should have been multiple rows, with one row of data for each component).

I see. I just tried and can confirm. This should not happen. Result data should be allowed to have line-breaks. I created a new bug issue (#285) for this.

St-ZFeng · 2023-04-03T04:30:20Z

I was sick the other day, so a lot of work has been put on hold, and I apologize for not responding to your message until now.

If there were no nested quotes in the html, then this problem would be easily solved by simply inserting line breaks after a specific number of quotes (usually two times the maximum number of columns). However, in Jspsych's data the entire content of the html is usually recorded, for example <p style="....."> this type of tag information, which creates nested quotes.

The pairing status of each quotation mark is first checked one by one. If a character is a paired quotation mark and its next character is not a comma but an unpaired quotation mark, a line-break is inserted between the two. This usually results in broken data. Thanks to Jspsych's data format, which starts with multiple consecutive nulls from the third line, the second step is to merge all lines that do not start with consecutive nulls with the previous line. But I'm not sure that this method works in all cases. Please be sure to perform a data backup before this operation.

import os

folder_path = './'  
#Step one
for filename in os.listdir(folder_path):
    if filename.endswith('.txt'):
        file_path = os.path.join(folder_path, filename)
        with open(file_path, 'r', encoding='utf-8') as f:
            content = f.read()
        modified_content = ''
        open_quote = True  
        for i, c in enumerate(content):
            modified_content += c
            if c == '"':
                open_quote = not open_quote 
                if i < len(content) - 1 and content[i+1] != ','and open_quote:

                    modified_content += '\n'

        with open(file_path, 'w', encoding='utf-8-sig') as f:
            f.write(modified_content)
            


#Step two
for filename in os.listdir(folder_path):
    if filename.endswith(".txt"):  
        file_path = os.path.join(folder_path, filename)
        with open(file_path, "r", encoding="utf-8") as f:
            lines = f.readlines()

        merged_lines = [lines[0].rstrip()]  
        for i in range(1, len(lines)):
            line = lines[i].rstrip()
            if i > 2 and not line.startswith('"","",""'):
                merged_lines[-1] += line
            else:
                merged_lines.append(line)

        with open(os.path.splitext(file_path)[0] + ".txt", "w", encoding="utf-8-sig", newline='') as f:
            for line in merged_lines:
                f.write(line + "\n")

kristian-lange · 2023-04-03T14:58:20Z

Thank you for sharing! Maybe it can help others :)
And the next release v3.8.2 with the bug fix will come out soon.

St-ZFeng · 2023-04-04T05:53:00Z

I am glad to hear this. Is there an expected release time for the new version？

kristian-lange · 2023-04-04T14:57:36Z

There is no release date, but I guess within the next 2 weeks.

St-ZFeng · 2023-04-26T14:32:12Z

The line break seems to have disappeared.

This issue seems to be happening with 3.7.6 as well. The data view of the JATOS page seems to be fine, but once exported, the line breaks still disappear.

St-ZFeng · 2023-04-26T14:33:40Z

Hope the new version will be released soon.

kristian-lange · 2023-04-27T08:07:03Z

I'm sorry for the delay. There are some issues related to running JATOS in a cluster with multiple nodes that have to solved before we can release the new version. But hopefully, fingers crossed, next weekend it's going to happen.

kirstenstark · 2023-05-02T21:20:07Z

Hi Kristian,
thank you so much for sharing JATOS with us. We are having a similar problem. Our institute's server was updated about six weeks ago, and since then about 25 % of our participants have been receiving the message "The experiment failed to load." at a seemingly random moment during the experiment. Curisously, we have been collecting data for this experiment since January (about 65-70 datasets collected) and have not changed anything about this experiment since then. So far, we have never had this problem.
Unfortunately, I can't reproduce the problem myself, but a student sent me a screenshot their console output. Unfortunately I can't make sense of it and don't really know where in my could I should try to fix it. All images are available and are loaded properly for other participants. The problem occurred on different OS and in different browsers (including Chrome and Firefox).

Regarding the issue "Internal JATOS error during /publix/[jatos study code]. Check logs to get more information." others have reported in the cogsci forum: We had a similar problem about two weeks ago (a month after the update), when we out of a sudden got the same error message every time any Jatos link was opened in a browser where a Jatos link had been opened at some point before. This problem can be fixed by clearing the browser cache (even though this means all participants need to be instructed to empty their browser cache first).

kristian-lange · 2023-05-03T13:45:03Z

Hi!

It would have been better to post this kind of question in the CogSci forum since it's more a support kind of question. And secondly it would have been better to post the question in a new thread or issue; just to keep things separated and clean. Sorry for nagging so much ;). But, now, since we are already here ... you have two issues as far as I can see: 1) the connection problems, and 2) the Internal JATOS error due malformed cookies.

About 1) The two screenshots show that your participant was not able to reach the JATOS server (lots of connection timeouts, batch channel heartbeat fail, websocket connection fail). So something was broken, either the JATOS server or something between the server and your participant (router, network etc.). Here I can't help much since I do not operate this particular JATOS server nor the other parts of this infrastructure. I'd recommend to contact your admin.

About 2) JATOS has a problem dealing with old cookies from older JATOS versions after an update with certain browsers. This is a one-time thing and after one deletes those cookies JATOS works normally. But it is a bug and the next version (v3.8.2) will have a fix for it.

Best,
Kristian

kirstenstark · 2023-05-04T17:56:05Z

Hi!
Thank you for your reply! And sorry for posting in the wrong place, I wasn't sure which forum to use. I'll switch to the CogSci forum :)
Should I just delete my post here?

St-ZFeng · 2023-05-07T15:04:55Z

I'm sorry for the delay. There are some issues related to running JATOS in a cluster with multiple nodes that have to solved before we can release the new version. But hopefully, fingers crossed, next weekend it's going to happen.

It doesn't seem to be possible to update directly in the existing server yet, do I need to reinstall the server or will this feature take a few days to implement? My current version is 3.7.6.

kristian-lange · 2023-05-07T19:23:04Z

It should be possible to update from 3.7.6 to 3.8.2. Why do you think it is not?

St-ZFeng · 2023-05-08T07:11:52Z

Still showing as a 3.8.1 update.

St-ZFeng · 2023-05-08T07:26:38Z

Oh, no more questions. Probably an internet connection issue, even the 3.8.1 update doesn't work. I will take some time to rebuild the server. After all, this is the only viable way to get the newest version for me.

Thank you again.

kristian-lange · 2023-05-08T07:38:28Z

Yes, looks like some connection issue.

And a hint: you can force an update to a certain version by using the 'version' query parameter. Sometimes JATOS doesn't acknowledge the newest version. E.g. for cortex.jatos.org it would be:

https://cortex.jatos.org/jatos/admin?version=v3.8.2

St-ZFeng · 2023-05-08T07:43:55Z

OK, I'll try it if the internet connection improves.

St-ZFeng · 2023-08-06T16:28:16Z

Recently I found that even though I no longer have the "This study run is invalid" error, sometimes I still can't find some of the data submitted by participants who have given proof of experiment completion. This problem usually occurs with a 5% probability.

After some summarization, I feel that the problem may not be a server issue, but rather that the participants or their devices are doing something unusual during the experiment. A common scenario is that the total runtime of the experiment is sufficient, but it consistently shows not finished yet. Does this stem from the participant closing the end page too quickly? As a result their slow network has not yet uploaded the data or the end-of-experiment signal to the server. In another rare case, the message indicated that the study did not allow refreshing, but the time continued to run for the entire length of time that the experiment should have run, and the participant gave proof of the experiment's completion. Is this due to an "implicit refresh" (there is probably no such thing, I'm just speculating) that does not change the browser display of the study page, but breaks the connection to the server in the background and sends a refresh signal？

These are my unprofessional guesses, and I can't say for sure exactly what the problem is caused by. Monitoring the user side is difficult, so solving this problem may be tricky as well. But the problem is certainly annoying.

Another issue is that the times in the logs don't seem to be aligned with the time the study was run. I recall that the time of the study run was changed in one of the releases, but the time recorded in the logs was not synchronized with the release change.

St-ZFeng changed the title ~~This study run is~~ “This study run is invalid” Mar 20, 2023

“This study run is invalid” #283

“This study run is invalid” #283

Comments

St-ZFeng commented Mar 20, 2023 • edited

St-ZFeng commented Mar 20, 2023

kristian-lange commented Mar 20, 2023

St-ZFeng commented Mar 20, 2023

kristian-lange commented Mar 20, 2023

St-ZFeng commented Mar 20, 2023

St-ZFeng commented Mar 21, 2023

St-ZFeng commented Mar 21, 2023 • edited

kristian-lange commented Mar 21, 2023 • edited

St-ZFeng commented Mar 21, 2023

kristian-lange commented Mar 21, 2023

St-ZFeng commented Mar 21, 2023

kristian-lange commented Mar 21, 2023

St-ZFeng commented Mar 22, 2023

St-ZFeng commented Mar 22, 2023

St-ZFeng commented Mar 23, 2023

St-ZFeng commented Mar 23, 2023

kristian-lange commented Mar 28, 2023

St-ZFeng commented Mar 28, 2023

kristian-lange commented Mar 28, 2023

St-ZFeng commented Apr 3, 2023 • edited

kristian-lange commented Apr 3, 2023

St-ZFeng commented Apr 4, 2023

kristian-lange commented Apr 4, 2023

St-ZFeng commented Apr 26, 2023

St-ZFeng commented Apr 26, 2023

kristian-lange commented Apr 27, 2023

kirstenstark commented May 2, 2023

kristian-lange commented May 3, 2023

kirstenstark commented May 4, 2023 • edited

St-ZFeng commented May 7, 2023

kristian-lange commented May 7, 2023

St-ZFeng commented May 8, 2023

St-ZFeng commented May 8, 2023

kristian-lange commented May 8, 2023

St-ZFeng commented May 8, 2023

St-ZFeng commented Aug 6, 2023 • edited

St-ZFeng commented Mar 20, 2023 •

edited

St-ZFeng commented Mar 21, 2023 •

edited

kristian-lange commented Mar 21, 2023 •

edited

St-ZFeng commented Apr 3, 2023 •

edited

kirstenstark commented May 4, 2023 •

edited

St-ZFeng commented Aug 6, 2023 •

edited