Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Experiment-Fedx-Fedbench-ls: query execution error #48

Open
chengsijin0817 opened this issue Dec 2, 2021 · 2 comments
Open

Experiment-Fedx-Fedbench-ls: query execution error #48

chengsijin0817 opened this issue Dec 2, 2021 · 2 comments

Comments

@chengsijin0817
Copy link

Hi, when I perform an experiment for FedX using the life-science dataset of FedBench, the evaluation completed successfully but query evaluation time and results are missing:
Query;run1;run2;run3;avg;numResults;minRes;maxRes; ls1; -2; -2; -2; -1; -1; -1; -1; ls2;-2;-2;-2;-1;-1;-1;-1; ls3;-2;-2;-2;-1;-1;-1;-1; ls4;-2;-2;-2;-1;-1;-1;-1; ls5;-2;-2;-2;-1;-1;-1;-1; ls6;-2;-2;-2;-1;-1;-1;-1; ls7;-2;-2;-2;-1;-1;-1;-1;
You can find the log and description for the Pod "fedx-ls-exp-evaluationjob" below:
log.txt
fedx_fedbench_ls_pod_describe.txt

Please feel free to let me know if I'm missing something.

@stasinos
Copy link
Member

stasinos commented Dec 7, 2021

@chengsijin0817 what seems to be happening is that Virtuoso has changed the format of the response it gives to ASK queries, and the FedX version we are bundling does not recognize it. Please try to checkout branch https://github.com/semagrow/kobe/tree/fix-fedx-template and see if that solves the problem.

@chengsijin0817
Copy link
Author

Hi @stasinos , I sincerely apologize for not realizing that you had already responded to this issue a long time ago.
When I did experiments with FedX last month, this issue was resolved, I believe the reason is that you had updated the Docker images for FedX at that time. Many thanks for your work. ;-)

In addition, I have a few follow-up questions:
-I am wondering if it is the latest version of FedX bundling? If not, may I know which version it is?
-Also, if I want to use KOBE with the latest version of FedX, is there a simple way to do so?
I would grateful for any advice:-)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants