Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Resultset size in Virtuoso template #51

Open
antru6 opened this issue Feb 25, 2022 · 8 comments · May be fixed by #52
Open

Resultset size in Virtuoso template #51

antru6 opened this issue Feb 25, 2022 · 8 comments · May be fixed by #52
Assignees
Labels

Comments

@antru6
Copy link
Collaborator

antru6 commented Feb 25, 2022

The result size of a request seems to be limited to 10,000 when utilizing the Virtuoso server.
If that's the case, is it possible to remove the default limit or increase the limit?

Issue identified by @chengsijin0817

@antru6
Copy link
Collaborator Author

antru6 commented Feb 25, 2022

Virtuoso has some specific entries in its configuration (namely virtuoso.ini file).
I believe that this parameter is the ResultSetMaxRows parameter, currently set in -1.
It seems that -1 does not mean "unlimited" but it refers to a 10,000 limit.
Can you provide us with a dump file and a query to try to reproduce this?

@gmouchakis
Copy link
Member

According to http://docs.openlinksw.com/virtuoso/dbadm/#ini_SPARQL

ResultSetMaxRows = number . This setting is used to limit the number of the rows in the result. The effective limit will be the lowest of this setting, SPARQL query 'LIMIT' clause value (if present), and SPARQL Endpoint request URI &maxrows parameter value (if present).

I think you should remove the ResultSetMaxRows parameter for unlimited results.

@antru6 antru6 self-assigned this Feb 25, 2022
@chengsijin0817
Copy link

Thank you both for your speedy responses. ;-)
I will remove the ResultSetMaxRows parameter first and see if it helps.

@antru6
Copy link
Collaborator Author

antru6 commented Feb 26, 2022

I have updated the docker image that initializes Virtuoso. Now the ResultSetMaxRows parameter is removed.
Please, give it a try and tell us if it works.

@chengsijin0817
Copy link

Please accept my apologies for the delay in responding. I've just found some time to test it.
Unfortunately, removing the ResultSetMaxRows parameter appears to not change the limit on the number of results. The number of rows in the result. is still 10000. :-(

@antru6
Copy link
Collaborator Author

antru6 commented Mar 3, 2022

I suspect that since KOBE uses a cache to speed up endpoint deployment, your installation maybe keeps the old virtuoso configuration in the cache. I suggest to try the following steps and tell us if the problem persists.

First, delete everything (dataset servers, benchmarks, etc.)

kubectl delete experiments.kobe.semagrow.org --all
kubectl delete benchmarks.kobe.semagrow.org --all
kubectl delete federatortemplates.kobe.semagrow.org --all
kubectl delete datasettemplates.kobe.semagrow.org  --all

Then, delete also the cache

kubectl delete pod kobenfs

And finally, re-deploy your KOBE specifications as previously.

@antru6 antru6 added the bug label Mar 3, 2022
@chengsijin0817
Copy link

Hi @antru6 , that's it! The issue has now been resolved by using the updated docker images for Virtuoso.
Thanks a lot for your help.

@antru6 antru6 linked a pull request Mar 8, 2022 that will close this issue
@antru6
Copy link
Collaborator Author

antru6 commented Mar 8, 2022

Thanks again @chengsijin0817 for identifying this issue and for the tests you have done for us!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants