QuLIO-XR

This is the repository of the Python (3.7+) implementation of QuLIO-XR (Querying LInguistic Ontologies with eXpressive Response), which integrates instances of the foundational ontology LODO with Large Language Models. The LODO foundational ontology was presented as short paper in Workshop on Agents (WOA 2021) held in Bologna in June 2021. A full paper of the work is also available in Intelligenza Artificiale.

Installation

---

This repository has been tested on Python 3.7.3 64bit (Windows 10/PopOs linux), with the following packages versions:

• Phidias (release 1.3.4.alpha)
• spaCy (ver. 2.2.4)
• Natural Language Toolkit (ver. 3.5)
• Owlready2 (ver. 0.26)
• transformers (ver. 4.34.0)
• peft (ver. 4.0)
• sentencepiece (ver. 0.1.99)
• datasets (ver. 2.13.0)
• accelerate (ver. 0.23.0)
• bitsandbytes (ver. 0.41.1)
• trl (ver. 0.4.7)
• safetensors (ver. 0.3.1)
• scipy (latest)

Phidias

---

> git clone https://github.com/corradosantoro/phidias
> cd phidias
> pip install -r requirements.txt
> pip install .

spaCy

---

> pip install spacy
> python -m spacy download en_core_web_trf

Natural Language Toolkit

---

from prompt:

> pip install nltk

from python console:

> import nltk
> nltk.download('wordnet')

Owlready2

---

from prompt:

> pip install owlready2

rdflib

---

from prompt:

> pip install rdflib

Pytorch

Follow the instructions reported here for the current system.

Llama 2

• Download Llama-2-7b-chat-hf (or 70b) from huggingface and copy it in a local folder (BASE_MODEL in [LLM] Section of config.ini). The other two adapters path must be set as well (ADAPTER_PATH1 and ADAPTER_PATH2 in [LLM] Section of config.ini). Both adapters finetuning's code is in the folder "finetuning" of this repository.

QLoRA

> pip install transformers==4.34.0
> pip install peft==0.4.0
> pip install sentencepiece==0.1.99
> pip install datasets==2.13.0
> pip install accelerate==0.23.0
> pip install bitsandbytes==0.41.1
> pip install trl==0.4.7
> pip install safetensors>=0.3.1
> pip install scipy

Huggingface hub (optional)

> pip install huggingface_hub

Setting interaction configuration

In section [LLM] of config.ini, the parameter MODE must be set as follows:

• KG (OWL inference with OWL-to-NL response)
• LLM (only Query/Answer LLM)
• DUAL (KG+LLM)

Starting agent

---

First of all, you must create the ontology. In order to do that, you must follow three preliminar steps:

• Choose the owl file name, by setting the variable FILE_NAME (within AGENT) in the config.ini (test.owl for instance)
• Execute qulio-xr.py

Creating new test.owl file...

Please Re-Run QuLIO-XR.

Process finished with exit code 0

• Re-execute QuLIO-XR

Loading existing test.owl file...

NLP engine initializing. Please wait...

	PHIDIAS Release 1.3.4.alpha (deepcopy-->clone,micropython,py3)
	Autonomous and Robotic Systems Laboratory
	Department of Mathematics and Informatics
	University of Catania, Italy (santoro@dmi.unict.it)
	
eShell: main > 

Now QuLIO-XR is ready. Unless you delete the owl file or choose to create another ontology, the agent will try to load every time the file specified in confi.ini.

Ontology Learning

---

After having started QuLIO-XR agent, to feed KGs with sentence you must assert the belief FEED as follows:

eShell: main > +FEED("sentence")

For instance, considering the following sentences:

• Colonel West is American
• Cuba is a hostile nation
• missiles are weapons
• Colonel West sells missiles to Cuba
• When an American sells weapons to a hostile nation, that American is a criminal

QuLIO-XR will model the ontology in order to infer the further natural language assertion:

• Colonel West is a criminal

To let the agent model the ontology on this basis, you must execute the following lines:

eShell: main > +FEED("Colonel West is American")
eShell: main > +FEED("Cuba is a hostile nation")
eShell: main > +FEED("missiles are weapons")
eShell: main > +FEED("Colonel West sells missiles to Cuba")
eShell: main > +FEED("When an American sells weapons to a hostile nation, that American is a criminal")

Here is all taxonomic relations (by opening the ontology file with Protege) after the such assertions:

Here is all individuals. The number related to each sentence will always be different depending on the timestamp:

Here is all non-taxonomic relations related to the individual "Be.426837":

Here's all axioms:

Reasoning (Protegè)

---

Thanks to all relations and axioms, we can make reasoning (Hermit/Pellet) and infer the following further relations referred to the individual "Colonel_West.791305":

Considering also the following small knowledge base, in order to test also Value Giver Statements properties and Values Comparison Conditionals axioms:

eShell: main > +FEED("Robinson Crusoe is a patient")
eShell: main > +FEED("Robinson Crusoe has diastolic blood pressure equal to 150")
eShell: main > +FEED("When a patient has diastolic blood pressure greater than 140, the patient is hypertensive")

Here's ontology details like seen previously:

In such a case, by invoking the reasoner (Hermit/Pellet) will infer that Robinson Crusoe belong also to the class Hypertensive.

Reasoning (shell)

-----> to be added soon!

Reasoning (RESTful)

-----> to be added soon!

Known issues

It is well-known that natural language can be ambiguous, subject to interpretation about the semantic role of each lexical parts. For such a reason out-of-common sense utterance might lead to unexpected triples, due to the dataset the dependency parser has been trained on. Still, as reported here, the model used for dependency parsing has an accuracy of 0.95, which means that some missful/wrong dependecy classification is expected, especially for longer sentences. Beyond that, the following are known issues related to the code in this repository:

• Anaphora resolution/coreferentiators are not included in this code. So it is recommended to not use sentence containing pronoms, otherwise translation from natural language in OWL 2 won't be successful. For this purpose, the integration of tools such as neuralcoref is recommended. Coders might include such a tool in their own fork of this repository.
• Sentence containing singles quotation marks (') are still not well managed. So, it is recommended to not use it, and, in such a case, to rephrase utterances differently.
• Occasional crashes during parsing of text may occur, especially during conversion from natural language to OWL 2. In this case, rephrasing/reducing utterances is recommended.
• IMPORTANT: all production rules are designed starting from a toy domain. Practical use involves a global review of all parsing rules and modules.