Skip to content

Experimental implementation of a CaveXML standard to facilitate exchange of data about caves through the definition and implementation of a data interchange format.

License

Notifications You must be signed in to change notification settings

nschorgh/CaveXML

Repository files navigation

README

CaveXML is a data interchange format for the purpose of facilitating scientific research on caves. This repository provides: CaveXML element and data type definitions, an example database, and tools to work with CaveXML-formatted data.

The most important files:
cavexml.md (explains the CaveXML standard)
cavexml.xsd (XML Schema Definition of CaveXML)
allcaves-database.xml (Master version of the database in native format)
Derivatives/allcaves-database.csv (csv version of the database generated from the XML version)
Utilities/cavexml.py (Python functions for CaveXML)

Auxiliary files:
cavexml-db-table.css (minimalist Style Sheet so the XML database can be viewed in a webbrowser)
Derivatives/allcaves-database.md (Full records in Markdown format, generated from the XML version)
Derivatives/allcaves-database.rdf (XML/RDF version of database for KarstLink)
Derivatives/list-of-ice-caves.md (list of caves with permanent ice)
Derivatives/list-of-lava-tubes.md (list of volcanic caves)
Derivatives/list-of-longest-lava-tubes.md (list of lava tubes longer than 1km)
Derivatives/metadata.rdf (a file used by the RDF ontology)
Utilities/cavexml2csv.py (converts database to comma-separated-values using Python)
Utilities/cavexml2html.py (outputs full records in HTML format)
Utilities/cavexml2kml.py (converts coordinates into KML format)
Utilities/cavexml2md.py (creates filtered list of entries in Markdown format)
Utilities/cavexml2md-full.py (creates allcaves-database.md)
Utilities/CaveXML2rdf.xquery (converts database to RDF/XML using XQuery)
Utilities/CaveXML2rdf.py (converts database to RDF/XML using Python)
Utilities/cavexml-warnings.py (issues informative warnings)
Utilities/cavesystemfinder.py (connects cave branches with cave systems)
Utilities/filter.xquery (creates simple filtered list of entries using XQuery)
Utilities/reorder.xslt (sorts elements within each record)
Utilities/stats.py (extracts statistical information about a database)

This is a pilot project to explore the capabilities of a CaveXML implementation end-to-end. The actual database is for demonstration, and mainly contains ice caves and lava tubes.

Notes

cavexml.md describes the meaning of the XML elements used to organize the data, and restrictions for the entries.

For non-programmers:
The file allcaves-database.csv can be opened as a spreadsheet and contains a flattened version of the database. The Derivatives/ directory also contains other derived data products, such as allcaves-database.md where the full records can be viewed directly on GitHub. A search interface is available at https://tinyurl.com/cavexmlsearch and hosted on Google Colaboratory. It requires a Google account and a warning message will appear at the beginning of each session.

For programmers:
The Python programs in the Utilities/ directory serve as examples for how a CaveXML database can be loaded and analyzed within Python. Parsing functions for quasi-numerical entries are found in cavexml.py, which also contains many other functions useful for working with CaveXML data. The same directory also includes a few xquery scripts as an alternative to Python.

For data creators:
The XML schema definition cavexml.xsd incorporates all CaveXML requirements. The following validates a database against the Schema:

xmllint --schema cavexml.xsd allcaves-database.xml -noout  

Alternatively, various online tools can be used to validate an XML database against an XSD document. If you create a public CaveXML-formatted database, I would be happy to link to it and include it in the search path.Vice versa, programmers can write tools to search multiple databases.

Acknowledgments

Thanks to Jean-Marc Vanel for help with XML and XQuery - March 2021

About

Experimental implementation of a CaveXML standard to facilitate exchange of data about caves through the definition and implementation of a data interchange format.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published