Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

librdf errors/tar warnings when downloading restricted resource from Zenodo (result ok) #70

Open
ablaette opened this issue Feb 26, 2024 · 1 comment

Comments

@ablaette
Copy link
Collaborator

tarball_tmp <- zenodo_get_tarball(url = gparlsample_url_restricted)
    if (is.null(tarball_tmp)) testthat::skip_on_cran()
    success <- corpus_install(tarball = tarball_tmp, ask = FALSE, load = FALSE)
    testthat::expect_true(success)

── Download restricted resource from Zenodo ───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
librdf error - HTML parser error: Tag header invalid
librdf error - HTML parser error: Tag nav invalid
librdf error - HTML parser error: Tag nav invalid
librdf error - HTML parser error: Opening and ending tag mismatch: header and div
librdf error - HTML parser error: Tag main invalid
librdf error - HTML parser error: Tag section invalid
librdf error - HTML parser error: Tag article invalid
librdf error - HTML parser error: Tag section invalid
librdf error - HTML parser error: Tag section invalid
librdf error - HTML parser error: Tag section invalid
librdf error - HTML parser error: Tag section invalid
librdf error - HTML parser error: Tag section invalid
librdf error - HTML parser error: Unexpected end tag : p
librdf error - HTML parser error: Tag section invalid
librdf error - HTML parser error: Tag section invalid
librdf error - HTML parser error: Tag section invalid
librdf error - HTML parser error: Tag aside invalid
librdf error - HTML parser error: Tag section invalid
librdf error - HTML parser error: Tag section invalid
librdf error - HTML parser error: Tag footer invalid
librdf error - HTML parser error: htmlParseEntityRef: no name
librdf error - HTML parser error: Element script embeds close tag
librdf error - HTML parser error: Element script embeds close tag
✔ get handle for restricted resource ... done
ℹ tarball to download: https://zenodo.org//records/6546810/files/germaparlsample_v0.1.1.tar.gz?download=1
[100%] Downloaded 1305613 bytes...
✔ checking whether md5 checksum meets expectation (81d6131ac55b36f40442b7e320e6f51e) ... done
── Get CWB directories ────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
ℹ registry directory: /tmp/Rtmp62LVFD/cwb_tmp/registry
ℹ data directory: /tmp/Rtmp62LVFD/cwb_tmp/indexed_corpora
── Install corpus ─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
/bin/tar: Ignoring unknown extended header keyword 'LIBARCHIVE.xattr.com.apple.quarantine'
✔ extract tarball ... done
── remove corpus GERMAPARLSAMPLE ──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
ℹ registry directory: /tmp/Rtmp62LVFD/cwb_tmp/registry
ℹ data directory: /tmp/Rtmp62LVFD/cwb_tmp/indexed_corpora/germaparlsample
✔ remove files in data directory [4ms]
✔ remove data directory [9ms]
✔ remove registry file [7ms]
✔ corpus GERMAPARLSAMPLE has been removed
✔ copy corpus data to target directory ... done
✔ parse registry file ... done
! no info file
✔ update registry data and save registry file ... done

@ablaette
Copy link
Collaborator Author

Returning to this issue: The HTML page is a mess and cannot be parsed without errors, because it is invaled (checked with xmllint). Catching the errors with capture.output() does not work. But we get the result we want/need. This issue is hard to solve unless we move from parsing XML/HTML to using plain and simple regular expressions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant