alanorth/csv-metadata-quality
1
0
Fork 0
mirror of https://github.com/ilri/csv-metadata-quality.git synced 2024-11-18 20:17:04 +01:00
Code Releases Activity
A simple but opinionated metadata quality checker and fixer designed to work with CSVs in the DSpace ecosystem.
49 Commits 4 Branches 17 Tags 2 MiB
Python 100%
a8a41d60b6
Go to file
Alan Orth a8a41d60b6
README.md: Add note about Pandas
2019-07-29 10:56:02 +03:00
csv_metadata_quality Add "unsafe fixes" runtime option 2019-07-28 22:53:39 +03:00
data Add "unsafe fixes" runtime option 2019-07-28 22:53:39 +03:00
tests Add "unsafe fixes" runtime option 2019-07-28 22:53:39 +03:00
.build.yml .build.yml: Fix setup script 2019-07-27 00:41:57 +03:00
.flake8 Add flake8 to pipenv dev environment 2019-07-28 17:46:30 +03:00
LICENSE.txt Add GPLv3 license 2019-07-26 22:16:16 +03:00
Pipfile Add flake8 to pipenv dev environment 2019-07-28 17:46:30 +03:00
Pipfile.lock Add flake8 to pipenv dev environment 2019-07-28 17:46:30 +03:00
README.md README.md: Add note about Pandas 2019-07-29 10:56:02 +03:00
requirements-dev.txt Update python requirements 2019-07-28 17:12:20 +03:00
requirements.txt Update python requirements 2019-07-28 17:12:20 +03:00

README.md

CSV Metadata Quality builds.sr.ht status

A simple but opinionated metadata quality checker and fixer designed to work with CSVs in the DSpace ecosystem. Supports multi-value fields using the standard DSpace value separator ("||"). Despite the name it does support reading Excel files.

Written and tested using Python 3.7. CSV and Excel support comes from the Pandas library.

Checks

Supports checking the validity of the following metadata elements:

  • ISSN
  • ISBN
  • Multi-value separators ("||")
  • Dates

Fixes

Supports fixing the following metadata issues:

  • Leading, trailing, and excessive whitespace
  • Invalid multi-value separators ("|") using --unsafe-fixes

Todo

  • Reporting / summary
  • Real logging

License

This work is licensed under the GPLv3.

The license allows you to use and modify the work for personal and commercial purposes, but if you distribute the work you must provide users with a means to access the source code for the version you are distributing. Read more about the GPLv3 at TL;DR Legal.