alanorth/csv-metadata-quality
1
0
Fork 0
mirror of https://github.com/ilri/csv-metadata-quality.git synced 2024-11-22 05:45:02 +01:00
Code Releases Activity
A simple but opinionated metadata quality checker and fixer designed to work with CSVs in the DSpace ecosystem.
33 Commits 4 Branches 17 Tags 2 MiB
Python 100%
196bb434fa
Go to file
Alan Orth 196bb434fa
Add date validation 
I'm only concerned with validating issue dates here. In DSpace they
are generally always YYYY, YYY-MM, or YYYY-MM-DD (though in theory
they could be any valid ISO8601 format).

This also checks for cases where the date is missing and where the
metadata has specified multiple dates like "1990||1991", as this is
valid, but there is no practical value for it in our system.
2019-07-28 16:11:36 +03:00
csv_metadata_quality Add date validation 2019-07-28 16:11:36 +03:00
data Move tests.csv to data directory 2019-07-27 00:02:47 +03:00
tests Add date validation 2019-07-28 16:11:36 +03:00
.build.yml .build.yml: Fix setup script 2019-07-27 00:41:57 +03:00
LICENSE.txt Add GPLv3 license 2019-07-26 22:16:16 +03:00
Pipfile Add ipython to pipenv dev packages 2019-07-28 10:06:41 +03:00
Pipfile.lock Add ipython to pipenv dev packages 2019-07-28 10:06:41 +03:00
README.md README.md: Add todos 2019-07-27 19:24:35 +03:00
requirements-dev.txt Add requirements-dev.txt 2019-07-27 00:33:52 +03:00
requirements.txt Add requirements.txt 2019-07-26 23:54:07 +03:00

README.md

CSV Metadata Quality builds.sr.ht status

A simple but opinionated metadata quality checker and fixer designed to work with CSVs in the DSpace ecosystem. Supports multi-value fields using the standard DSpace value separator ("||").

Written and tested using Python 3.7.

Checks

Supports checking the validity of the following metadata elements:

  • ISSN
  • ISBN
  • Multi-value separators

Fixes

Supports fixing the following metadata issues:

  • Leading, trailing, and excessive whitespace

Todo

  • Reporting / summary
  • Real logging
  • Fix invalid multi-value separators? Check if there are any valid cases of "|" in the database
  • Date validation

License

This work is licensed under the GPLv3.

The license allows you to use and modify the work for personal and commercial purposes, but if you distribute the work you must provide users with a means to access the source code for the version you are distributing. Read more about the GPLv3 at TL;DR Legal.