mirror of
https://github.com/ilri/csv-metadata-quality.git
synced 2024-11-22 05:45:02 +01:00
A simple but opinionated metadata quality checker and fixer designed to work with CSVs in the DSpace ecosystem.
Alan Orth
40e77db713
In this case it fixes occurences of invalid multi-value separators. DSpace uses "||" to separate multiple values in one field, but our editors sometimes give us files with mistakes like "|". We can fix these to be correct multi-value separators if we are sure that the metadata is not actually using "|" for some legitimate purpose. |
||
|---|---|---|
| csv_metadata_quality | ||
| data | ||
| tests | ||
| .build.yml | ||
| .flake8 | ||
| LICENSE.txt | ||
| Pipfile | ||
| Pipfile.lock | ||
| README.md | ||
| requirements-dev.txt | ||
| requirements.txt | ||
CSV Metadata Quality 
A simple but opinionated metadata quality checker and fixer designed to work with CSVs in the DSpace ecosystem. Supports multi-value fields using the standard DSpace value separator ("||"). Despite the name it does support reading Excel files.
Written and tested using Python 3.7.
Checks
Supports checking the validity of the following metadata elements:
- ISSN
- ISBN
- Multi-value separators
- Dates
Fixes
Supports fixing the following metadata issues:
- Leading, trailing, and excessive whitespace
Todo
- Reporting / summary
- Real logging
- Fix invalid multi-value separators? Check if there are any valid cases of "|" in the database
License
This work is licensed under the GPLv3.
The license allows you to use and modify the work for personal and commercial purposes, but if you distribute the work you must provide users with a means to access the source code for the version you are distributing. Read more about the GPLv3 at TL;DR Legal.