614 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Alan Orth	a0ea829f5c	csv_metadata_quality/fix.py: Fixes should be green	2021-03-11 11:47:24 +02:00
Alan Orth	0089efa914	tests/test_check.py: Use dcterms.subject instead of dc.subject ... Trying to move some old DC fields to DCTERMS.	2021-03-11 11:45:25 +02:00
Alan Orth	3dbe656f9f	Update requirements ... Generated with poetry export: $ poetry export --without-hashes -f requirements.txt > requirements.txt $ poetry export --without-hashes --dev -f requirements.txt > requirements-dev.txt I am trying `--without-hashes` to work around an error on pip install when running in CI: ERROR: In --require-hashes mode, all requirements must have their versions pinned with ==.	2021-03-11 11:11:19 +02:00
Alan Orth	7ad821dcad	CHANGELOG.md: Add note about poetry dependencies	2021-03-11 11:10:27 +02:00
Alan Orth	cd876c4fb3	poetry.lock: Run poetry update	2021-03-11 11:10:02 +02:00
Alan Orth	d88ea56488	csv_metadata_quality/check.py: Move all imports to top of file ... PEP8 recommends keeping imports at the top of the file. Also, I had to re-work the issn/isbn so they didn't conflict with the functions in check.py (flake8 warned about them being redefined). Imports sorted with isort. See: https://www.python.org/dev/peps/pep-0008/#imports	2021-03-11 10:52:20 +02:00
Alan Orth	e0e3ca6c58	CHANGELOG.md: Add notes about DCTERMS in data/test.csv	2021-03-11 10:50:52 +02:00
Alan Orth	abae8ca4fb	data/test.csv: Move some DC fields to DCTERMS ... The original Dublin Core elements set was superceded by DCTERMS in 2008 and we have started using them in our DSpace repository so I think it's good to update them in our test data. Old DC fields are still checked and fixed in this tool, though. It's worth nothing that currently supported DSpace versions (4, 5, and 6) all have hard-coded a few fields like dc.title internally so we can't migrate those to their DCTERMS counterparts just yet.	2021-03-11 10:49:05 +02:00
Alan Orth	d7d4d4efca	CHANGELOG.md: Add note about SPDX license identifiers	2021-03-11 10:37:27 +02:00
Alan Orth	5318953150	tests/test_check.py: Add tests for licenses	2021-03-11 10:36:26 +02:00
Alan Orth	3b17914002	data/test.csv: Add invalid SPDX license ... Now we are checking dcterms.license against the list of SPDX license identifiers using https://pypi.org/project/spdx-license-list/.	2021-03-11 10:34:58 +02:00
Alan Orth	6e4b0e5c1b	Add validation of SPDX license identifiers ... Currently this only checks the dcterms.license field and the result will only be a warning.	2021-03-11 10:33:16 +02:00
Alan Orth	b16fa9121f	pyproject.toml: Add csv-metadata-quality as a script ... For some reason I stopped having csv-metadata-quality available in my poetry environment after install. It seems I need to add it as a poetry tool script? I had already done this in setup.py years ago, which works for regular python setup.py installs, but hadn't needed to do it in poetry for a year or more that I've been using it, until now.	2021-03-08 09:50:05 +02:00
Alan Orth	202bda862a	Bump version to 0.4.5	2021-03-04 21:38:10 +02:00
Alan Orth	7479310ac0	setup.py: Bump version to 0.4.4 ... I missed to increase this when I actually released version 0.4.4 so I will do it in a separate commit now before I bump the version to 0.4.5.	2021-03-04 21:35:08 +02:00
Alan Orth	98a91bc9c2	Update requirements ... Generated with poetry export: $ poetry export --without-hashes -f requirements.txt > requirements.txt $ poetry export --without-hashes --dev -f requirements.txt > requirements-dev.txt I am trying `--without-hashes` to work around an error on pip install when running in CI: ERROR: In --require-hashes mode, all requirements must have their versions pinned with ==.	2021-03-04 21:33:33 +02:00
Alan Orth	fc5bedcc5c	CHANGELOG.md: Add poetry update	2021-03-04 21:32:46 +02:00
Alan Orth	44d12d771a	poetry.lock: Run poetry update	2021-03-04 21:32:21 +02:00
Alan Orth	4a7000e975	README.md: Add more ideas to do	2021-03-04 21:26:53 +02:00
Alan Orth	27b2d81ca8	CHANGELOG.md: Add note about dcterms.issued	2021-02-28 15:14:39 +02:00
Alan Orth	91ebd0f606	README.md: Update TODOs ... A few of these date things have been addressed.	2021-02-28 15:13:36 +02:00
Alan Orth	dd2cfae047	csv_metadata_quality/app.py: Match dcterms.issued for dates ... We used to only check fields that had "date" in their name because we were using DSpace's default dc.date.* fields. Now we are using dcterms.issued so I will add that one as well.	2021-02-28 15:11:06 +02:00
Alan Orth	d76e72532a	Move unreleased changes to v0.4.4	2021-02-21 13:25:22 +02:00
Alan Orth	13980d2dde	CHANGELOG.md: Add note about colored output	2021-02-21 13:12:26 +02:00
Alan Orth	9aaaa62461	Update requirements ... Generated with poetry export: $ poetry export --without-hashes -f requirements.txt > requirements.txt $ poetry export --without-hashes --dev -f requirements.txt > requirements-dev.txt I am trying `--without-hashes` to work around an error on pip install when running in CI: ERROR: In --require-hashes mode, all requirements must have their versions pinned with ==.	2021-02-21 13:10:52 +02:00
Alan Orth	a7fc5a246c	Colorize output ... Messages will be colorized: - Red for errors - Yellow for warnings or information - Green for fixes	2021-02-21 13:01:25 +02:00
Alan Orth	7fb8acb866	Add colorama for colored output ... Red for errors, yellow for warnings or information, and green for fixes.	2021-02-21 13:00:31 +02:00
Alan Orth	9f5d2c2c4f	poetry.lock: Run poetry update	2021-02-15 15:13:12 +02:00
Alan Orth	202abf140c	CHANGELOG.md: Add note about poetry	2021-02-04 21:48:12 +02:00
Alan Orth	0cd6d3dfe6	Update requirements ... Generated with poetry export: $ poetry export --without-hashes -f requirements.txt > requirements.txt $ poetry export --without-hashes --dev -f requirements.txt > requirements-dev.txt I am trying `--without-hashes` to work around an error on pip install when running in CI: ERROR: In --require-hashes mode, all requirements must have their versions pinned with ==.	2021-02-04 21:46:49 +02:00
Alan Orth	a458beac55	poetry.lock: Run poetry update	2021-02-04 21:45:30 +02:00
Alan Orth	e62ecb0a8f	CHANGELOG.md: Add note about new date format	2021-02-04 21:43:44 +02:00
Alan Orth	de92f32ab6	csv_metadata_quality/check.py: More date formats ... We should also allow ISO 8601 extended in combined date and time format. DSpace does not have a problem with dates in this format and I have found some metadata that uses this date format. For example: 2020-08-31T11:04:56Z See: https://en.wikipedia.org/wiki/ISO_8601	2021-02-04 21:39:14 +02:00
Alan Orth	dbbbc0944a	README.md: Add handle to citation	2021-01-27 10:33:37 +02:00
Alan Orth	d17bf3033c	README.md: Add citation	2021-01-27 10:32:26 +02:00
Alan Orth	2ec52f1b73	README.md: Update description	2021-01-26 15:43:41 +02:00
Alan Orth	aa1abf15a7	README.md: Adjust title	2021-01-26 15:35:21 +02:00
Alan Orth	cbf94490f2	Version 0.4.3	2021-01-26 15:22:40 +02:00
Alan Orth	f3d0d5ef07	setup.py: Remove Python 3.6 ... I actually removed Python 3.6 support a few weeks ago after updating to Pandas 1.2.0, but forgot to update this.	2021-01-26 15:22:08 +02:00
Alan Orth	4b7b99c94c	CHANGELOG.md: Add note about multi-value separators	2021-01-26 15:20:22 +02:00
Alan Orth	df670e81b9	README.md: Use badge from my Drone CI ... I'm not using SourceHut anymore.	2021-01-26 14:38:50 +02:00
Alan Orth	ae357d8c6c	Revert "Update requirements" ... This reverts commit ca80340f7a. Nope, we still need the --without-hashes because this still fails on Python 3.7, but not 3.8 or 3.9. From looking around it seems that nobody can agree whether poetry should handle this, pip should handle it, or upstream projects should pin their dependencies.	2021-01-26 14:15:31 +02:00
Alan Orth	ca80340f7a	Update requirements ... Generated with poetry export: $ poetry export -f requirements.txt > requirements.txt $ poetry export --dev -f requirements.txt > requirements-dev.txt Trying to see if we no longer need --without-hashes since we don't support Python 3.6 anymore.	2021-01-26 11:46:05 +02:00
Alan Orth	cc1743b86d	Remove .build.yml ... I will just use GitHub Actions and Drone.	2021-01-26 11:41:30 +02:00
Alan Orth	bcb9885c6b	Update requirements ... Generated with poetry export: $ poetry export --without-hashes -f requirements.txt > requirements.txt $ poetry export --without-hashes --dev -f requirements.txt > requirements-dev.txt I am trying `--without-hashes` to work around an error on pip install when running on Python 3.6 in Travis: ERROR: In --require-hashes mode, all requirements must have their versions pinned with ==.	2021-01-26 10:36:48 +02:00
Alan Orth	b484b75178	poetry.lock: Run poetry update	2021-01-26 10:36:04 +02:00
Alan Orth	d3880a9dfa	Remove Python 3.6 support ... Pandas 1.2.0 apparently requires Python 3.7.1+.	2021-01-03 15:51:53 +02:00
Alan Orth	7edb8b19d7	tests/test_check.py: Reformat with black	2021-01-03 15:50:21 +02:00
Alan Orth	a6709c7f82	Update requirements ... Generated with poetry export: $ poetry export --without-hashes -f requirements.txt > requirements.txt $ poetry export --without-hashes --dev -f requirements.txt > requirements-dev.txt I am trying `--without-hashes` to work around an error on pip install when running on Python 3.6 in Travis: ERROR: In --require-hashes mode, all requirements must have their versions pinned with ==.	2021-01-03 15:42:00 +02:00
Alan Orth	d489ea4609	poetry.lock: Run poetry update	2021-01-03 15:41:08 +02:00