mirror of
https://github.com/ilri/csv-metadata-quality.git
synced 2024-11-22 22:05:03 +01:00
2.1 KiB
2.1 KiB
Changelog
All notable changes to this project will be documented in this file.
The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.
Unreleased
Added
- Unicode normalization (enable with
--unsafe-fixes
, see README.md)
Updated
- Update python dependencies to latest versions, including numpy 1.18.1, pandas 1.0.0rc0, flake8 3.7.9, pytest 5.3.2, and black 19.10b0
- Regenerate requirements.txt and requirements-dev.txt
Changed
- Use Python 3.8.0 for pipenv
- Use Ubuntu 18.04 "Bionic" for TravisCI builds
- Test Python 3.8 in TravisCI builds
[0.3.1] - 2019-10-01
Changed
- Replace non-breaking spaces (U+00A0) with space instead of removing them
- Harmonize language of script output when fixing various issues
[0.3.0] - 2019-09-26
Updated
- Update python dependencies to latest versions, including numpy 1.17.2, pandas 0.25.1, pytest 5.1.3, and requests-cache 0.5.2
Added
- csvkit to dev requirements (csvcut etc are useful during development)
- Experimental language validation using the Python
langid
library (enable with-e
, see README.md)
Changed
- Re-formatted code with black and isort
[0.2.2] - 2019-08-27
Changed
- Output of date checks to include column names (helps debugging in case there are multiple date fields)
Added
- Ability to exclude certain fields using
--exclude-fields
- Fix for missing space after a comma, ie "Orth,Alan S."
Improved
- AGROVOC lookup code
[0.2.1] - 2019-08-11
Added
- Check for uncommon filename extensions
- Replacement of unneccessary Unicode characters like soft hyphens (U+00AD)
[0.2.0] - 2019-08-09
Added
- Handle Ctrl-C interrupt gracefully
- Make output in suspicious character check more user friendly
- Add pytest-clarity to dev packages for more user friendly pytest output
[0.1.0] - 2019-08-01
Changed
- AGROVOC validation is now turned off by default
Added
- Ability to enable AGROVOC validation on a field-by-field basis using the
--agrovoc-fields
option - Option to print the version (
--version
or-V
)