From e1b270cf83acbd5c8a893b05cd8360dd42aa3823 Mon Sep 17 00:00:00 2001 From: Alan Orth Date: Thu, 23 Dec 2021 12:47:42 +0200 Subject: [PATCH] CHANGELOG.md: add note about dropping invalid AGROVOC values --- CHANGELOG.md | 8 ++++++-- 1 file changed, 6 insertions(+), 2 deletions(-) diff --git a/CHANGELOG.md b/CHANGELOG.md index 11e193b..7f5a922 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -5,15 +5,19 @@ The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/), and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html). ## Unreleased -## Changed +### Changed - Perform fix for "unnecessary" Unicode characters after we try to fix encoding issues with ftfy - ftfy heuristics to use `is_bad()` instead of `sequence_weirdness()` - ftfy `fix_text()` to *not* change “smart quotes” to "ASCII quotes" -## Updated +### Updated - Python dependencies +### Added +- Ability to drop invalid AGROVOC values with `-d` when checking AGROVOC values +with `-a ` + ## [0.5.0] - 2021-12-08 ### Added - Ability to check for, and fix, "mojibake" characters using [ftfy](https://github.com/LuminosoInsight/python-ftfy)