README.md: Add note about removing duplicate values

This commit is contained in:
Alan Orth 2019-07-29 18:09:48 +03:00
parent 1e444cf040
commit 8c34c2d6e6
Signed by: alanorth
GPG Key ID: 0FB860CC9C45B1B9
1 changed files with 1 additions and 0 deletions

View File

@ -12,6 +12,7 @@ Requires Python 3.6 or greater. CSV and Excel support comes from the [Pandas](ht
- Fix invalid multi-value separators ("|") using `--unsafe-fixes`
- Remove unnecessary Unicode like [non-breaking spaces](https://en.wikipedia.org/wiki/Non-breaking_space), [replacement characters](https://en.wikipedia.org/wiki/Specials_(Unicode_block)#Replacement_character), etc ✓
- Check for "suspicious" characters that could indicate encoding or copy/paste issues, for example "foreˆt" should be "forêt" ✓
- Remove duplicate metadata values ✓
## Installation
The easiest way to install CSV Metadata Quality is with [pipenv](https://github.com/pypa/pipenv):