alanorth/csv-metadata-quality
1
0
Fork 0
mirror of https://github.com/ilri/csv-metadata-quality.git synced 2024-11-22 05:45:02 +01:00
Code Releases Activity

csv_metadata_quality/util.py: update for ftfy 6.0

Browse Source 
The sequence_weirdness() heuristic is deprecated. Now we should use
is_bad().

See: https://ftfy.readthedocs.io/en/v6.0/heuristic.html
See: https://github.com/rspeer/python-ftfy/blob/master/CHANGELOG.md#version-60-april-2-2021
This commit is contained in:
Alan Orth 2021-12-15 21:58:07 +02:00
parent ff49a80432
commit e4faf114dc
Signed by: alanorth
GPG Key ID: 0FB860CC9C45B1B9
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
csv_metadata_quality/util.py
View File

@ -1,6 +1,6 @@
# SPDX-License-Identifier: GPL-3.0-only # SPDX-License-Identifier: GPL-3.0-only
from ftfy.badness import sequence_weirdness from ftfy.badness import is_bad
def is_nfc(field): def is_nfc(field):
@ -38,7 +38,7 @@ def is_mojibake(field):
Return boolean. Return boolean.
""" """
if not sequence_weirdness(field): if not is_bad(field):
# Nothing weird, should be okay # Nothing weird, should be okay
return False return False
try: try: