mirror of
https://github.com/ilri/csv-metadata-quality.git
synced 2025-05-08 14:16:00 +02:00
Add support for fixing "unnecessary" Unicode
These are things like non-breaking spaces, "replacement" characters, etc that add nothing to the metadata and often cause errors during parsing or displaying in a UI.
This commit is contained in:
@ -31,3 +31,11 @@ def test_fix_invalid_separators():
|
||||
value = 'Alan|Orth'
|
||||
|
||||
assert fix.separators(value) == 'Alan||Orth'
|
||||
|
||||
|
||||
def test_fix_unnecessary_unicode():
|
||||
'''Test fixing unnecessary Unicode.'''
|
||||
|
||||
value = 'Alan Orth'
|
||||
|
||||
assert fix.unnecessary_unicode(value) == 'Alan Orth'
|
||||
|
Reference in New Issue
Block a user