alanorth/csv-metadata-quality
1
0
Fork 0
mirror of https://github.com/ilri/csv-metadata-quality.git synced 2025-06-06 09:08:40 +02:00
Code Releases Activity

csv_metadata_quality/app.py: disable whitespace on abstracts

Browse Source 
It's too aggressive on abstracts. If people paste in text from a
PDF there are often newlines, and most of the time this is what
they want.
This commit is contained in:
Alan Orth
2023-02-07 16:48:40 +03:00
parent d5afbad788
commit 545bb8cd0c
1 changed files with 7 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
csv_metadata_quality/app.py
View File

@ -90,11 +90,13 @@ def run(argv):
continue
if args.unsafe_fixes:
match = re.match(r"^.*?abstract.*$", column)
if match is None:
# Fix: whitespace
df[column] = df[column].apply(fix.whitespace, field_name=column)
# Fix: newlines
if args.unsafe_fixes:
df[column] = df[column].apply(fix.newlines, field_name=column)
# Fix: missing space after comma. Only run on author and citation