1
0
mirror of https://github.com/ilri/csv-metadata-quality.git synced 2024-12-23 20:44:29 +01:00
csv-metadata-quality/data
Alan Orth 8435ee242d
Experimental language detection using langid
Works decenty well assuming the title, abstract, and citation fields
are an accurate representation of the language as identified by the
language field. Handles ISO 639-1 (alpha 2) and ISO 639-3 (alpha 3)
values seamlessly.

This includes updated pipenv environment, test data, pytest tests
for both correct and incorrect ISO 639-1 and ISO 639-3 languages,
and a new command line option "-e".
2019-09-26 13:46:32 +03:00
..
test.csv Experimental language detection using langid 2019-09-26 13:46:32 +03:00
test.xlsx Add Excel verion of test file 2019-07-28 17:07:33 +03:00