csv-metadata-quality/Pipfile

[[source]]
name = "pypi"
url = "https://pypi.org/simple"
verify_ssl = true

[dev-packages]
pytest = "*"
ipython = "*"
flake8 = "*"
pytest-clarity = "*"
black = "*"
isort = "*"
csvkit = "*"

[packages]
pandas = "*"
python-stdnum = "*"
xlrd = "*"
requests = "*"
requests-cache = "*"
pycountry = "*"
csv-metadata-quality = {editable = true,path = "."}
langid = "*"

[requires]
python_version = "3.8"

[pipenv]
allow_prereleases = true
Initial commit Pipenv environment with Pandas. 2019-07-26 16:54:01 +02:00			`[[source]]`
			`name = "pypi"`
			`url = "https://pypi.org/simple"`
			`verify_ssl = true`

			`[dev-packages]`
Add pytest to pipenv dev environment 2019-07-26 23:32:53 +02:00			`pytest = "*"`
Add ipython to pipenv dev packages 2019-07-28 09:06:41 +02:00			`ipython = "*"`
Add flake8 to pipenv dev environment To help check PEP8 formatting/style compliance. 2019-07-28 16:46:30 +02:00			`flake8 = "*"`
Pipfile: Add pytest-clarity to dev packages This helps you understand the cryptic assertion error output from pytest. For some reason pytest-clarity is a pre-release package so we need to install it in pipenv with --pre. 2019-08-09 00:30:37 +02:00			`pytest-clarity = "*"`
Add black and isort to pipenv dev dependencies These do a very opinionated automatic formatting and validation of code. See: https://sourcery.ai/blog/python-best-practices/ 2019-08-29 00:08:38 +02:00			`black = "*"`
			`isort = "*"`
Pipfile: Add csvkit to dev requirements Used to inspect CSV files during testing and development. 2019-09-24 17:48:01 +02:00			`csvkit = "*"`
Initial commit Pipenv environment with Pandas. 2019-07-26 16:54:01 +02:00
			`[packages]`
			`pandas = "*"`
Add ISSN and ISBN checks using python-stdnum 2019-07-26 22:14:10 +02:00			`python-stdnum = "*"`
Add xlrd to pipenv for Pandas read_excel support 2019-07-28 16:05:17 +02:00			`xlrd = "*"`
Add support for validating subjects against AGROVOC Checks values in the dc.subject or dcterms.subject field against the AGROVOC REST API hosted by FAO. Code borrowed from agrovoc-lookup.py. See: http://agrovoc.uniroma2.it/agrovoc/agrovoc/en/ See: https://github.com/ilri/DSpace/blob/5_x-prod/agrovoc-lookup.py 2019-07-29 23:30:31 +02:00			`requests = "*"`
			`requests-cache = "*"`
Use pycountry instead of iso-639 for languages The latter is a fork that hasn't been updated since 2016 and the original still seems to be well maintained, with recent database updates as well as tests for Python 3.7. Also, pycountry supports ISO 3166-2 (administrative zones), which we could eventually use for sub regions. 2019-07-30 15:39:26 +02:00			`pycountry = "*"`
pipenv install -e . 2019-08-02 09:58:21 +02:00			`csv-metadata-quality = {editable = true,path = "."}`
Experimental language detection using langid Works decenty well assuming the title, abstract, and citation fields are an accurate representation of the language as identified by the language field. Handles ISO 639-1 (alpha 2) and ISO 639-3 (alpha 3) values seamlessly. This includes updated pipenv environment, test data, pytest tests for both correct and incorrect ISO 639-1 and ISO 639-3 languages, and a new command line option "-e". 2019-09-24 17:55:05 +02:00			`langid = "*"`
Initial commit Pipenv environment with Pandas. 2019-07-26 16:54:01 +02:00
			`[requires]`
Use Python 3.8 for pipenv Python 3.8.0 entered Arch Linux core repositories now and all tests pass with Python 3.8.0 so it's time... 2019-11-14 22:10:20 +01:00			`python_version = "3.8"`
Pipfile: Add pytest-clarity to dev packages This helps you understand the cryptic assertion error output from pytest. For some reason pytest-clarity is a pre-release package so we need to install it in pipenv with --pre. 2019-08-09 00:30:37 +02:00
			`[pipenv]`
			`allow_prereleases = true`