alanorth/csv-metadata-quality
1
0
Fork 0
mirror of https://github.com/ilri/csv-metadata-quality.git synced 2024-11-04 21:43:00 +01:00
Code Releases Activity
ccc2a73456
csv-metadata-quality/pyproject.toml

40 lines
1.0 KiB
TOML
Raw Normal View History

Add poetry project file and lock I want to try to use poetry instead of pipenv because pipenv takes forever to do dependency resolution sometimes. Also, I have had a few issues with Python modules like black that don't have releases other than pre-releases, and even including the project itself in the dependencies (pip install -e . ...?). My initial experience is that poetry handles this better.
2020-05-31 16:31:36 +02:00
[tool.poetry]
name = "csv-metadata-quality"
Bump version to 0.4.8-dev
2021-03-19 10:53:56 +01:00
version = "0.4.8-dev"
Add poetry project file and lock I want to try to use poetry instead of pipenv because pipenv takes forever to do dependency resolution sometimes. Also, I have had a few issues with Python modules like black that don't have releases other than pre-releases, and even including the project itself in the dependencies (pip install -e . ...?). My initial experience is that poetry handles this better.
2020-05-31 16:31:36 +02:00
description="A simple, but opinionated CSV quality checking and fixing pipeline for CSVs in the DSpace ecosystem."
authors = ["Alan Orth <alan.orth@gmail.com>"]
pyproject.toml: Update license specifier We need to use valid SPDX license identifiers.
2020-06-09 13:22:53 +02:00
license="GPL-3.0-only"
Add poetry project file and lock I want to try to use poetry instead of pipenv because pipenv takes forever to do dependency resolution sometimes. Also, I have had a few issues with Python modules like black that don't have releases other than pre-releases, and even including the project itself in the dependencies (pip install -e . ...?). My initial experience is that poetry handles this better.
2020-05-31 16:31:36 +02:00
repository = "https://github.com/ilri/csv-metadata-quality"
homepage = "https://github.com/ilri/csv-metadata-quality"
pyproject.toml: Add csv-metadata-quality as a script For some reason I stopped having csv-metadata-quality available in my poetry environment after install. It seems I need to add it as a poetry tool script? I had already done this in setup.py years ago, which works for regular python setup.py installs, but hadn't needed to do it in poetry for a year or more that I've been using it, until now.
2021-03-08 08:49:43 +01:00
[tool.poetry.scripts]
csv-metadata-quality = 'csv_metadata_quality.__main__:main'
Add poetry project file and lock I want to try to use poetry instead of pipenv because pipenv takes forever to do dependency resolution sometimes. Also, I have had a few issues with Python modules like black that don't have releases other than pre-releases, and even including the project itself in the dependencies (pip install -e . ...?). My initial experience is that poetry handles this better.
2020-05-31 16:31:36 +02:00
[tool.poetry.dependencies]
pyproject.toml: Minimum Python is technically 3.7.1 See: https://pandas.pydata.org/pandas-docs/stable/whatsnew/v1.2.0.html
2021-03-11 12:41:58 +01:00
python = "^3.7.1"
Add poetry project file and lock I want to try to use poetry instead of pipenv because pipenv takes forever to do dependency resolution sometimes. Also, I have had a few issues with Python modules like black that don't have releases other than pre-releases, and even including the project itself in the dependencies (pip install -e . ...?). My initial experience is that poetry handles this better.
2020-05-31 16:31:36 +02:00
pandas = "^1.0.4"
python-stdnum = "^1.13"
xlrd = "^1.2.0"
requests = "^2.23.0"
Update requests-cache Apparently we were stuck on an older version of requests-cache due to the fact that we were using the caret, which will never update the left-most (major) version. Upstream requests-cache is currently version 0.6.4, and there seems to have been some changes to the API.
2021-07-06 14:24:39 +02:00
requests-cache = "~0.6.4"
Add poetry project file and lock I want to try to use poetry instead of pipenv because pipenv takes forever to do dependency resolution sometimes. Also, I have had a few issues with Python modules like black that don't have releases other than pre-releases, and even including the project itself in the dependencies (pip install -e . ...?). My initial experience is that poetry handles this better.
2020-05-31 16:31:36 +02:00
pycountry = "^19.8.18"
langid = "^1.1.6"
Add colorama for colored output Red for errors, yellow for warnings or information, and green for fixes.
2021-02-21 12:00:31 +01:00
colorama = "^0.4.4"
Add validation of SPDX license identifiers Currently this only checks the dcterms.license field and the result will only be a warning.
2021-03-11 09:33:16 +01:00
spdx-license-list = "^0.5.2"
Add checks and unsafe fixes for mojibake This detects whether text has likely been encoded in one encoding and decoded in another, perhaps multiple times. This often results in display of "mojibake" characters. For example, a file encoded in UTF-8 is opened as CP-1252 (Windows Latin codepage) in Microsoft Excel, and saved again as UTF-8. You will see strings like this in the resulting file: - CIAT Publicaçao - CIAT Publicación The correct version of these in UTF-8 would be: - CIAT Publicaçao - CIAT Publicación I use a code snippet from Martijn Pieters on StackOverflow to de- tect whether a string is "weird" as determined by the excellent "fixes text for you" (ftfy) Python library, then check if a weird string encodes as CP-1252 or not. If so, I can try to fix it. See: https://stackoverflow.com/questions/29071995/identify-garbage-unicode-string-using-python
2021-03-19 09:22:21 +01:00
ftfy = "^5.9"
pyproject.toml: limit SQLAlchemy to < 1.4.23 SQLAlchemy gets pulled in by csvkit's agate-sql dependency and there is currently an issue with Poetry's parsing of the SQLAlchemy 1.4.23 constraints. Temporarily explicitly install a version of SQLAlchemy that works (can remove later once Poetry fixes this). Anyways, I am not using any SQLAlchemy features that I know of. See: https://github.com/python-poetry/poetry/issues/4402
2021-09-06 20:01:09 +02:00
SQLAlchemy = ">=1.3.3,<1.4.23"
Add check for countries without matching regions If we have country "Kenya" we should have region "Eastern Africa" according to the UN M.49 geolocation scheme.
2021-12-08 14:02:20 +01:00
country-converter = "^0.7.4"
Add poetry project file and lock I want to try to use poetry instead of pipenv because pipenv takes forever to do dependency resolution sometimes. Also, I have had a few issues with Python modules like black that don't have releases other than pre-releases, and even including the project itself in the dependencies (pip install -e . ...?). My initial experience is that poetry handles this better.
2020-05-31 16:31:36 +02:00
[tool.poetry.dev-dependencies]
Update poetry package dependencies
2020-10-06 16:20:16 +02:00
pytest = "^6.1.1"
Only install ipython on Python 3.7+
2020-10-06 16:48:16 +02:00
ipython = { version = "^7.18.1", python = "^3.7" }
Update poetry package dependencies
2020-10-06 16:20:16 +02:00
flake8 = "^3.8.4"
pyproject.toml: Update pytest-clarity and black These seem to have much newer versions that didn't get updated in this project due to the version pinning selector I was using with poetry. In the case of pytest-clarity the previous version was 0.3.1 and the version selector was a caret (^), which will never update the left-most (major) number. Now they seem to be on 1.x.x so it will be OK in the future. In the case of black, they use weird numbering so it's anyone's guess how this will work! Luckily it's only used for linting and formatting.
2021-07-06 14:30:41 +02:00
pytest-clarity = "^1.0.1"
black = "^21.6b0"
Update poetry package dependencies
2020-10-06 16:20:16 +02:00
isort = "^5.5.4"
Add poetry project file and lock I want to try to use poetry instead of pipenv because pipenv takes forever to do dependency resolution sometimes. Also, I have had a few issues with Python modules like black that don't have releases other than pre-releases, and even including the project itself in the dependencies (pip install -e . ...?). My initial experience is that poetry handles this better.
2020-05-31 16:31:36 +02:00
csvkit = "^1.0.5"
[build-system]
requires = ["poetry>=0.12"]
build-backend = "poetry.masonry.api"
Copy Permalink