Commit Graph

155 Commits

Author SHA1 Message Date
Alan Orth f5835d6391
Bootstrap v5.0.1
Also update devDependencies and bootstrap.scss.
2021-05-25 21:07:34 +03:00
Alan Orth 2a60888705
Add static/css/style.min.css 2021-05-25 21:03:41 +03:00
Alan Orth 266e3c7373
package-lock.json: Run npm update
continuous-integration/drone/push Build is passing Details
2021-04-14 16:57:29 +03:00
Alan Orth 0a601ab335
Regenerate requirements
Generated using poetry:

  $ poetry export --without-hashes -f requirements.txt > requirements.txt
  $ poetry export --without-hashes --dev -f requirements.txt > requirements-dev.txt
2021-04-14 16:56:51 +03:00
Alan Orth 23f4359913
poetry.lock: Run poetry update 2021-04-14 16:56:17 +03:00
Alan Orth 8bb90ed6b1
pyproject.toml: Update csv-metadata-quality version
Fixes some issues with Python deps.
2021-04-14 16:56:01 +03:00
Alan Orth 6466287b0f
source/scss/bootstrap.scss: Update comment
continuous-integration/drone/push Build is passing Details
Bootstrap is now 5.0.0-beta3
2021-04-02 16:17:48 +03:00
Alan Orth d5f100fe42
package-lock.json: Run npm update 2021-04-02 16:17:23 +03:00
Alan Orth 4352831b43
poetry.lock: Run poetry update 2021-04-02 16:17:06 +03:00
Alan Orth 4bae262a97
Regenerate requirements
continuous-integration/drone/push Build is passing Details
Generated using poetry:

  $ poetry export --without-hashes -f requirements.txt > requirements.txt
  $ poetry export --without-hashes --dev -f requirements.txt > requirements-dev.txt
2021-03-19 12:00:09 +02:00
Alan Orth c5138f8065
Update csv-metadata-quality version for Mojibake support 2021-03-19 11:59:21 +02:00
Alan Orth 36a072b1fd
pyproject.toml: Bump version to 0.0.2
continuous-integration/drone/push Build is passing Details
2021-03-17 10:10:01 +02:00
Alan Orth f6726ef210
Regenerate requirements
Generated using poetry:

  $ poetry export --without-hashes -f requirements.txt > requirements.txt
  $ poetry export --without-hashes --dev -f requirements.txt > requirements-dev.txt
2021-03-17 10:09:39 +02:00
Alan Orth a1243cf54a
poetry.lock: Run poetry update 2021-03-17 10:09:14 +02:00
Alan Orth 99cb76568f
pyproject.toml: Use csv-metadata-quality v0.4.7
This includes some minor optimizations and the ability to check for
duplicate items.

See: https://github.com/ilri/csv-metadata-quality/releases/tag/v0.4.7
2021-03-17 10:08:06 +02:00
Alan Orth ca116284ca
Use "unsafe" in quotes on frontpage
continuous-integration/drone/push Build is passing Details
This was more me being cautious when I was writing the original tool
than a warning about it being actually unsafe. Now that this web fro
ntend will be used by less-technical users I should tone down the la
nguage.
2021-03-16 13:04:33 +02:00
Alan Orth 2fcfc76ea5
csv_metadata_quality_web/main.py: Remove check for __main__
continuous-integration/drone/push Build is passing Details
This is only needed if we are running directly in Python.
2021-03-14 22:05:04 +02:00
Alan Orth 78f58b459c
Create application for gunicorn
This is apparently what gunicorn looks for.
2021-03-14 22:03:15 +02:00
Alan Orth 863a540225
Move csv_metadata_quality_web to a package
Eventually I will want to refactor so this will be necessary.
2021-03-14 22:01:45 +02:00
Alan Orth cc203b2842
Regenerate requirements
Generated using poetry:

  $ poetry export --without-hashes -f requirements.txt > requirements.txt
  $ poetry export --without-hashes --dev -f requirements.txt > requirements-dev.txt
2021-03-14 21:10:33 +02:00
Alan Orth de0703ceb2
poetry.lock: Run poetry update 2021-03-14 21:09:58 +02:00
Alan Orth 2a852c9ed3
pyproject.toml: Pin new version of csv-metadata-quality
This version doesn't bother checking invalid multi-value separators.
Instead it just fixes them.
2021-03-14 21:09:07 +02:00
Alan Orth edd651317b
templates/index.html: Change default selections
Enable AGROVOC lookup on dcterms.subject as well as the "unsafe"
fixes. For the AGROVOC lookup I just think that it  might not be
obvious to non-technical users that you have to check the box AND
enter a field name, despite the placeholder value. In any case, it
doesn't hurt to enable AGROVOC lookup by default because it won't
fail if the default dcterms.subject field is not present in the
user's CSV.
2021-03-14 20:54:50 +02:00
Alan Orth 6f396f392f Revert "Move style.min.css to css/v1/style.min.css"
This reverts commit 8f6d337d2d.

We are using Heroku now so we don't need this phony version.
2021-03-14 20:40:33 +02:00
Alan Orth f292a4902f
.drone.yml: Install git for some pip deps
continuous-integration/drone/push Build is passing Details
2021-03-14 19:32:14 +02:00
Alan Orth b43b995a90
Add drone.yml for Drone CI
continuous-integration/drone/push Build is failing Details
2021-03-14 18:33:42 +02:00
Alan Orth aa862620d7
README.md: Try a relative link for screenshot.png 2021-03-14 16:15:21 +02:00
Alan Orth f42a83c7ab
Remove Google App Engine config 2021-03-14 16:07:26 +02:00
Alan Orth 1d46d490cb
README.md: Add build badge from GitHub Actions 2021-03-14 15:57:59 +02:00
Alan Orth 4f48af7f24
Add GitHub workflow to build
For now only builds, as I'm not sure how to test the web application
yet.
2021-03-14 15:55:58 +02:00
Alan Orth e8dc08bcac
README.md: Update text 2021-03-14 13:54:03 +02:00
Alan Orth f4ddf4a7b5
README.md: Update intro text 2021-03-14 13:11:39 +02:00
Alan Orth d37654206f
README.md: Fix screenshot link 2021-03-14 13:08:50 +02:00
Alan Orth 69501cbacb
Add README.md with screenshot and license 2021-03-14 13:07:24 +02:00
Alan Orth 2a9ec1c3f3
LICENSE.txt: Use GPLv3 instead of AGPLv3
I would rather have the source publishing requirements be triggered
on distribution than on web hosting.
2021-03-14 13:05:32 +02:00
Alan Orth be9143204c
Add Procfile for Heroku
See: https://devcenter.heroku.com/articles/python-gunicorn
2021-03-14 12:29:28 +02:00
Alan Orth 55815cf4c0
runtime.txt: Use Python 3.9.2
Actually it seems they do have Python 3.9.2.

See: https://devcenter.heroku.com/articles/python-support
2021-03-14 12:25:49 +02:00
Alan Orth 73a13145b6
Add runtime.txt
Apparently to deploy on Heroku we need this. And they only support
Python 3.7? Damn...
2021-03-14 12:24:03 +02:00
Alan Orth 8f6d337d2d
Move style.min.css to css/v1/style.min.css
Trying to break Google App Engine's aggressive caching.
2021-03-14 12:04:28 +02:00
Alan Orth aabb783d99
app.yaml: Set Cache-Control header to private for CSS
Google App Engine agressively caches stuff. They are currently serving
a 24-hour old version of my CSS after multiple updates and re-deploys.
Ughhh. From their docs:

> After a file is transmitted with a given expiration time, there is
> generally no way to clear it out of web-proxy caches, even if the user
> clears their own browser cache. Re-deploying a new version of the app
> will not reset any caches. Therefore, if you ever plan to modify a
> static file, it should have a short (less than one hour) expiration
> time. In most cases, the default 10-minute expiration time is
> appropriate.

The only way to break this for now is to change the CSS *directory*.
In the future I think we have to be sure to set the private cache
control header, which lets browsers cache it, but not public CDNs.

See: https://cloud.google.com/appengine/docs/standard/python3/how-requests-are-handled
2021-03-14 11:58:57 +02:00
Alan Orth bd31ac912e
Regenerate static assets 2021-03-14 11:42:07 +02:00
Alan Orth 61040ea4a5
Use an ILRI theme 2021-03-14 11:41:48 +02:00
Alan Orth d483f7fc0b
.gitignore: Ignore sqlite requests response cache 2021-03-14 11:36:46 +02:00
Alan Orth c07716abcb
.gcloudignore: Ignore sqlite requests response cache 2021-03-14 11:36:09 +02:00
Alan Orth 36b43a06b9
templates/index.html: Add link to test.csv
Offer the user to test with this file.
2021-03-14 11:34:55 +02:00
Alan Orth 25aa74ba14
app.yaml: Try to serve static CSS directly
Google App Engine is currently caching an old version of my CSS, so
I am trying to get it to use the correct version. Let's try serving
it directly from the filesystem.

See: https://cloud.google.com/appengine/docs/standard/php/getting-started/serving-static-files
2021-03-14 10:36:57 +02:00
Alan Orth a2ace2d331
.gcloudignore: Don't upload source dir
We only need this during build.
2021-03-14 10:31:46 +02:00
Alan Orth 94cdd7fb50
Regenerate requirements
Generated using poetry:

  $ poetry export --without-hashes -f requirements.txt > requirements.txt
  $ poetry export --without-hashes --dev -f requirements.txt > requirements-dev.txt
2021-03-14 10:09:18 +02:00
Alan Orth 74bde23567
poetry.lock: Run poetry update 2021-03-14 10:08:44 +02:00
Alan Orth 4e52d1bcc9
Add configurable requests cache directory
As I expected, on Google App Engine we can't write the cache file
to the current working directory. I modified csv-metadata-quality
CLI to check for the REQUESTS_CACHE_DIR environment variable so we
don't really have to do anything different other than setting the
variable.
2021-03-14 10:06:39 +02:00