From 6313ebb1a58cff944166f9f63a95e3e55bb66a0d Mon Sep 17 00:00:00 2001 From: Alan Orth Date: Tue, 1 Oct 2019 17:31:40 +0300 Subject: [PATCH] Add notes for 2019-10-01 --- content/posts/2019-10.md | 31 ++++ docs/2015-11/index.html | 4 +- docs/2015-12/index.html | 4 +- docs/2016-01/index.html | 4 +- docs/2016-02/index.html | 4 +- docs/2016-03/index.html | 4 +- docs/2016-04/index.html | 4 +- docs/2016-05/index.html | 4 +- docs/2016-06/index.html | 4 +- docs/2016-07/index.html | 4 +- docs/2016-08/index.html | 4 +- docs/2016-09/index.html | 4 +- docs/2016-10/index.html | 4 +- docs/2016-11/index.html | 4 +- docs/2016-12/index.html | 4 +- docs/2017-01/index.html | 4 +- docs/2017-02/index.html | 4 +- docs/2017-03/index.html | 4 +- docs/2017-04/index.html | 4 +- docs/2017-05/index.html | 4 +- docs/2017-06/index.html | 4 +- docs/2017-07/index.html | 4 +- docs/2017-08/index.html | 4 +- docs/2017-09/index.html | 4 +- docs/2017-10/index.html | 4 +- docs/2017-11/index.html | 4 +- docs/2017-12/index.html | 4 +- docs/2018-01/index.html | 4 +- docs/2018-02/index.html | 4 +- docs/2018-03/index.html | 4 +- docs/2018-04/index.html | 4 +- docs/2018-05/index.html | 4 +- docs/2018-06/index.html | 4 +- docs/2018-07/index.html | 4 +- docs/2018-08/index.html | 4 +- docs/2018-09/index.html | 4 +- docs/2018-10/index.html | 4 +- docs/2018-11/index.html | 4 +- docs/2018-12/index.html | 4 +- docs/2019-01/index.html | 4 +- docs/2019-02/index.html | 4 +- docs/2019-03/index.html | 4 +- docs/2019-04/index.html | 4 +- docs/2019-05/index.html | 4 +- docs/2019-06/index.html | 4 +- docs/2019-07/index.html | 4 +- docs/2019-08/index.html | 8 +- docs/2019-09/index.html | 8 +- docs/2019-10/index.html | 206 ++++++++++++++++++++++++ docs/404.html | 4 +- docs/categories/index.html | 53 +++--- docs/categories/notes/index.html | 4 +- docs/categories/page/2/index.html | 59 +++---- docs/categories/page/3/index.html | 47 +++--- docs/categories/page/4/index.html | 56 +++---- docs/categories/page/5/index.html | 38 ++++- docs/cgiar-library-migration/index.html | 4 +- docs/index.html | 57 +++---- docs/index.xml | 12 +- docs/page/2/index.html | 63 ++++---- docs/page/3/index.html | 51 +++--- docs/page/4/index.html | 60 +++---- docs/page/5/index.html | 42 ++++- docs/posts/index.html | 57 +++---- docs/posts/index.xml | 12 +- docs/posts/page/2/index.html | 63 ++++---- docs/posts/page/3/index.html | 51 +++--- docs/posts/page/4/index.html | 60 +++---- docs/posts/page/5/index.html | 42 ++++- docs/robots.txt | 3 +- docs/sitemap.xml | 25 +-- docs/tags/index.html | 57 +++---- docs/tags/index.xml | 4 +- docs/tags/notes/index.html | 55 +++---- docs/tags/notes/index.xml | 12 +- docs/tags/notes/page/2/index.html | 61 +++---- docs/tags/notes/page/3/index.html | 65 ++++---- docs/tags/notes/page/4/index.html | 67 ++++---- docs/tags/notes/page/5/index.html | 33 +++- docs/tags/page/2/index.html | 63 ++++---- docs/tags/page/3/index.html | 51 +++--- docs/tags/page/4/index.html | 60 +++---- docs/tags/page/5/index.html | 42 ++++- 83 files changed, 1117 insertions(+), 749 deletions(-) create mode 100644 content/posts/2019-10.md create mode 100644 docs/2019-10/index.html diff --git a/content/posts/2019-10.md b/content/posts/2019-10.md new file mode 100644 index 000000000..2f8a27161 --- /dev/null +++ b/content/posts/2019-10.md @@ -0,0 +1,31 @@ +--- +title: "October, 2019" +date: 2019-10-01T13:20:51+03:00 +author: "Alan Orth" +tags: ["Notes"] +--- + +## 2019-10-01 + +- Udana from IWMI asked me for a CSV export of their community on CGSpace + - I exported it, but a quick run through the `csv-metadata-quality` tool shows that there are some low-hanging fruits we can fix before I send him the data + - I will limit the scope to the titles, regions, subregions, and river basins for now to manually fix some non-breaking spaces (U+00A0) there that would otherwise be removed by the csv-metadata-quality script's "unneccesary Unicode" fix: + +``` +$ csvcut -c 'id,dc.title[en_US],cg.coverage.region[en_US],cg.coverage.subregion[en_US],cg.river.basin[en_US]' ~/Downloads/10568-16814.csv > /tmp/iwmi-title-region-subregion-river.csv +``` + + - Then I replace them in vim with `:% s/\%u00a0/ /g` because I can't figure out the correct sed syntax to do it directly from the pipe above + - I uploaded those to CGSpace and then re-exported the metadata + - Now that I think about it, I shouldn't be removing non-breaking spaces (U+00A0), I should be replacing them with normal spaces! + - I modified the script so it replaces the non-breaking spaces instead of removing them + - Then I ran the csv-metadata-quality script to do some general cleanups (though I temporarily commented out the whitespace fixes because it was too many thousands of rows): + +``` +$ csv-metadata-quality -i ~/Downloads/10568-16814.csv -o /tmp/iwmi.csv -x 'dc.date.issued,dc.date.issued[],dc.date.issued[en_US]' -u +``` + + - That fixed 153 items (unnecessary Unicode, duplicates, comma–space fixes, etc) +- Release [version 0.3.1 of the csv-metadata-quality script](https://github.com/ilri/csv-metadata-quality/releases/tag/v0.3.1) with the non-breaking spaces change + + diff --git a/docs/2015-11/index.html b/docs/2015-11/index.html index c45e35f87..e68276f52 100644 --- a/docs/2015-11/index.html +++ b/docs/2015-11/index.html @@ -278,6 +278,8 @@ db.statementpool = true
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -286,8 +288,6 @@ db.statementpool = true
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2015-12/index.html b/docs/2015-12/index.html index 3fc2d923e..a6f6ffa86 100644 --- a/docs/2015-12/index.html +++ b/docs/2015-12/index.html @@ -294,6 +294,8 @@ $ curl -o /dev/null -s -w %{time_total}\\n https://cgspace.cgiar.org/rest/handle
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -302,8 +304,6 @@ $ curl -o /dev/null -s -w %{time_total}\\n https://cgspace.cgiar.org/rest/handle
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2016-01/index.html b/docs/2016-01/index.html index 3cecb1aa5..b68372aa2 100644 --- a/docs/2016-01/index.html +++ b/docs/2016-01/index.html @@ -210,6 +210,8 @@ $ find SimpleArchiveForBio/ -iname “*.pdf” -exec basename {} \; | so
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -218,8 +220,6 @@ $ find SimpleArchiveForBio/ -iname “*.pdf” -exec basename {} \; | so
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2016-02/index.html b/docs/2016-02/index.html index e5ec4a91c..236f4120f 100644 --- a/docs/2016-02/index.html +++ b/docs/2016-02/index.html @@ -455,6 +455,8 @@ Bitstream: tést señora alimentación.pdf
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -463,8 +465,6 @@ Bitstream: tést señora alimentación.pdf
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2016-03/index.html b/docs/2016-03/index.html index 812e2daf5..40bdb2a9f 100644 --- a/docs/2016-03/index.html +++ b/docs/2016-03/index.html @@ -361,6 +361,8 @@ metadata_value_id | resource_id | metadata_field_id | text_value | text_lang | p
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -369,8 +371,6 @@ metadata_value_id | resource_id | metadata_field_id | text_value | text_lang | p
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2016-04/index.html b/docs/2016-04/index.html index 6f4c63cbb..3433e6ef5 100644 --- a/docs/2016-04/index.html +++ b/docs/2016-04/index.html @@ -577,6 +577,8 @@ dspace.log.2016-04-27:7271
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -585,8 +587,6 @@ dspace.log.2016-04-27:7271
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2016-05/index.html b/docs/2016-05/index.html index d1eb524ce..ead09aa40 100644 --- a/docs/2016-05/index.html +++ b/docs/2016-05/index.html @@ -435,6 +435,8 @@ sys 0m20.540s
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -443,8 +445,6 @@ sys 0m20.540s
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2016-06/index.html b/docs/2016-06/index.html index 6e762e06b..884e70ebd 100644 --- a/docs/2016-06/index.html +++ b/docs/2016-06/index.html @@ -470,6 +470,8 @@ $ ./delete-metadata-values.py -f dc.contributor.corporate -i Corporate-Authors-D
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -478,8 +480,6 @@ $ ./delete-metadata-values.py -f dc.contributor.corporate -i Corporate-Authors-D
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2016-07/index.html b/docs/2016-07/index.html index d1b012bd7..70a7b1ff2 100644 --- a/docs/2016-07/index.html +++ b/docs/2016-07/index.html @@ -381,6 +381,8 @@ discovery.index.authority.ignore-variants=true
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -389,8 +391,6 @@ discovery.index.authority.ignore-variants=true
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2016-08/index.html b/docs/2016-08/index.html index 058746d78..600d3f089 100644 --- a/docs/2016-08/index.html +++ b/docs/2016-08/index.html @@ -460,6 +460,8 @@ $ JAVA_OPTS="-Dfile.encoding=UTF-8 -Xmx512m" /home/cgspace.cgiar.org/b
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -468,8 +470,6 @@ $ JAVA_OPTS="-Dfile.encoding=UTF-8 -Xmx512m" /home/cgspace.cgiar.org/b
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2016-09/index.html b/docs/2016-09/index.html index 19076d277..9628d5414 100644 --- a/docs/2016-09/index.html +++ b/docs/2016-09/index.html @@ -734,6 +734,8 @@ $ ./delete-metadata-values.py -i ilrisubjects-delete-13.csv -f cg.subject.ilri -
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -742,8 +744,6 @@ $ ./delete-metadata-values.py -i ilrisubjects-delete-13.csv -f cg.subject.ilri -
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2016-10/index.html b/docs/2016-10/index.html index 2d37dd10d..4b647a82c 100644 --- a/docs/2016-10/index.html +++ b/docs/2016-10/index.html @@ -439,6 +439,8 @@ dspace=# update metadatavalue set text_value = regexp_replace(text_value, 'http:
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -447,8 +449,6 @@ dspace=# update metadatavalue set text_value = regexp_replace(text_value, 'http:
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2016-11/index.html b/docs/2016-11/index.html index 90a08cf99..c929ced45 100644 --- a/docs/2016-11/index.html +++ b/docs/2016-11/index.html @@ -640,6 +640,8 @@ org.dspace.discovery.SearchServiceException: Error executing query
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -648,8 +650,6 @@ org.dspace.discovery.SearchServiceException: Error executing query
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2016-12/index.html b/docs/2016-12/index.html index db18b6488..abe62e237 100644 --- a/docs/2016-12/index.html +++ b/docs/2016-12/index.html @@ -907,6 +907,8 @@ $ exit
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -915,8 +917,6 @@ $ exit
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2017-01/index.html b/docs/2017-01/index.html index 8a3e29cf8..f82bd6fbf 100644 --- a/docs/2017-01/index.html +++ b/docs/2017-01/index.html @@ -432,6 +432,8 @@ $ gs -sDEVICE=pdfwrite -dCompatibilityLevel=1.4 -dPDFSETTINGS=/ebook -dNOPAUSE -
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -440,8 +442,6 @@ $ gs -sDEVICE=pdfwrite -dCompatibilityLevel=1.4 -dPDFSETTINGS=/ebook -dNOPAUSE -
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2017-02/index.html b/docs/2017-02/index.html index 8d9942d5b..c902354c6 100644 --- a/docs/2017-02/index.html +++ b/docs/2017-02/index.html @@ -497,6 +497,8 @@ COPY 1968
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -505,8 +507,6 @@ COPY 1968
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2017-03/index.html b/docs/2017-03/index.html index b3f730199..2663e50c3 100644 --- a/docs/2017-03/index.html +++ b/docs/2017-03/index.html @@ -434,6 +434,8 @@ $ ./delete-metadata-values.py -i Investors-Delete-121.csv -f dc.description.spon
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -442,8 +444,6 @@ $ ./delete-metadata-values.py -i Investors-Delete-121.csv -f dc.description.spon
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2017-04/index.html b/docs/2017-04/index.html index ee37ee6f2..c7274e14a 100644 --- a/docs/2017-04/index.html +++ b/docs/2017-04/index.html @@ -702,6 +702,8 @@ $ gem install compass -v 1.0.3
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -710,8 +712,6 @@ $ gem install compass -v 1.0.3
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2017-05/index.html b/docs/2017-05/index.html index bf7705d20..a2e30cc00 100644 --- a/docs/2017-05/index.html +++ b/docs/2017-05/index.html @@ -462,6 +462,8 @@ UPDATE 187
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -470,8 +472,6 @@ UPDATE 187
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2017-06/index.html b/docs/2017-06/index.html index 6fd91eada..3985d29cc 100644 --- a/docs/2017-06/index.html +++ b/docs/2017-06/index.html @@ -295,6 +295,8 @@ text_value
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -303,8 +305,6 @@ text_value
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2017-07/index.html b/docs/2017-07/index.html index 92c0e126c..a81e7faef 100644 --- a/docs/2017-07/index.html +++ b/docs/2017-07/index.html @@ -315,6 +315,8 @@ delete from metadatavalue where resource_type_id=2 and metadata_field_id=235 and
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -323,8 +325,6 @@ delete from metadatavalue where resource_type_id=2 and metadata_field_id=235 and
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2017-08/index.html b/docs/2017-08/index.html index 620c5c5ee..680108ff9 100644 --- a/docs/2017-08/index.html +++ b/docs/2017-08/index.html @@ -611,6 +611,8 @@ org.apache.commons.dbcp.SQLNestedException: Cannot get a connection, pool error
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -619,8 +621,6 @@ org.apache.commons.dbcp.SQLNestedException: Cannot get a connection, pool error
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2017-09/index.html b/docs/2017-09/index.html index ee8386e82..f499e2c24 100644 --- a/docs/2017-09/index.html +++ b/docs/2017-09/index.html @@ -781,6 +781,8 @@ Cert Status: good
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -789,8 +791,6 @@ Cert Status: good
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2017-10/index.html b/docs/2017-10/index.html index 55be1a756..61df773cf 100644 --- a/docs/2017-10/index.html +++ b/docs/2017-10/index.html @@ -547,6 +547,8 @@ session_id=6C30F10B4351A4ED83EC6ED50AFD6B6A
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -555,8 +557,6 @@ session_id=6C30F10B4351A4ED83EC6ED50AFD6B6A
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2017-11/index.html b/docs/2017-11/index.html index 0a62c0b63..2bd0cb6b4 100644 --- a/docs/2017-11/index.html +++ b/docs/2017-11/index.html @@ -1157,6 +1157,8 @@ $ cat dspace.log.2017-11-28 | grep -o -E 'session_id=[A-Z0-9]{32}' | sort -n | u
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -1165,8 +1167,6 @@ $ cat dspace.log.2017-11-28 | grep -o -E 'session_id=[A-Z0-9]{32}' | sort -n | u
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2017-12/index.html b/docs/2017-12/index.html index 93ff94c35..a7fabe0d1 100644 --- a/docs/2017-12/index.html +++ b/docs/2017-12/index.html @@ -938,6 +938,8 @@ DELETE 20
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -946,8 +948,6 @@ DELETE 20
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2018-01/index.html b/docs/2018-01/index.html index 9783b4979..dee4720cb 100644 --- a/docs/2018-01/index.html +++ b/docs/2018-01/index.html @@ -1732,6 +1732,8 @@ Catalina:type=Manager,context=/,host=localhost activeSessions 8
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -1740,8 +1742,6 @@ Catalina:type=Manager,context=/,host=localhost activeSessions 8
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2018-02/index.html b/docs/2018-02/index.html index 7c984fe29..494930c6f 100644 --- a/docs/2018-02/index.html +++ b/docs/2018-02/index.html @@ -1286,6 +1286,8 @@ UPDATE 3
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -1294,8 +1296,6 @@ UPDATE 3
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2018-03/index.html b/docs/2018-03/index.html index d8b72f0ae..78402ef9b 100644 --- a/docs/2018-03/index.html +++ b/docs/2018-03/index.html @@ -712,6 +712,8 @@ Fixed 5 occurences of: GENEBANKS
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -720,8 +722,6 @@ Fixed 5 occurences of: GENEBANKS
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2018-04/index.html b/docs/2018-04/index.html index ae7b062ce..fb6e134ac 100644 --- a/docs/2018-04/index.html +++ b/docs/2018-04/index.html @@ -720,6 +720,8 @@ java.lang.NoSuchMethodError: java.nio.ByteBuffer.position(I)Ljava/nio/ByteBuffer
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -728,8 +730,6 @@ java.lang.NoSuchMethodError: java.nio.ByteBuffer.position(I)Ljava/nio/ByteBuffer
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2018-05/index.html b/docs/2018-05/index.html index 814246e9e..0e9a57ca5 100644 --- a/docs/2018-05/index.html +++ b/docs/2018-05/index.html @@ -615,6 +615,8 @@ $ psql -h localhost -U postgres dspacetest
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -623,8 +625,6 @@ $ psql -h localhost -U postgres dspacetest
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2018-06/index.html b/docs/2018-06/index.html index 355530003..c5be6f5c3 100644 --- a/docs/2018-06/index.html +++ b/docs/2018-06/index.html @@ -583,6 +583,8 @@ $ sed '/^id/d' 10568-*.csv | csvcut -c 1,2 > map-to-cifor-archive.csv
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -591,8 +593,6 @@ $ sed '/^id/d' 10568-*.csv | csvcut -c 1,2 > map-to-cifor-archive.csv
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2018-07/index.html b/docs/2018-07/index.html index b6907627a..102e59a04 100644 --- a/docs/2018-07/index.html +++ b/docs/2018-07/index.html @@ -674,6 +674,8 @@ count
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -682,8 +684,6 @@ count
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2018-08/index.html b/docs/2018-08/index.html index 7ddcec4f1..a89401fdb 100644 --- a/docs/2018-08/index.html +++ b/docs/2018-08/index.html @@ -547,6 +547,8 @@ $ dspace database migrate ignored
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -555,8 +557,6 @@ $ dspace database migrate ignored
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2018-09/index.html b/docs/2018-09/index.html index 9aab90b0e..0e2563cfb 100644 --- a/docs/2018-09/index.html +++ b/docs/2018-09/index.html @@ -909,6 +909,8 @@ UPDATE metadatavalue SET text_value='ja' WHERE resource_type_id=2 AND metadata_f
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -917,8 +919,6 @@ UPDATE metadatavalue SET text_value='ja' WHERE resource_type_id=2 AND metadata_f
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2018-10/index.html b/docs/2018-10/index.html index f1043ddf9..3fe9658b5 100644 --- a/docs/2018-10/index.html +++ b/docs/2018-10/index.html @@ -796,6 +796,8 @@ $ curl -X GET -H "Content-Type: application/json" -H "Accept: app
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -804,8 +806,6 @@ $ curl -X GET -H "Content-Type: application/json" -H "Accept: app
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2018-11/index.html b/docs/2018-11/index.html index 8deb8ef42..dd0141c45 100644 --- a/docs/2018-11/index.html +++ b/docs/2018-11/index.html @@ -651,6 +651,8 @@ $ dspace dsrun org.dspace.eperson.Groomer -a -b 11/27/2016 -d
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -659,8 +661,6 @@ $ dspace dsrun org.dspace.eperson.Groomer -a -b 11/27/2016 -d
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2018-12/index.html b/docs/2018-12/index.html index 5dc401a2b..f749119b2 100644 --- a/docs/2018-12/index.html +++ b/docs/2018-12/index.html @@ -684,6 +684,8 @@ UPDATE 1
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -692,8 +694,6 @@ UPDATE 1
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2019-01/index.html b/docs/2019-01/index.html index 5af3f47d3..06f333d02 100644 --- a/docs/2019-01/index.html +++ b/docs/2019-01/index.html @@ -1397,6 +1397,8 @@ identify: CorruptImageProfile `xmp' @ warning/profile.c/SetImageProfileInternal/
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -1405,8 +1407,6 @@ identify: CorruptImageProfile `xmp' @ warning/profile.c/SetImageProfileInternal/
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2019-02/index.html b/docs/2019-02/index.html index 5762bebc9..3bff5b99f 100644 --- a/docs/2019-02/index.html +++ b/docs/2019-02/index.html @@ -1588,6 +1588,8 @@ Please see the DSpace documentation for assistance.
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -1596,8 +1598,6 @@ Please see the DSpace documentation for assistance.
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2019-03/index.html b/docs/2019-03/index.html index 6b4d63a41..210114cc1 100644 --- a/docs/2019-03/index.html +++ b/docs/2019-03/index.html @@ -1380,6 +1380,8 @@ sys 0m2.551s
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -1388,8 +1390,6 @@ sys 0m2.551s
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2019-04/index.html b/docs/2019-04/index.html index 090094814..9e2ba5f84 100644 --- a/docs/2019-04/index.html +++ b/docs/2019-04/index.html @@ -1439,6 +1439,8 @@ UPDATE 14
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -1447,8 +1449,6 @@ UPDATE 14
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2019-05/index.html b/docs/2019-05/index.html index 09207f012..7c4c965f5 100644 --- a/docs/2019-05/index.html +++ b/docs/2019-05/index.html @@ -728,6 +728,8 @@ COPY 64871
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -736,8 +738,6 @@ COPY 64871
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2019-06/index.html b/docs/2019-06/index.html index 3c9fe775b..cc4bfa931 100644 --- a/docs/2019-06/index.html +++ b/docs/2019-06/index.html @@ -341,6 +341,8 @@ UPDATE 2
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -349,8 +351,6 @@ UPDATE 2
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2019-07/index.html b/docs/2019-07/index.html index 391fffb62..a58fbb6e7 100644 --- a/docs/2019-07/index.html +++ b/docs/2019-07/index.html @@ -624,6 +624,8 @@ issn.validate('1020-3362')
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -632,8 +634,6 @@ issn.validate('1020-3362')
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2019-08/index.html b/docs/2019-08/index.html index 65cf32e65..0ebc8304d 100644 --- a/docs/2019-08/index.html +++ b/docs/2019-08/index.html @@ -27,7 +27,7 @@ Run system updates on DSpace Test (linode19) and reboot it - + @@ -61,7 +61,7 @@ Run system updates on DSpace Test (linode19) and reboot it "url": "https:\/\/alanorth.github.io\/cgspace-notes\/2019-08\/", "wordCount": "2703", "datePublished": "2019-08-03T12:39:51\x2b03:00", - "dateModified": "2019-09-27T01:20:09\x2b03:00", + "dateModified": "2019-09-27T17:53:18\x2b03:00", "author": { "@type": "Person", "name": "Alan Orth" @@ -626,6 +626,8 @@ sys 2m27.496s
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -634,8 +636,6 @@ sys 2m27.496s
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2019-09/index.html b/docs/2019-09/index.html index d5e1dad64..5b6daf4aa 100644 --- a/docs/2019-09/index.html +++ b/docs/2019-09/index.html @@ -40,7 +40,7 @@ Here are the top ten IPs in the nginx XMLUI and REST/OAI logs this morning: - + @@ -87,7 +87,7 @@ Here are the top ten IPs in the nginx XMLUI and REST/OAI logs this morning: "url": "https:\/\/alanorth.github.io\/cgspace-notes\/2019-09\/", "wordCount": "2870", "datePublished": "2019-09-01T10:17:51\x2b03:00", - "dateModified": "2019-09-27T01:20:09\x2b03:00", + "dateModified": "2019-09-27T17:53:18\x2b03:00", "author": { "@type": "Person", "name": "Alan Orth" @@ -634,6 +634,8 @@ $ csv-metadata-quality -i /tmp/clarisa-institutions.csv -o /tmp/clarisa-institut
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -642,8 +644,6 @@ $ csv-metadata-quality -i /tmp/clarisa-institutions.csv -o /tmp/clarisa-institut
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/2019-10/index.html b/docs/2019-10/index.html new file mode 100644 index 000000000..9e590efda --- /dev/null +++ b/docs/2019-10/index.html @@ -0,0 +1,206 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + October, 2019 | CGSpace Notes + + + + + + + + + + + + + + + + +
+
+ +
+
+ + + + +
+
+

CGSpace Notes

+

Documenting day-to-day work on the CGSpace repository.

+
+
+ + + + +
+
+
+ + + + +
+
+

October, 2019

+

by Alan Orth in + +  + +

+
+ + +

2019-10-01

+ +
    +

  • Udana from IWMI asked me for a CSV export of their community on CGSpace

    + +
      +
    • I exported it, but a quick run through the csv-metadata-quality tool shows that there are some low-hanging fruits we can fix before I send him the data
      • + +

    • I will limit the scope to the titles, regions, subregions, and river basins for now to manually fix some non-breaking spaces (U+00A0) there that would otherwise be removed by the csv-metadata-quality script’s “unneccesary Unicode” fix:

      + +
      $ csvcut -c 'id,dc.title[en_US],cg.coverage.region[en_US],cg.coverage.subregion[en_US],cg.river.basin[en_US]' ~/Downloads/10568-16814.csv > /tmp/iwmi-title-region-subregion-river.csv
+
      • + +

    • Then I replace them in vim with :% s/\%u00a0/ /g because I can’t figure out the correct sed syntax to do it directly from the pipe above

      • + +

    • I uploaded those to CGSpace and then re-exported the metadata

      • + +

    • Now that I think about it, I shouldn’t be removing non-breaking spaces (U+00A0), I should be replacing them with normal spaces!

      • + +

    • I modified the script so it replaces the non-breaking spaces instead of removing them

      • + +

    • Then I ran the csv-metadata-quality script to do some general cleanups (though I temporarily commented out the whitespace fixes because it was too many thousands of rows):

      + +
      $ csv-metadata-quality -i ~/Downloads/10568-16814.csv -o /tmp/iwmi.csv -x 'dc.date.issued,dc.date.issued[],dc.date.issued[en_US]' -u
+
      • + +

    • That fixed 153 items (unnecessary Unicode, duplicates, comma–space fixes, etc)

      • +
    • + +

  • Release version 0.3.1 of the csv-metadata-quality script with the non-breaking spaces change

    • +
+ + + + + + + + +
+ + + +
+ + + + +
+
+ + + + + + + + + diff --git a/docs/404.html b/docs/404.html index a9728d269..c6161ecf6 100644 --- a/docs/404.html +++ b/docs/404.html @@ -87,6 +87,8 @@
    +
  1. October, 2019
    2. +
  2. Posts
  3. September, 2019
    4. @@ -95,8 +97,6 @@
  4. July, 2019
    5. -
  5. June, 2019
    6. -
diff --git a/docs/categories/index.html b/docs/categories/index.html index 5235e7395..2ff4870d7 100644 --- a/docs/categories/index.html +++ b/docs/categories/index.html @@ -89,6 +89,25 @@ +
+
+

October, 2019

+

by Alan Orth in + +  + +

+
+ 2019-10-01 Udana from IWMI asked me for a CSV export of their community on CGSpace + I exported it, but a quick run through the csv-metadata-quality tool shows that there are some low-hanging fruits we can fix before I send him the data I will limit the scope to the titles, regions, subregions, and river basins for now to manually fix some non-breaking spaces (U+00A0) there that would otherwise be removed by the csv-metadata-quality script’s “unneccesary Unicode” fix: + Read more → +
+ + + + + +

September, 2019

@@ -432,36 +451,6 @@ sys 0m1.979s - -
-
-

December, 2018

-

by Alan Orth in - -  - -

-
-

2018-12-01

- -
    -
  • Switch CGSpace (linode18) to use OpenJDK instead of Oracle JDK
    • -
  • I manually installed OpenJDK, then removed Oracle JDK, then re-ran the Ansible playbook to update all configuration files, etc
    • -
  • Then I ran all system updates and restarted the server
    • -
- -

2018-12-02

- - - Read more → -
- - - - -