diff --git a/content/posts/2020-12.md b/content/posts/2020-12.md index 9a59d2159..9866d3338 100644 --- a/content/posts/2020-12.md +++ b/content/posts/2020-12.md @@ -184,4 +184,23 @@ Caused by: org.apache.http.TruncatedChunkException: Truncated chunk ( expected s ... ``` +## 2020-12-10 + +- The statistics-2019 core finished processing the duplicate removal so I started the statistics-2017 core +- Peter asked me to add ONE HEALTH to ILRI subjects on CGSpace +- A few items that got "lost" after approval during the database issues earlier this week seem to have gone back into their workflows + - Abenet approved them again and they got new handles, phew +- Abenet was having an issue with the date filter on AReS and it turns out that it's the same `.keyword` issue I had noticed before that causes the filter to stop working + - I fixed the filter to use the correct field name and filed a bug on OpenRXV: https://github.com/ilri/OpenRXV/issues/63 +- I checked the Solr statistics on DSpace Test to see if the Atmire duplicates remover was working, but now I see a comical amount of duplicates... + +![Solr stats with dozens of duplicates](/cgspace-notes/2020/12/solr-stats-duplicates.png) + +- I sent feedback about this to Atmire +- I will re-sync the Solr stats from CGSpace so we can try again... +- In other news, it has been a few days since we deployed the fix for the database locking issue and things seem much better now: + +![PostgreSQL connections all week](/cgspace-notes/2020/12/postgres_connections_ALL-week.png) +![PostgreSQL locks all week](/cgspace-notes/2020/12/postgres_locks_ALL-week.png) + diff --git a/docs/2020-12/index.html b/docs/2020-12/index.html index 55bafaa40..b7705b789 100644 --- a/docs/2020-12/index.html +++ b/docs/2020-12/index.html @@ -20,7 +20,7 @@ I started processing those (about 411,000 records): - + @@ -46,9 +46,9 @@ I started processing those (about 411,000 records): "@type": "BlogPosting", "headline": "December, 2020", "url": "https://alanorth.github.io/cgspace-notes/2020-12/", - "wordCount": "1051", + "wordCount": "1231", "datePublished": "2020-12-01T11:32:54+02:00", - "dateModified": "2020-12-08T11:14:33+02:00", + "dateModified": "2020-12-09T22:48:19+02:00", "author": { "@type": "Person", "name": "Alan Orth" @@ -309,7 +309,31 @@ Caused by: org.apache.http.TruncatedChunkException: Truncated chunk ( expected s at org.apache.solr.common.util.FastInputStream.read(FastInputStream.java:125) at org.apache.solr.common.util.FastInputStream.readFully(FastInputStream.java:152) ... - +

2020-12-10

+ +

Solr stats with dozens of duplicates

+ +

PostgreSQL connections all week +PostgreSQL locks all week

+ diff --git a/docs/2020/12/postgres_connections_ALL-week.png b/docs/2020/12/postgres_connections_ALL-week.png new file mode 100644 index 000000000..42b21e808 Binary files /dev/null and b/docs/2020/12/postgres_connections_ALL-week.png differ diff --git a/docs/2020/12/postgres_locks_ALL-week.png b/docs/2020/12/postgres_locks_ALL-week.png new file mode 100644 index 000000000..ffbcfd2ec Binary files /dev/null and b/docs/2020/12/postgres_locks_ALL-week.png differ diff --git a/docs/2020/12/solr-stats-duplicates.png b/docs/2020/12/solr-stats-duplicates.png new file mode 100644 index 000000000..c10d58fb7 Binary files /dev/null and b/docs/2020/12/solr-stats-duplicates.png differ diff --git a/docs/categories/index.html b/docs/categories/index.html index 2d4c891d1..41a551dff 100644 --- a/docs/categories/index.html +++ b/docs/categories/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/categories/notes/index.html b/docs/categories/notes/index.html index 4ee10ff84..8dcd717da 100644 --- a/docs/categories/notes/index.html +++ b/docs/categories/notes/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/categories/notes/page/2/index.html b/docs/categories/notes/page/2/index.html index 194fbcfae..5de02e639 100644 --- a/docs/categories/notes/page/2/index.html +++ b/docs/categories/notes/page/2/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/categories/notes/page/3/index.html b/docs/categories/notes/page/3/index.html index 1beffbc33..4ab1b4ff6 100644 --- a/docs/categories/notes/page/3/index.html +++ b/docs/categories/notes/page/3/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/categories/notes/page/4/index.html b/docs/categories/notes/page/4/index.html index 5a94083ef..ae61eacc0 100644 --- a/docs/categories/notes/page/4/index.html +++ b/docs/categories/notes/page/4/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/categories/notes/page/5/index.html b/docs/categories/notes/page/5/index.html index dc4de5ac3..7943ac0a0 100644 --- a/docs/categories/notes/page/5/index.html +++ b/docs/categories/notes/page/5/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/index.html b/docs/index.html index 593599782..bb4f30fe7 100644 --- a/docs/index.html +++ b/docs/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/page/2/index.html b/docs/page/2/index.html index 92cf3013d..670163fb7 100644 --- a/docs/page/2/index.html +++ b/docs/page/2/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/page/3/index.html b/docs/page/3/index.html index e282ebd6e..fc884b7c8 100644 --- a/docs/page/3/index.html +++ b/docs/page/3/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/page/4/index.html b/docs/page/4/index.html index 471052051..31f6dc824 100644 --- a/docs/page/4/index.html +++ b/docs/page/4/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/page/5/index.html b/docs/page/5/index.html index 6dd521a49..f2b135913 100644 --- a/docs/page/5/index.html +++ b/docs/page/5/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/page/6/index.html b/docs/page/6/index.html index 0dccb050c..07d9ce82a 100644 --- a/docs/page/6/index.html +++ b/docs/page/6/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/page/7/index.html b/docs/page/7/index.html index 3fd0abf0f..71adedcb4 100644 --- a/docs/page/7/index.html +++ b/docs/page/7/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/posts/index.html b/docs/posts/index.html index 6c59407d7..989ca06f8 100644 --- a/docs/posts/index.html +++ b/docs/posts/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/posts/page/2/index.html b/docs/posts/page/2/index.html index e883c5896..dacdb1562 100644 --- a/docs/posts/page/2/index.html +++ b/docs/posts/page/2/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/posts/page/3/index.html b/docs/posts/page/3/index.html index 52d62bec0..13755d0d0 100644 --- a/docs/posts/page/3/index.html +++ b/docs/posts/page/3/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/posts/page/4/index.html b/docs/posts/page/4/index.html index 32614522a..df62a7d11 100644 --- a/docs/posts/page/4/index.html +++ b/docs/posts/page/4/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/posts/page/5/index.html b/docs/posts/page/5/index.html index e619dbf20..54d4c759e 100644 --- a/docs/posts/page/5/index.html +++ b/docs/posts/page/5/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/posts/page/6/index.html b/docs/posts/page/6/index.html index 24d7c5db7..d76d4d874 100644 --- a/docs/posts/page/6/index.html +++ b/docs/posts/page/6/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/posts/page/7/index.html b/docs/posts/page/7/index.html index 4805d6bfe..13233b24a 100644 --- a/docs/posts/page/7/index.html +++ b/docs/posts/page/7/index.html @@ -10,7 +10,7 @@ - + diff --git a/docs/sitemap.xml b/docs/sitemap.xml index 5efbe8807..e3546b7a4 100644 --- a/docs/sitemap.xml +++ b/docs/sitemap.xml @@ -4,27 +4,27 @@ https://alanorth.github.io/cgspace-notes/categories/ - 2020-12-08T11:14:33+02:00 + 2020-12-09T22:48:19+02:00 https://alanorth.github.io/cgspace-notes/ - 2020-12-08T11:14:33+02:00 + 2020-12-09T22:48:19+02:00 https://alanorth.github.io/cgspace-notes/2020-12/ - 2020-12-08T11:14:33+02:00 + 2020-12-09T22:48:19+02:00 https://alanorth.github.io/cgspace-notes/categories/notes/ - 2020-12-08T11:14:33+02:00 + 2020-12-09T22:48:19+02:00 https://alanorth.github.io/cgspace-notes/posts/ - 2020-12-08T11:14:33+02:00 + 2020-12-09T22:48:19+02:00 diff --git a/static/2020/12/postgres_connections_ALL-week.png b/static/2020/12/postgres_connections_ALL-week.png new file mode 100644 index 000000000..42b21e808 Binary files /dev/null and b/static/2020/12/postgres_connections_ALL-week.png differ diff --git a/static/2020/12/postgres_locks_ALL-week.png b/static/2020/12/postgres_locks_ALL-week.png new file mode 100644 index 000000000..ffbcfd2ec Binary files /dev/null and b/static/2020/12/postgres_locks_ALL-week.png differ diff --git a/static/2020/12/solr-stats-duplicates.png b/static/2020/12/solr-stats-duplicates.png new file mode 100644 index 000000000..c10d58fb7 Binary files /dev/null and b/static/2020/12/solr-stats-duplicates.png differ