diff --git a/content/posts/2023-06.md b/content/posts/2023-06.md
index 8467136ae..0de05d585 100644
--- a/content/posts/2023-06.md
+++ b/content/posts/2023-06.md
@@ -166,4 +166,66 @@ ERROR DOMException: CSSStyleSheet.cssRules getter: Not allowed to access cross-o
- Upload thumbnails for about 42 IITA Journal Articles after resolving their DOIs and making sure they were not CC ND
- I fixed a few bugs in `get_scihub_pdfs.py` in the process
+## 2023-06-21
+
+- Stefano got back to me about the MODS OAI-PMH schema test on DSpace Test
+ - He said that it's fine if we use iso8601 encoding for dates instead of w3cdtf and asked if we can create a custom end point for AGRIS that only includes types like Journal Articles similar to how Salem did it: https://melspace.loc.codeobia.com/oai/agris?verb=ListRecords&metadataPrefix=mods
+ - I updated DSpace Test with the new date format and said I'd work on the custom AGRIS set
+
+## 2023-06-25
+
+- Export CGSpace to check for missing Initiative collection mappings
+- I wanted to start a harvest on AReS but I've seen the load on the server high for a few days and I'm not sure what it is
+ - I decided to run all updates and reboot it since it's Sunday anyway
+
+## 2023-06-26
+
+- Since the new DSpace 7 will respect newlines in metadata fields I am curious to see how many of our abstracts have poor newlines
+ - I exported CGSpace and used a custom text facet with this GREL expression in OpenRefine to count the number of newlines in each cell:
+
+```console
+value.split('\n').length()
+```
+
+- Also useful to check for general length of the text in the cell to make sure it's a reasonably long string
+ - I spent some time trying to find a pattern that I could use to identify "easy" targets, but there are so many exceptions that it will have to be done manually
+ - I fixed a few dozen
+- Do a bit of work on thumbnails on CGSpace
+- I'm trying to troubleshoot the Discovery error I get on DSpace 7:
+
+```console
+java.lang.NullPointerException: Cannot invoke "org.dspace.discovery.configuration.DiscoverySearchFilterFacet.getIndexFieldName()" because the return value of "org.dspace.content.authority.DSpaceControlledVocabularyIndex.getFacetConfig()" is null
+```
+
+- I reverted to the default `submission-forms.xml` and the `getFacetConfig()` error goes away...
+- Kill some long-held locks on CGSpace PostgreSQL, as some users are complaining of slowness in archiving
+- I did some testing of the LDAP login issue related to groupmaps
+ - It does seem to be a regression from the [LDAP auth patch](https://github.com/DSpace/DSpace/pull/8814) from last month, so I [filed an issue](https://github.com/DSpace/DSpace/issues/8920)
+- I spent some time on working on Angular and I figured out how to add a custom Angular component to show the UN SDG Goal icons on DSpace 7
+
+## 2023-06-27
+
+- I debugged the NullPointerException and somehow it disappeared
+ - It seems to be related to the external controlled vocabularies in the submission form
+ - I removed them all, then added them all back, and now the issue is solved... hmmmm
+ - Oh now, now they are gone again, sigh...
+
+## 2023-06-28
+
+- Spent a lot of time debugging the browse indexes
+ - Looking at the [DSpace 7 demo API](https://api7.dspace.org/server/api/discover/browses) I see the four default browse indexes from `dspace.cfg` and the one default `srsc` one that gets automatically enabled from the `srsc` in the `submission-forms.xml`
+ - The same API call on my test DSpace 7 configuration results in the HTTP 500 I've been seeing for some time, and I am pretty sure it's due to the automagic configuration of hierarchical browses based on the submission form
+ - Yes, if I remove them all from my submission form then this works: http://localhost:8080/server/api/discover/browses
+ - I went through each of our vocabularies and tested them one by one:
+ - dcterms-subject: OK
+ - dc-contributor-author: NO
+ - cg-creator-identifier: NO
+ - cg-contributor-affiliation: OK (and with `facetType: "affiliation"` in API response?!)
+ - cg-contributor-donor: OK (`facetType: "sponsorship"`)
+ - cg-journal: NO
+ - cg-coverage-subregion: NO
+ - cg-species-breed: NO
+ - Now I need to figure out what it is about those five that causes them to not work!
+ - Ah, after debugging with someone on the DSpace Slack, I realized that DSpace expects these vocabularies to have corresponding indexes configured in `discovery.xml`, and they must be added as search filters AND sidebar facets.
+
diff --git a/docs/2023-06/index.html b/docs/2023-06/index.html
index fc094ff9c..632ea52c4 100644
--- a/docs/2023-06/index.html
+++ b/docs/2023-06/index.html
@@ -24,7 +24,7 @@ From what I can see we need to upgrade the MODS schema from 3.1 to 3.7 and then
-
+
@@ -54,9 +54,9 @@ From what I can see we need to upgrade the MODS schema from 3.1 to 3.7 and then
"@type": "BlogPosting",
"headline": "June, 2023",
"url": "https://alanorth.github.io/cgspace-notes/2023-06/",
- "wordCount": "1179",
+ "wordCount": "1766",
"datePublished": "2023-06-02T10:29:36+03:00",
- "dateModified": "2023-06-17T23:14:32+03:00",
+ "dateModified": "2023-06-19T16:26:41+03:00",
"author": {
"@type": "Person",
"name": "Alan Orth"
@@ -321,6 +321,88 @@ From what I can see we need to upgrade the MODS schema from 3.1 to 3.7 and then
+
2023-06-21
+
+- Stefano got back to me about the MODS OAI-PMH schema test on DSpace Test
+
+
+
+2023-06-25
+
+- Export CGSpace to check for missing Initiative collection mappings
+- I wanted to start a harvest on AReS but I’ve seen the load on the server high for a few days and I’m not sure what it is
+
+- I decided to run all updates and reboot it since it’s Sunday anyway
+
+
+
+2023-06-26
+
+- Since the new DSpace 7 will respect newlines in metadata fields I am curious to see how many of our abstracts have poor newlines
+
+- I exported CGSpace and used a custom text facet with this GREL expression in OpenRefine to count the number of newlines in each cell:
+
+
+
+value.split('\n').length()
+
+- Also useful to check for general length of the text in the cell to make sure it’s a reasonably long string
+
+- I spent some time trying to find a pattern that I could use to identify “easy” targets, but there are so many exceptions that it will have to be done manually
+- I fixed a few dozen
+
+
+- Do a bit of work on thumbnails on CGSpace
+- I’m trying to troubleshoot the Discovery error I get on DSpace 7:
+
+java.lang.NullPointerException: Cannot invoke "org.dspace.discovery.configuration.DiscoverySearchFilterFacet.getIndexFieldName()" because the return value of "org.dspace.content.authority.DSpaceControlledVocabularyIndex.getFacetConfig()" is null
+
+- I reverted to the default
submission-forms.xml
and the getFacetConfig()
error goes away…
+- Kill some long-held locks on CGSpace PostgreSQL, as some users are complaining of slowness in archiving
+- I did some testing of the LDAP login issue related to groupmaps
+
+
+- I spent some time on working on Angular and I figured out how to add a custom Angular component to show the UN SDG Goal icons on DSpace 7
+
+2023-06-27
+
+- I debugged the NullPointerException and somehow it disappeared
+
+- It seems to be related to the external controlled vocabularies in the submission form
+- I removed them all, then added them all back, and now the issue is solved… hmmmm
+- Oh now, now they are gone again, sigh…
+
+
+
+2023-06-28
+
+- Spent a lot of time debugging the browse indexes
+
+- Looking at the DSpace 7 demo API I see the four default browse indexes from
dspace.cfg
and the one default srsc
one that gets automatically enabled from the <vocabulary>srsc</vocabulary>
in the submission-forms.xml
+- The same API call on my test DSpace 7 configuration results in the HTTP 500 I’ve been seeing for some time, and I am pretty sure it’s due to the automagic configuration of hierarchical browses based on the submission form
+- Yes, if I remove them all from my submission form then this works: http://localhost:8080/server/api/discover/browses
+- I went through each of our vocabularies and tested them one by one:
+
+- dcterms-subject: OK
+- dc-contributor-author: NO
+- cg-creator-identifier: NO
+- cg-contributor-affiliation: OK (and with
facetType: "affiliation"
in API response?!)
+- cg-contributor-donor: OK (
facetType: "sponsorship"
)
+- cg-journal: NO
+- cg-coverage-subregion: NO
+- cg-species-breed: NO
+
+
+- Now I need to figure out what it is about those five that causes them to not work!
+- Ah, after debugging with someone on the DSpace Slack, I realized that DSpace expects these vocabularies to have corresponding indexes configured in
discovery.xml
, and they must be added as search filters AND sidebar facets.
+
+
+
diff --git a/docs/categories/index.html b/docs/categories/index.html
index e790d1d70..78a072479 100644
--- a/docs/categories/index.html
+++ b/docs/categories/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/categories/notes/index.html b/docs/categories/notes/index.html
index 155ab9ece..0f2dcf969 100644
--- a/docs/categories/notes/index.html
+++ b/docs/categories/notes/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/categories/notes/page/2/index.html b/docs/categories/notes/page/2/index.html
index 60a7c1943..fd27bfcf9 100644
--- a/docs/categories/notes/page/2/index.html
+++ b/docs/categories/notes/page/2/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/categories/notes/page/3/index.html b/docs/categories/notes/page/3/index.html
index e040a68d7..2213621bf 100644
--- a/docs/categories/notes/page/3/index.html
+++ b/docs/categories/notes/page/3/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/categories/notes/page/4/index.html b/docs/categories/notes/page/4/index.html
index 3ed326f1e..24d9267fe 100644
--- a/docs/categories/notes/page/4/index.html
+++ b/docs/categories/notes/page/4/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/categories/notes/page/5/index.html b/docs/categories/notes/page/5/index.html
index aeec3adc5..cec0266a0 100644
--- a/docs/categories/notes/page/5/index.html
+++ b/docs/categories/notes/page/5/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/categories/notes/page/6/index.html b/docs/categories/notes/page/6/index.html
index c73124405..eee9db724 100644
--- a/docs/categories/notes/page/6/index.html
+++ b/docs/categories/notes/page/6/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/categories/notes/page/7/index.html b/docs/categories/notes/page/7/index.html
index 87e7f96b6..ad1a12adc 100644
--- a/docs/categories/notes/page/7/index.html
+++ b/docs/categories/notes/page/7/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/categories/notes/page/8/index.html b/docs/categories/notes/page/8/index.html
index 136183dcb..681439ec2 100644
--- a/docs/categories/notes/page/8/index.html
+++ b/docs/categories/notes/page/8/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/index.html b/docs/index.html
index 04545a8c8..0a7435742 100644
--- a/docs/index.html
+++ b/docs/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/page/10/index.html b/docs/page/10/index.html
index 3cab8fb3e..d487e2efe 100644
--- a/docs/page/10/index.html
+++ b/docs/page/10/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/page/2/index.html b/docs/page/2/index.html
index 7461882aa..11aa35f53 100644
--- a/docs/page/2/index.html
+++ b/docs/page/2/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/page/3/index.html b/docs/page/3/index.html
index f442b0d9d..ab387d787 100644
--- a/docs/page/3/index.html
+++ b/docs/page/3/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/page/4/index.html b/docs/page/4/index.html
index c625180f7..4680aeaa1 100644
--- a/docs/page/4/index.html
+++ b/docs/page/4/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/page/5/index.html b/docs/page/5/index.html
index 21a15d485..a89d80e8c 100644
--- a/docs/page/5/index.html
+++ b/docs/page/5/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/page/6/index.html b/docs/page/6/index.html
index 8f3f489bb..e0d00300d 100644
--- a/docs/page/6/index.html
+++ b/docs/page/6/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/page/7/index.html b/docs/page/7/index.html
index 6c0c88b74..577306b66 100644
--- a/docs/page/7/index.html
+++ b/docs/page/7/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/page/8/index.html b/docs/page/8/index.html
index d31654548..c338aef8e 100644
--- a/docs/page/8/index.html
+++ b/docs/page/8/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/page/9/index.html b/docs/page/9/index.html
index e62e91dd6..bd94806ca 100644
--- a/docs/page/9/index.html
+++ b/docs/page/9/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/posts/index.html b/docs/posts/index.html
index bf1274528..81ecf0109 100644
--- a/docs/posts/index.html
+++ b/docs/posts/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/posts/page/10/index.html b/docs/posts/page/10/index.html
index 6caa0e301..1eb3a268f 100644
--- a/docs/posts/page/10/index.html
+++ b/docs/posts/page/10/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/posts/page/2/index.html b/docs/posts/page/2/index.html
index dd718fbcf..58c742edd 100644
--- a/docs/posts/page/2/index.html
+++ b/docs/posts/page/2/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/posts/page/3/index.html b/docs/posts/page/3/index.html
index 666787ab2..518b775a8 100644
--- a/docs/posts/page/3/index.html
+++ b/docs/posts/page/3/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/posts/page/4/index.html b/docs/posts/page/4/index.html
index bc906d9d1..6aa16f851 100644
--- a/docs/posts/page/4/index.html
+++ b/docs/posts/page/4/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/posts/page/5/index.html b/docs/posts/page/5/index.html
index 817df2e9e..0229af219 100644
--- a/docs/posts/page/5/index.html
+++ b/docs/posts/page/5/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/posts/page/6/index.html b/docs/posts/page/6/index.html
index b85401615..fa6d05763 100644
--- a/docs/posts/page/6/index.html
+++ b/docs/posts/page/6/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/posts/page/7/index.html b/docs/posts/page/7/index.html
index 2963da631..2fb8a7efe 100644
--- a/docs/posts/page/7/index.html
+++ b/docs/posts/page/7/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/posts/page/8/index.html b/docs/posts/page/8/index.html
index d0affe7f1..aa2ebad6e 100644
--- a/docs/posts/page/8/index.html
+++ b/docs/posts/page/8/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/posts/page/9/index.html b/docs/posts/page/9/index.html
index d927384f0..f111b684b 100644
--- a/docs/posts/page/9/index.html
+++ b/docs/posts/page/9/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/sitemap.xml b/docs/sitemap.xml
index 67f3d2dc4..7e2f4d58b 100644
--- a/docs/sitemap.xml
+++ b/docs/sitemap.xml
@@ -3,19 +3,19 @@
xmlns:xhtml="http://www.w3.org/1999/xhtml">
https://alanorth.github.io/cgspace-notes/categories/
- 2023-06-17T23:14:32+03:00
+ 2023-06-19T16:26:41+03:00
https://alanorth.github.io/cgspace-notes/
- 2023-06-17T23:14:32+03:00
+ 2023-06-19T16:26:41+03:00
https://alanorth.github.io/cgspace-notes/2023-06/
- 2023-06-17T23:14:32+03:00
+ 2023-06-19T16:26:41+03:00
https://alanorth.github.io/cgspace-notes/categories/notes/
- 2023-06-17T23:14:32+03:00
+ 2023-06-19T16:26:41+03:00
https://alanorth.github.io/cgspace-notes/posts/
- 2023-06-17T23:14:32+03:00
+ 2023-06-19T16:26:41+03:00
https://alanorth.github.io/cgspace-notes/2023-05/
2023-05-30T20:19:17+03:00