diff --git a/content/posts/2020-12.md b/content/posts/2020-12.md
index 5b1f55297..9a59d2159 100644
--- a/content/posts/2020-12.md
+++ b/content/posts/2020-12.md
@@ -130,4 +130,58 @@ Caused by: java.lang.UnsupportedOperationException
... 10 more
```
+- I sent some feedback to Atmire
+ - They responded with an updated CUA (6.x-4.1.10-ilri-RC7) that has a fix for the duplicates processor _and_ a possible fix for the database locking issues (a bug in CUASolrLoggerServiceImpl that causes an infinite loop and a Tomcat timeout)
+ - I deployed the changes on DSpace Test and CGSpace, hopefully it will fix both issues!
+- In other news, after I restarted Tomcat on CGSpace the statistics-2013 core didn't come back up properly, so I exported it and imported it into the main statistics core like I did for the others a few days ago
+- Sync DSpace Test with CGSpace's Solr, PostgreSQL database, and assetstore...
+
+## 2020-12-09
+
+- I was running the AtomicStatisticsUpdateCLI to remove duplicates on DSpace Test but it failed near the end of the statistics core (after 20 hours or so) with a memory error:
+
+```
+Successfully finished updating Solr Storage Reports | Wed Dec 09 15:25:11 CET 2020
+Run 1 — 67% — 10,000/14,935 docs — 6m 6s — 6m 6s
+Exception: GC overhead limit exceeded
+java.lang.OutOfMemoryError: GC overhead limit exceeded
+ at org.noggit.CharArr.toString(CharArr.java:164)
+```
+
+- I increased the JVM heap to 2048m and tried again, but it failed with a memory error again...
+- I increased the JVM heap to 4096m and tried again, but it failed with another error:
+
+```
+Successfully finished updating Solr Storage Reports | Wed Dec 09 15:53:40 CET 2020
+Exception: parsing error
+org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: parsing error
+ at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:530)
+ at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
+ at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
+ at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:91)
+ at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
+ at com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdater.getNextSetOfSolrDocuments(SourceFile:392)
+ at com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdater.performRun(SourceFile:157)
+ at com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdater.update(SourceFile:128)
+ at com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdateCLI.main(SourceFile:78)
+ at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
+ at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
+ at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
+ at java.lang.reflect.Method.invoke(Method.java:498)
+ at org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:229)
+ at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:81)
+Caused by: org.apache.solr.common.SolrException: parsing error
+ at org.apache.solr.client.solrj.impl.BinaryResponseParser.processResponse(BinaryResponseParser.java:45)
+ at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:528)
+ ... 14 more
+Caused by: org.apache.http.TruncatedChunkException: Truncated chunk ( expected size: 8192; actual size: 2843)
+ at org.apache.http.impl.io.ChunkedInputStream.read(ChunkedInputStream.java:200)
+ at org.apache.http.conn.EofSensorInputStream.read(EofSensorInputStream.java:137)
+ at org.apache.solr.common.util.FastInputStream.readWrappedStream(FastInputStream.java:80)
+ at org.apache.solr.common.util.FastInputStream.refill(FastInputStream.java:89)
+ at org.apache.solr.common.util.FastInputStream.read(FastInputStream.java:125)
+ at org.apache.solr.common.util.FastInputStream.readFully(FastInputStream.java:152)
+...
+```
+
diff --git a/docs/2020-12/index.html b/docs/2020-12/index.html
index 0b7c27433..55bafaa40 100644
--- a/docs/2020-12/index.html
+++ b/docs/2020-12/index.html
@@ -20,7 +20,7 @@ I started processing those (about 411,000 records):
-
+
@@ -46,9 +46,9 @@ I started processing those (about 411,000 records):
"@type": "BlogPosting",
"headline": "December, 2020",
"url": "https://alanorth.github.io/cgspace-notes/2020-12/",
- "wordCount": "754",
+ "wordCount": "1051",
"datePublished": "2020-12-01T11:32:54+02:00",
- "dateModified": "2020-12-06T16:53:29+02:00",
+ "dateModified": "2020-12-08T11:14:33+02:00",
"author": {
"@type": "Person",
"name": "Alan Orth"
@@ -256,6 +256,59 @@ Caused by: java.lang.UnsupportedOperationException
at com.atmire.statistics.util.update.atomic.record.UsageRecord.accept(SourceFile:23)
at com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdater.applyProcessors(SourceFile:301)
... 10 more
+
+- I sent some feedback to Atmire
+
+- They responded with an updated CUA (6.x-4.1.10-ilri-RC7) that has a fix for the duplicates processor and a possible fix for the database locking issues (a bug in CUASolrLoggerServiceImpl that causes an infinite loop and a Tomcat timeout)
+- I deployed the changes on DSpace Test and CGSpace, hopefully it will fix both issues!
+
+
+- In other news, after I restarted Tomcat on CGSpace the statistics-2013 core didn’t come back up properly, so I exported it and imported it into the main statistics core like I did for the others a few days ago
+- Sync DSpace Test with CGSpace’s Solr, PostgreSQL database, and assetstore…
+
+2020-12-09
+
+- I was running the AtomicStatisticsUpdateCLI to remove duplicates on DSpace Test but it failed near the end of the statistics core (after 20 hours or so) with a memory error:
+
+Successfully finished updating Solr Storage Reports | Wed Dec 09 15:25:11 CET 2020
+Run 1 — 67% — 10,000/14,935 docs — 6m 6s — 6m 6s
+Exception: GC overhead limit exceeded
+java.lang.OutOfMemoryError: GC overhead limit exceeded
+ at org.noggit.CharArr.toString(CharArr.java:164)
+
+- I increased the JVM heap to 2048m and tried again, but it failed with a memory error again…
+- I increased the JVM heap to 4096m and tried again, but it failed with another error:
+
+Successfully finished updating Solr Storage Reports | Wed Dec 09 15:53:40 CET 2020
+Exception: parsing error
+org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: parsing error
+ at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:530)
+ at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
+ at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
+ at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:91)
+ at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
+ at com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdater.getNextSetOfSolrDocuments(SourceFile:392)
+ at com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdater.performRun(SourceFile:157)
+ at com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdater.update(SourceFile:128)
+ at com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdateCLI.main(SourceFile:78)
+ at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
+ at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
+ at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
+ at java.lang.reflect.Method.invoke(Method.java:498)
+ at org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:229)
+ at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:81)
+Caused by: org.apache.solr.common.SolrException: parsing error
+ at org.apache.solr.client.solrj.impl.BinaryResponseParser.processResponse(BinaryResponseParser.java:45)
+ at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:528)
+ ... 14 more
+Caused by: org.apache.http.TruncatedChunkException: Truncated chunk ( expected size: 8192; actual size: 2843)
+ at org.apache.http.impl.io.ChunkedInputStream.read(ChunkedInputStream.java:200)
+ at org.apache.http.conn.EofSensorInputStream.read(EofSensorInputStream.java:137)
+ at org.apache.solr.common.util.FastInputStream.readWrappedStream(FastInputStream.java:80)
+ at org.apache.solr.common.util.FastInputStream.refill(FastInputStream.java:89)
+ at org.apache.solr.common.util.FastInputStream.read(FastInputStream.java:125)
+ at org.apache.solr.common.util.FastInputStream.readFully(FastInputStream.java:152)
+...
diff --git a/docs/categories/index.html b/docs/categories/index.html
index 96197f016..2d4c891d1 100644
--- a/docs/categories/index.html
+++ b/docs/categories/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/categories/notes/index.html b/docs/categories/notes/index.html
index 3e4a09c82..4ee10ff84 100644
--- a/docs/categories/notes/index.html
+++ b/docs/categories/notes/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/categories/notes/page/2/index.html b/docs/categories/notes/page/2/index.html
index 2189235c2..194fbcfae 100644
--- a/docs/categories/notes/page/2/index.html
+++ b/docs/categories/notes/page/2/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/categories/notes/page/3/index.html b/docs/categories/notes/page/3/index.html
index 1ff9b1a1f..1beffbc33 100644
--- a/docs/categories/notes/page/3/index.html
+++ b/docs/categories/notes/page/3/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/categories/notes/page/4/index.html b/docs/categories/notes/page/4/index.html
index 7e6d6097a..5a94083ef 100644
--- a/docs/categories/notes/page/4/index.html
+++ b/docs/categories/notes/page/4/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/categories/notes/page/5/index.html b/docs/categories/notes/page/5/index.html
index cfe1cae23..dc4de5ac3 100644
--- a/docs/categories/notes/page/5/index.html
+++ b/docs/categories/notes/page/5/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/index.html b/docs/index.html
index bcf75cd80..593599782 100644
--- a/docs/index.html
+++ b/docs/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/page/2/index.html b/docs/page/2/index.html
index f9afc23bb..92cf3013d 100644
--- a/docs/page/2/index.html
+++ b/docs/page/2/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/page/3/index.html b/docs/page/3/index.html
index ad1a663b6..e282ebd6e 100644
--- a/docs/page/3/index.html
+++ b/docs/page/3/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/page/4/index.html b/docs/page/4/index.html
index 4a7a00d71..471052051 100644
--- a/docs/page/4/index.html
+++ b/docs/page/4/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/page/5/index.html b/docs/page/5/index.html
index 60ff04a19..6dd521a49 100644
--- a/docs/page/5/index.html
+++ b/docs/page/5/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/page/6/index.html b/docs/page/6/index.html
index 9598a3617..0dccb050c 100644
--- a/docs/page/6/index.html
+++ b/docs/page/6/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/page/7/index.html b/docs/page/7/index.html
index ce0cdc61a..3fd0abf0f 100644
--- a/docs/page/7/index.html
+++ b/docs/page/7/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/posts/index.html b/docs/posts/index.html
index 03b491997..6c59407d7 100644
--- a/docs/posts/index.html
+++ b/docs/posts/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/posts/page/2/index.html b/docs/posts/page/2/index.html
index 76135b94b..e883c5896 100644
--- a/docs/posts/page/2/index.html
+++ b/docs/posts/page/2/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/posts/page/3/index.html b/docs/posts/page/3/index.html
index b83e36cb5..52d62bec0 100644
--- a/docs/posts/page/3/index.html
+++ b/docs/posts/page/3/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/posts/page/4/index.html b/docs/posts/page/4/index.html
index 57f3be449..32614522a 100644
--- a/docs/posts/page/4/index.html
+++ b/docs/posts/page/4/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/posts/page/5/index.html b/docs/posts/page/5/index.html
index 82af608d0..e619dbf20 100644
--- a/docs/posts/page/5/index.html
+++ b/docs/posts/page/5/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/posts/page/6/index.html b/docs/posts/page/6/index.html
index e51f67333..24d7c5db7 100644
--- a/docs/posts/page/6/index.html
+++ b/docs/posts/page/6/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/posts/page/7/index.html b/docs/posts/page/7/index.html
index 14ce14236..4805d6bfe 100644
--- a/docs/posts/page/7/index.html
+++ b/docs/posts/page/7/index.html
@@ -10,7 +10,7 @@
-
+
diff --git a/docs/sitemap.xml b/docs/sitemap.xml
index adfadfeca..5efbe8807 100644
--- a/docs/sitemap.xml
+++ b/docs/sitemap.xml
@@ -4,27 +4,27 @@
https://alanorth.github.io/cgspace-notes/categories/
- 2020-12-06T16:53:29+02:00
+ 2020-12-08T11:14:33+02:00
https://alanorth.github.io/cgspace-notes/
- 2020-12-06T16:53:29+02:00
+ 2020-12-08T11:14:33+02:00
https://alanorth.github.io/cgspace-notes/2020-12/
- 2020-12-06T16:53:29+02:00
+ 2020-12-08T11:14:33+02:00
https://alanorth.github.io/cgspace-notes/categories/notes/
- 2020-12-06T16:53:29+02:00
+ 2020-12-08T11:14:33+02:00
https://alanorth.github.io/cgspace-notes/posts/
- 2020-12-06T16:53:29+02:00
+ 2020-12-08T11:14:33+02:00