diff --git a/content/posts/2019-07.md b/content/posts/2019-07.md
index c91ab6bc2..59f313d5b 100644
--- a/content/posts/2019-07.md
+++ b/content/posts/2019-07.md
@@ -8,7 +8,63 @@ tags: ["Notes"]
## 2019-07-01
- Create an "AfricaRice books and book chapters" collection on CGSpace for AfricaRice
+- Last month Sisay asked why the following "most popular" statistics link for a range of months in 2018 works for the CIAT community on DSpace Test, but not on CGSpace:
+ - [DSpace Test](https://dspacetest.cgiar.org/handle/10568/35697/most-popular/item#simplefilter=custom&time_filter_end_date=01%2F12%2F2018)
+ - [CGSpace](https://cgspace.cgiar.org/handle/10568/35697/most-popular/item#simplefilter=custom&time_filter_end_date=01%2F12%2F2018)
+- Abenet had another similar issue a few days ago when trying to find the stats for 2018 in the RTB community
+- If I change the parameters to 2019 I see stats, so I'm really thinking it has something to do with the sharded yearly Solr statistics cores
+ - I checked the Solr admin UI and I see all Solr cores loaded, so I don't know what it could be
+ - When I check the Atmire content and usage module it seems obvious that there is a problem with the old cores because I dont have anything before 2019-01
+
+![Atmire CUA 2018 stats missing](/cgspace-notes/2019/07/atmire-cua-2018-missing.png)
+
+- I don't see anyone logged in right now so I'm going to try to restart Tomcat and see if the stats are accessible after Solr comes back up
+- I decided to run all system updates on the server (linode18) and reboot it
+ - After rebooting Tomcat came back up, but the the Solr statistics cores were not all loaded
+ - The error is always (with a different core):
+
+```
+org.apache.solr.common.SolrException: Error CREATEing SolrCore 'statistics-2010': Unable to create core [statistics-2010] Caused by: Lock obtain timed out: NativeFSLock@/home/cgspace.cgiar.org/solr/statistics-2010/data/index/write.lock
+```
+
+- I restarted Tomcat *ten times* and it never worked...
+- I tried to stop Tomcat and delete the write locks:
+
+```
+# systemctl stop tomcat7
+# find /dspace/solr/statistics* -iname "*.lock" -print -delete
+/dspace/solr/statistics/data/index/write.lock
+/dspace/solr/statistics-2010/data/index/write.lock
+/dspace/solr/statistics-2011/data/index/write.lock
+/dspace/solr/statistics-2012/data/index/write.lock
+/dspace/solr/statistics-2013/data/index/write.lock
+/dspace/solr/statistics-2014/data/index/write.lock
+/dspace/solr/statistics-2015/data/index/write.lock
+/dspace/solr/statistics-2016/data/index/write.lock
+/dspace/solr/statistics-2017/data/index/write.lock
+/dspace/solr/statistics-2018/data/index/write.lock
+# find /dspace/solr/statistics* -iname "*.lock" -print -delete
+# systemctl start tomcat7
+```
+
+- But it still didn't work!
+- I stopped Tomcat, deleted the old locks, and will try to use the "simple" lock file type in `solr/statistics/conf/solrconfig.xml`:
+
+```
+${solr.lock.type:simple}
+```
+
+- And after restarting Tomcat it still doesn't work
+- Now I'll try going back to "native" locking with `unlockAtStartup`:
+
+```
+true
+```
+
+- Now the cores seem to load, but I still see an error in the Solr Admin UI and I still can't access any stats before 2018
+- I filed an [issue with Atmire](https://tracker.atmire.com/tickets-cgiar-ilri/view-ticket?id=685), so let's see if they can help
+
diff --git a/docs/2019-07/index.html b/docs/2019-07/index.html
index 75fa59c90..5ece46ee1 100644
--- a/docs/2019-07/index.html
+++ b/docs/2019-07/index.html
@@ -10,11 +10,18 @@
Create an “AfricaRice books and book chapters” collection on CGSpace for AfricaRice
+Last month Sisay asked why the following “most popular” statistics link for a range of months in 2018 works for the CIAT community on DSpace Test, but not on CGSpace:
+
+
+DSpace Test
+CGSpace
+
+Abenet had another similar issue a few days ago when trying to find the stats for 2018 in the RTB community
" />
-
+
@@ -22,6 +29,13 @@ Create an “AfricaRice books and book chapters” collection on CGSpace
Create an “AfricaRice books and book chapters” collection on CGSpace for AfricaRice
+Last month Sisay asked why the following “most popular” statistics link for a range of months in 2018 works for the CIAT community on DSpace Test, but not on CGSpace:
+
+
+DSpace Test
+CGSpace
+
+Abenet had another similar issue a few days ago when trying to find the stats for 2018 in the RTB community
"/>
@@ -33,9 +47,9 @@ Create an “AfricaRice books and book chapters” collection on CGSpace
"@type": "BlogPosting",
"headline": "July, 2019",
"url": "https:\/\/alanorth.github.io\/cgspace-notes\/2019-07\/",
- "wordCount": "13",
+ "wordCount": "359",
"datePublished": "2019-07-01T12:13:51\x2b03:00",
- "dateModified": "2019-07-01T12:13:51\x2b03:00",
+ "dateModified": "2019-07-01T12:22:43\x2b03:00",
"author": {
"@type": "Person",
"name": "Alan Orth"
@@ -106,6 +120,77 @@ Create an “AfricaRice books and book chapters” collection on CGSpace
- Create an “AfricaRice books and book chapters” collection on CGSpace for AfricaRice
+- Last month Sisay asked why the following “most popular” statistics link for a range of months in 2018 works for the CIAT community on DSpace Test, but not on CGSpace:
+
+
+- Abenet had another similar issue a few days ago when trying to find the stats for 2018 in the RTB community
+
+
+
+- If I change the parameters to 2019 I see stats, so I’m really thinking it has something to do with the sharded yearly Solr statistics cores
+
+
+- I checked the Solr admin UI and I see all Solr cores loaded, so I don’t know what it could be
+- When I check the Atmire content and usage module it seems obvious that there is a problem with the old cores because I dont have anything before 2019-01
+
+
+
+
+
+
+- I don’t see anyone logged in right now so I’m going to try to restart Tomcat and see if the stats are accessible after Solr comes back up
+
+I decided to run all system updates on the server (linode18) and reboot it
+
+
+- After rebooting Tomcat came back up, but the the Solr statistics cores were not all loaded
+
+The error is always (with a different core):
+
+org.apache.solr.common.SolrException: Error CREATEing SolrCore 'statistics-2010': Unable to create core [statistics-2010] Caused by: Lock obtain timed out: NativeFSLock@/home/cgspace.cgiar.org/solr/statistics-2010/data/index/write.lock
+
+
+
+I restarted Tomcat ten times and it never worked…
+
+I tried to stop Tomcat and delete the write locks:
+
+# systemctl stop tomcat7
+# find /dspace/solr/statistics* -iname "*.lock" -print -delete
+/dspace/solr/statistics/data/index/write.lock
+/dspace/solr/statistics-2010/data/index/write.lock
+/dspace/solr/statistics-2011/data/index/write.lock
+/dspace/solr/statistics-2012/data/index/write.lock
+/dspace/solr/statistics-2013/data/index/write.lock
+/dspace/solr/statistics-2014/data/index/write.lock
+/dspace/solr/statistics-2015/data/index/write.lock
+/dspace/solr/statistics-2016/data/index/write.lock
+/dspace/solr/statistics-2017/data/index/write.lock
+/dspace/solr/statistics-2018/data/index/write.lock
+# find /dspace/solr/statistics* -iname "*.lock" -print -delete
+# systemctl start tomcat7
+
+
+But it still didn’t work!
+
+I stopped Tomcat, deleted the old locks, and will try to use the “simple” lock file type in solr/statistics/conf/solrconfig.xml
:
+
+<lockType>${solr.lock.type:simple}</lockType>
+
+
+And after restarting Tomcat it still doesn’t work
+
+Now I’ll try going back to “native” locking with unlockAtStartup
:
+
+<unlockOnStartup>true</unlockOnStartup>
+
+
+Now the cores seem to load, but I still see an error in the Solr Admin UI and I still can’t access any stats before 2018
+
+I filed an issue with Atmire, so let’s see if they can help
diff --git a/docs/2019/07/atmire-cua-2018-missing.png b/docs/2019/07/atmire-cua-2018-missing.png
new file mode 100644
index 000000000..eced2d3ec
Binary files /dev/null and b/docs/2019/07/atmire-cua-2018-missing.png differ
diff --git a/docs/categories/index.html b/docs/categories/index.html
index 044b8d591..e07845d13 100644
--- a/docs/categories/index.html
+++ b/docs/categories/index.html
@@ -102,6 +102,13 @@
- Create an “AfricaRice books and book chapters” collection on CGSpace for AfricaRice
+- Last month Sisay asked why the following “most popular” statistics link for a range of months in 2018 works for the CIAT community on DSpace Test, but not on CGSpace:
+
+
+- Abenet had another similar issue a few days ago when trying to find the stats for 2018 in the RTB community
Read more →
diff --git a/docs/index.html b/docs/index.html
index 1d4aed78b..28d96c890 100644
--- a/docs/index.html
+++ b/docs/index.html
@@ -102,6 +102,13 @@
- Create an “AfricaRice books and book chapters” collection on CGSpace for AfricaRice
+- Last month Sisay asked why the following “most popular” statistics link for a range of months in 2018 works for the CIAT community on DSpace Test, but not on CGSpace:
+
+
+- Abenet had another similar issue a few days ago when trying to find the stats for 2018 in the RTB community
Read more →
diff --git a/docs/index.xml b/docs/index.xml
index eab979acc..4466feb44 100644
--- a/docs/index.xml
+++ b/docs/index.xml
@@ -21,6 +21,13 @@
<ul>
<li>Create an “AfricaRice books and book chapters” collection on CGSpace for AfricaRice</li>
+<li>Last month Sisay asked why the following “most popular” statistics link for a range of months in 2018 works for the CIAT community on DSpace Test, but not on CGSpace:
+
+<ul>
+<li><a href="https://dspacetest.cgiar.org/handle/10568/35697/most-popular/item#simplefilter=custom&time_filter_end_date=01%2F12%2F2018">DSpace Test</a></li>
+<li><a href="https://cgspace.cgiar.org/handle/10568/35697/most-popular/item#simplefilter=custom&time_filter_end_date=01%2F12%2F2018">CGSpace</a></li>
+</ul></li>
+<li>Abenet had another similar issue a few days ago when trying to find the stats for 2018 in the RTB community</li>
</ul>
diff --git a/docs/posts/index.html b/docs/posts/index.html
index 902ea9f49..b8917ca11 100644
--- a/docs/posts/index.html
+++ b/docs/posts/index.html
@@ -102,6 +102,13 @@
- Create an “AfricaRice books and book chapters” collection on CGSpace for AfricaRice
+- Last month Sisay asked why the following “most popular” statistics link for a range of months in 2018 works for the CIAT community on DSpace Test, but not on CGSpace:
+
+
+- Abenet had another similar issue a few days ago when trying to find the stats for 2018 in the RTB community
Read more →
diff --git a/docs/posts/index.xml b/docs/posts/index.xml
index 21ad109f7..57b2d8f2a 100644
--- a/docs/posts/index.xml
+++ b/docs/posts/index.xml
@@ -21,6 +21,13 @@
<ul>
<li>Create an “AfricaRice books and book chapters” collection on CGSpace for AfricaRice</li>
+<li>Last month Sisay asked why the following “most popular” statistics link for a range of months in 2018 works for the CIAT community on DSpace Test, but not on CGSpace:
+
+<ul>
+<li><a href="https://dspacetest.cgiar.org/handle/10568/35697/most-popular/item#simplefilter=custom&time_filter_end_date=01%2F12%2F2018">DSpace Test</a></li>
+<li><a href="https://cgspace.cgiar.org/handle/10568/35697/most-popular/item#simplefilter=custom&time_filter_end_date=01%2F12%2F2018">CGSpace</a></li>
+</ul></li>
+<li>Abenet had another similar issue a few days ago when trying to find the stats for 2018 in the RTB community</li>
</ul>
diff --git a/docs/sitemap.xml b/docs/sitemap.xml
index f8cfaf401..f16cd1650 100644
--- a/docs/sitemap.xml
+++ b/docs/sitemap.xml
@@ -4,30 +4,30 @@
https://alanorth.github.io/cgspace-notes/
- 2019-07-01T12:14:35+03:00
+ 2019-07-01T12:22:43+03:00
0
https://alanorth.github.io/cgspace-notes/2019-07/
- 2019-07-01T12:13:51+03:00
+ 2019-07-01T12:22:43+03:00
https://alanorth.github.io/cgspace-notes/tags/notes/
- 2019-07-01T12:14:35+03:00
+ 2019-07-01T12:22:43+03:00
0
https://alanorth.github.io/cgspace-notes/posts/
- 2019-07-01T12:14:35+03:00
+ 2019-07-01T12:22:43+03:00
0
https://alanorth.github.io/cgspace-notes/tags/
- 2019-07-01T12:14:35+03:00
+ 2019-07-01T12:22:43+03:00
0
diff --git a/docs/tags/index.html b/docs/tags/index.html
index 6a3646ce2..9bde05b5c 100644
--- a/docs/tags/index.html
+++ b/docs/tags/index.html
@@ -102,6 +102,13 @@
- Create an “AfricaRice books and book chapters” collection on CGSpace for AfricaRice
+- Last month Sisay asked why the following “most popular” statistics link for a range of months in 2018 works for the CIAT community on DSpace Test, but not on CGSpace:
+
+
+- Abenet had another similar issue a few days ago when trying to find the stats for 2018 in the RTB community
Read more →
diff --git a/docs/tags/notes/index.html b/docs/tags/notes/index.html
index 4957b31f5..d14f90ded 100644
--- a/docs/tags/notes/index.html
+++ b/docs/tags/notes/index.html
@@ -87,6 +87,13 @@
- Create an “AfricaRice books and book chapters” collection on CGSpace for AfricaRice
+- Last month Sisay asked why the following “most popular” statistics link for a range of months in 2018 works for the CIAT community on DSpace Test, but not on CGSpace:
+
+
+- Abenet had another similar issue a few days ago when trying to find the stats for 2018 in the RTB community
Read more →
diff --git a/docs/tags/notes/index.xml b/docs/tags/notes/index.xml
index 36eeef72f..a996ab8b8 100644
--- a/docs/tags/notes/index.xml
+++ b/docs/tags/notes/index.xml
@@ -21,6 +21,13 @@
<ul>
<li>Create an “AfricaRice books and book chapters” collection on CGSpace for AfricaRice</li>
+<li>Last month Sisay asked why the following “most popular” statistics link for a range of months in 2018 works for the CIAT community on DSpace Test, but not on CGSpace:
+
+<ul>
+<li><a href="https://dspacetest.cgiar.org/handle/10568/35697/most-popular/item#simplefilter=custom&time_filter_end_date=01%2F12%2F2018">DSpace Test</a></li>
+<li><a href="https://cgspace.cgiar.org/handle/10568/35697/most-popular/item#simplefilter=custom&time_filter_end_date=01%2F12%2F2018">CGSpace</a></li>
+</ul></li>
+<li>Abenet had another similar issue a few days ago when trying to find the stats for 2018 in the RTB community</li>
</ul>
diff --git a/static/2019/07/atmire-cua-2018-missing.png b/static/2019/07/atmire-cua-2018-missing.png
new file mode 100644
index 000000000..eced2d3ec
Binary files /dev/null and b/static/2019/07/atmire-cua-2018-missing.png differ