Update notes for 2020-02-06

content/posts/2020-02.md

@@ -251,4 +251,28 @@ $ ./check-spider-hits.sh -d -p -f /tmp/jersey -s statistics -u http://localhost:
 $ for year in 2018 2017 2016 2015; do ./check-spider-hits.sh -d -p -f /tmp/jersey -s "statistics-${year}" -u http://localhost:8081/solr; done
 ```
 
+- I noticed another user agen in the logs that we should add to the list:
+
+```
+ReactorNetty/0.9.2.RELEASE
+```
+
+- I made [an issue on the COUNTER-Robots repository](https://github.com/atmire/COUNTER-Robots/issues/31)
+- I found a [nice tool for exporting and importing Solr records](https://github.com/freedev/solr-import-export-json) and it seems to workfor exporting our 2019 stats from the large statistics core!
+
+```
+$ ./run.sh -s http://localhost:8081/solr/statistics -a export -o /tmp/statistics-2019-01.json -f 'dateYearMonth:2019-01' -k uid
+$ ls -lh /tmp/statistics-2019-01.json
+-rw-rw-r-- 1 aorth aorth 3.7G Feb  6 09:26 /tmp/statistics-2019-01.json
+```
+
+- Then I tested importing this by creating a new core in my development environment:
+
+```
+$ curl 'http://localhost:8080/solr/admin/cores?action=CREATE&name=statistics-2019&instanceDir=/home/aorth/dspace63/solr/statistics&dataDir=/home/aorth/dspace63/solr/statistics-2019/data'
+$ ./run.sh -s http://localhost:8080/solr/statistics-2019 -a import -o ~/Downloads/statistics-2019-01.json -k uid
+```
+
+- This imports the records into the core, but DSpace can't see them, and when I restart Tomcat the core is not seen by Solr...
+
 <!-- vim: set sw=2 ts=2: -->

docs/2020-02/index.html

@@ -20,7 +20,7 @@ The code finally builds and runs with a fresh install
 <meta property="og:type" content="article" />
 <meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2020-02/" />
 <meta property="article:published_time" content="2020-02-02T11:56:30+02:00" />
-<meta property="article:modified_time" content="2020-02-05T18:58:04+02:00" />
+<meta property="article:modified_time" content="2020-02-06T10:01:17+02:00" />
 
 <meta name="twitter:card" content="summary"/>
 <meta name="twitter:title" content="February, 2020"/>
@@ -45,9 +45,9 @@ The code finally builds and runs with a fresh install
   "@type": "BlogPosting",
   "headline": "February, 2020",
   "url": "https:\/\/alanorth.github.io\/cgspace-notes\/2020-02\/",
-  "wordCount": "1801",
+  "wordCount": "1926",
   "datePublished": "2020-02-02T11:56:30+02:00",
-  "dateModified": "2020-02-05T18:58:04+02:00",
+  "dateModified": "2020-02-06T10:01:17+02:00",
   "author": {
     "@type": "Person",
     "name": "Alan Orth"
@@ -378,7 +378,26 @@ dspace63=# \q
 </ul>
 <pre><code>$ ./check-spider-hits.sh -d -p -f /tmp/jersey -s statistics -u http://localhost:8081/solr
 $ for year in 2018 2017 2016 2015; do ./check-spider-hits.sh -d -p -f /tmp/jersey -s &quot;statistics-${year}&quot; -u http://localhost:8081/solr; done
-</code></pre><!-- raw HTML omitted -->
+</code></pre><ul>
+<li>I noticed another user agen in the logs that we should add to the list:</li>
+</ul>
+<pre><code>ReactorNetty/0.9.2.RELEASE
+</code></pre><ul>
+<li>I made <a href="https://github.com/atmire/COUNTER-Robots/issues/31">an issue on the COUNTER-Robots repository</a></li>
+<li>I found a <a href="https://github.com/freedev/solr-import-export-json">nice tool for exporting and importing Solr records</a> and it seems to workfor exporting our 2019 stats from the large statistics core!</li>
+</ul>
+<pre><code>$ ./run.sh -s http://localhost:8081/solr/statistics -a export -o /tmp/statistics-2019-01.json -f 'dateYearMonth:2019-01' -k uid
+$ ls -lh /tmp/statistics-2019-01.json
+-rw-rw-r-- 1 aorth aorth 3.7G Feb  6 09:26 /tmp/statistics-2019-01.json
+</code></pre><ul>
+<li>Then I tested importing this by creating a new core in my development environment:</li>
+</ul>
+<pre><code>$ curl 'http://localhost:8080/solr/admin/cores?action=CREATE&amp;name=statistics-2019&amp;instanceDir=/home/aorth/dspace63/solr/statistics&amp;dataDir=/home/aorth/dspace63/solr/statistics-2019/data'
+$ ./run.sh -s http://localhost:8080/solr/statistics-2019 -a import -o ~/Downloads/statistics-2019-01.json -k uid
+</code></pre><ul>
+<li>This imports the records into the core, but DSpace can&rsquo;t see them, and when I restart Tomcat the core is not seen by Solr&hellip;</li>
+</ul>
+<!-- raw HTML omitted -->
 
   
 

docs/sitemap.xml

@@ -4,27 +4,27 @@
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/categories/</loc>
-    <lastmod>2020-02-05T18:58:04+02:00</lastmod>
+    <lastmod>2020-02-06T10:01:17+02:00</lastmod>
   </url>
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/</loc>
-    <lastmod>2020-02-05T18:58:04+02:00</lastmod>
+    <lastmod>2020-02-06T10:01:17+02:00</lastmod>
   </url>
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/2020-02/</loc>
-    <lastmod>2020-02-05T18:58:04+02:00</lastmod>
+    <lastmod>2020-02-06T10:01:17+02:00</lastmod>
   </url>
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/categories/notes/</loc>
-    <lastmod>2020-02-05T18:58:04+02:00</lastmod>
+    <lastmod>2020-02-06T10:01:17+02:00</lastmod>
   </url>
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/posts/</loc>
-    <lastmod>2020-02-05T18:58:04+02:00</lastmod>
+    <lastmod>2020-02-06T10:01:17+02:00</lastmod>
   </url>
   
   <url>