From eebea17de031b1a68280f812044f24cd8bab3ce4 Mon Sep 17 00:00:00 2001 From: Alan Orth Date: Wed, 2 Nov 2016 17:19:02 +0200 Subject: [PATCH] Update notes for 2016-11-02 --- content/post/2016-11.md | 33 +++++++++++++++++++++++++++++++++ public/2016-11/index.html | 35 +++++++++++++++++++++++++++++++++++ public/index.html | 2 +- public/index.xml | 35 +++++++++++++++++++++++++++++++++++ public/post/index.html | 2 +- public/post/index.xml | 35 +++++++++++++++++++++++++++++++++++ public/tags/notes/index.html | 2 +- public/tags/notes/index.xml | 35 +++++++++++++++++++++++++++++++++++ 8 files changed, 176 insertions(+), 3 deletions(-) diff --git a/content/post/2016-11.md b/content/post/2016-11.md index aee30a2e7..58a84f246 100644 --- a/content/post/2016-11.md +++ b/content/post/2016-11.md @@ -16,3 +16,36 @@ tags = ["Notes"] - Migrate DSpace Test to DSpace 5.5 ([notes](https://gist.github.com/alanorth/61013895c6efe7095d7f81000953d1cf) - Run all updates on DSpace Test and reboot the server - Looks like the OAI bug from DSpace 5.1 that caused validation at Base Search to fail is now fixed and DSpace Test passes validation! ([#63](https://github.com/ilri/DSpace/issues/63)) +- Indexing Discovery on DSpace Test took 332 minutes, which is like five times as long as it usually takes +- At the end it appeared to finish correctly but there were lots of errors right after it finished: + +``` +2016-11-02 15:09:48,578 INFO com.atmire.dspace.discovery.AtmireSolrService @ Wrote Collection: 10568/76454 to Index +2016-11-02 15:09:48,584 INFO com.atmire.dspace.discovery.AtmireSolrService @ Wrote Community: 10568/3202 to Index +2016-11-02 15:09:48,589 INFO com.atmire.dspace.discovery.AtmireSolrService @ Wrote Collection: 10568/76455 to Index +2016-11-02 15:09:48,590 INFO com.atmire.dspace.discovery.AtmireSolrService @ Wrote Community: 10568/51693 to Index +2016-11-02 15:09:48,590 INFO org.dspace.discovery.IndexClient @ Done with indexing +2016-11-02 15:09:48,600 INFO com.atmire.dspace.discovery.AtmireSolrService @ Wrote Collection: 10568/76456 to Index +2016-11-02 15:09:48,613 INFO org.dspace.discovery.SolrServiceImpl @ Wrote Item: 10568/55536 to Index +2016-11-02 15:09:48,616 INFO com.atmire.dspace.discovery.AtmireSolrService @ Wrote Collection: 10568/76457 to Index +2016-11-02 15:09:48,634 ERROR com.atmire.dspace.discovery.AtmireSolrService @ +java.lang.NullPointerException + at org.dspace.discovery.SearchUtils.getDiscoveryConfiguration(SourceFile:57) + at org.dspace.discovery.SolrServiceImpl.buildDocument(SolrServiceImpl.java:824) + at com.atmire.dspace.discovery.AtmireSolrService.indexContent(AtmireSolrService.java:821) + at com.atmire.dspace.discovery.AtmireSolrService.updateIndex(AtmireSolrService.java:898) + at org.dspace.discovery.SolrServiceImpl.createIndex(SolrServiceImpl.java:370) + at org.dspace.storage.rdbms.DatabaseUtils$ReindexerThread.run(DatabaseUtils.java:945) +``` + +- DSpace is still up, and a few minutes later I see the default DSpace indexer is still running +- Sure enough, looking back before the first one finished, I see output from both indexers interleaved in the log: + +``` +2016-11-02 15:09:28,545 INFO org.dspace.discovery.SolrServiceImpl @ Wrote Item: 10568/47242 to Index +2016-11-02 15:09:28,633 INFO org.dspace.discovery.SolrServiceImpl @ Wrote Item: 10568/60785 to Index +2016-11-02 15:09:28,678 INFO com.atmire.dspace.discovery.AtmireSolrService @ Processing (55695 of 55722): 43557 +2016-11-02 15:09:28,688 INFO com.atmire.dspace.discovery.AtmireSolrService @ Processing (55703 of 55722): 34476 +``` + +- I will raise a ticket with Atmire to ask them diff --git a/public/2016-11/index.html b/public/2016-11/index.html index 723acaa69..99e2ab4e0 100644 --- a/public/2016-11/index.html +++ b/public/2016-11/index.html @@ -104,6 +104,41 @@
  • Migrate DSpace Test to DSpace 5.5 (notes
  • Run all updates on DSpace Test and reboot the server
  • Looks like the OAI bug from DSpace 5.1 that caused validation at Base Search to fail is now fixed and DSpace Test passes validation! (#63)
    • +
  • Indexing Discovery on DSpace Test took 332 minutes, which is like five times as long as it usually takes
    • +
  • At the end it appeared to finish correctly but there were lots of errors right after it finished:
    • + + +
    2016-11-02 15:09:48,578 INFO  com.atmire.dspace.discovery.AtmireSolrService @ Wrote Collection: 10568/76454 to Index
+2016-11-02 15:09:48,584 INFO  com.atmire.dspace.discovery.AtmireSolrService @ Wrote Community: 10568/3202 to Index
+2016-11-02 15:09:48,589 INFO  com.atmire.dspace.discovery.AtmireSolrService @ Wrote Collection: 10568/76455 to Index
+2016-11-02 15:09:48,590 INFO  com.atmire.dspace.discovery.AtmireSolrService @ Wrote Community: 10568/51693 to Index
+2016-11-02 15:09:48,590 INFO  org.dspace.discovery.IndexClient @ Done with indexing
+2016-11-02 15:09:48,600 INFO  com.atmire.dspace.discovery.AtmireSolrService @ Wrote Collection: 10568/76456 to Index
+2016-11-02 15:09:48,613 INFO  org.dspace.discovery.SolrServiceImpl @ Wrote Item: 10568/55536 to Index
+2016-11-02 15:09:48,616 INFO  com.atmire.dspace.discovery.AtmireSolrService @ Wrote Collection: 10568/76457 to Index
+2016-11-02 15:09:48,634 ERROR com.atmire.dspace.discovery.AtmireSolrService @
+java.lang.NullPointerException
+        at org.dspace.discovery.SearchUtils.getDiscoveryConfiguration(SourceFile:57)
+        at org.dspace.discovery.SolrServiceImpl.buildDocument(SolrServiceImpl.java:824)
+        at com.atmire.dspace.discovery.AtmireSolrService.indexContent(AtmireSolrService.java:821)
+        at com.atmire.dspace.discovery.AtmireSolrService.updateIndex(AtmireSolrService.java:898)
+        at org.dspace.discovery.SolrServiceImpl.createIndex(SolrServiceImpl.java:370)
+        at org.dspace.storage.rdbms.DatabaseUtils$ReindexerThread.run(DatabaseUtils.java:945)
+
    + + + +
    2016-11-02 15:09:28,545 INFO  org.dspace.discovery.SolrServiceImpl @ Wrote Item: 10568/47242 to Index
+2016-11-02 15:09:28,633 INFO  org.dspace.discovery.SolrServiceImpl @ Wrote Item: 10568/60785 to Index
+2016-11-02 15:09:28,678 INFO  com.atmire.dspace.discovery.AtmireSolrService @ Processing (55695 of 55722): 43557
+2016-11-02 15:09:28,688 INFO  com.atmire.dspace.discovery.AtmireSolrService @ Processing (55703 of 55722): 34476
+
    + + diff --git a/public/index.html b/public/index.html index c2d6ca839..54021021e 100644 --- a/public/index.html +++ b/public/index.html @@ -88,7 +88,7 @@

    - 2016-11-01 Add dc.type to the output options for Atmire’s Listings and Reports module (#286) 2016-11-02 Migrate DSpace Test to DSpace 5.5 (notes Run all updates on DSpace Test and reboot the server Looks like the OAI bug from DSpace 5.1 that caused validation at Base Search to fail is now fixed and DSpace Test passes validation! (#63) + 2016-11-01 Add dc.type to the output options for Atmire’s Listings and Reports module (#286) 2016-11-02 Migrate DSpace Test to DSpace 5.5 (notes Run all updates on DSpace Test and reboot the server Looks like the OAI bug from DSpace 5.1 that caused validation at Base Search to fail is now fixed and DSpace Test passes validation! (#63) Indexing Discovery on DSpace Test took 332 minutes, which is like five times as long as it usually takes At the end it appeared to finish correctly but there were lots of errors right after it finished: 2016-11-02 15:09:48,578 INFO com. Read more → diff --git a/public/index.xml b/public/index.xml index 14339061b..da994b160 100644 --- a/public/index.xml +++ b/public/index.xml @@ -31,6 +31,41 @@ <li>Migrate DSpace Test to DSpace 5.5 (<a href="https://gist.github.com/alanorth/61013895c6efe7095d7f81000953d1cf">notes</a></li> <li>Run all updates on DSpace Test and reboot the server</li> <li>Looks like the OAI bug from DSpace 5.1 that caused validation at Base Search to fail is now fixed and DSpace Test passes validation! (<a href="https://github.com/ilri/DSpace/issues/63">#63</a>)</li> +<li>Indexing Discovery on DSpace Test took 332 minutes, which is like five times as long as it usually takes</li> +<li>At the end it appeared to finish correctly but there were lots of errors right after it finished:</li> +</ul> + +<pre><code>2016-11-02 15:09:48,578 INFO com.atmire.dspace.discovery.AtmireSolrService @ Wrote Collection: 10568/76454 to Index +2016-11-02 15:09:48,584 INFO com.atmire.dspace.discovery.AtmireSolrService @ Wrote Community: 10568/3202 to Index +2016-11-02 15:09:48,589 INFO com.atmire.dspace.discovery.AtmireSolrService @ Wrote Collection: 10568/76455 to Index +2016-11-02 15:09:48,590 INFO com.atmire.dspace.discovery.AtmireSolrService @ Wrote Community: 10568/51693 to Index +2016-11-02 15:09:48,590 INFO org.dspace.discovery.IndexClient @ Done with indexing +2016-11-02 15:09:48,600 INFO com.atmire.dspace.discovery.AtmireSolrService @ Wrote Collection: 10568/76456 to Index +2016-11-02 15:09:48,613 INFO org.dspace.discovery.SolrServiceImpl @ Wrote Item: 10568/55536 to Index +2016-11-02 15:09:48,616 INFO com.atmire.dspace.discovery.AtmireSolrService @ Wrote Collection: 10568/76457 to Index +2016-11-02 15:09:48,634 ERROR com.atmire.dspace.discovery.AtmireSolrService @ +java.lang.NullPointerException + at org.dspace.discovery.SearchUtils.getDiscoveryConfiguration(SourceFile:57) + at org.dspace.discovery.SolrServiceImpl.buildDocument(SolrServiceImpl.java:824) + at com.atmire.dspace.discovery.AtmireSolrService.indexContent(AtmireSolrService.java:821) + at com.atmire.dspace.discovery.AtmireSolrService.updateIndex(AtmireSolrService.java:898) + at org.dspace.discovery.SolrServiceImpl.createIndex(SolrServiceImpl.java:370) + at org.dspace.storage.rdbms.DatabaseUtils$ReindexerThread.run(DatabaseUtils.java:945) +</code></pre> + +<ul> +<li>DSpace is still up, and a few minutes later I see the default DSpace indexer is still running</li> +<li>Sure enough, looking back before the first one finished, I see output from both indexers interleaved in the log:</li> +</ul> + +<pre><code>2016-11-02 15:09:28,545 INFO org.dspace.discovery.SolrServiceImpl @ Wrote Item: 10568/47242 to Index +2016-11-02 15:09:28,633 INFO org.dspace.discovery.SolrServiceImpl @ Wrote Item: 10568/60785 to Index +2016-11-02 15:09:28,678 INFO com.atmire.dspace.discovery.AtmireSolrService @ Processing (55695 of 55722): 43557 +2016-11-02 15:09:28,688 INFO com.atmire.dspace.discovery.AtmireSolrService @ Processing (55703 of 55722): 34476 +</code></pre> + +<ul> +<li>I will raise a ticket with Atmire to ask them</li> </ul> diff --git a/public/post/index.html b/public/post/index.html index 7a07c9896..792c47945 100644 --- a/public/post/index.html +++ b/public/post/index.html @@ -88,7 +88,7 @@

    - 2016-11-01 Add dc.type to the output options for Atmire’s Listings and Reports module (#286) 2016-11-02 Migrate DSpace Test to DSpace 5.5 (notes Run all updates on DSpace Test and reboot the server Looks like the OAI bug from DSpace 5.1 that caused validation at Base Search to fail is now fixed and DSpace Test passes validation! (#63) + 2016-11-01 Add dc.type to the output options for Atmire’s Listings and Reports module (#286) 2016-11-02 Migrate DSpace Test to DSpace 5.5 (notes Run all updates on DSpace Test and reboot the server Looks like the OAI bug from DSpace 5.1 that caused validation at Base Search to fail is now fixed and DSpace Test passes validation! (#63) Indexing Discovery on DSpace Test took 332 minutes, which is like five times as long as it usually takes At the end it appeared to finish correctly but there were lots of errors right after it finished: 2016-11-02 15:09:48,578 INFO com. Read more → diff --git a/public/post/index.xml b/public/post/index.xml index 4441e2f70..9085bb389 100644 --- a/public/post/index.xml +++ b/public/post/index.xml @@ -31,6 +31,41 @@ <li>Migrate DSpace Test to DSpace 5.5 (<a href="https://gist.github.com/alanorth/61013895c6efe7095d7f81000953d1cf">notes</a></li> <li>Run all updates on DSpace Test and reboot the server</li> <li>Looks like the OAI bug from DSpace 5.1 that caused validation at Base Search to fail is now fixed and DSpace Test passes validation! (<a href="https://github.com/ilri/DSpace/issues/63">#63</a>)</li> +<li>Indexing Discovery on DSpace Test took 332 minutes, which is like five times as long as it usually takes</li> +<li>At the end it appeared to finish correctly but there were lots of errors right after it finished:</li> +</ul> + +<pre><code>2016-11-02 15:09:48,578 INFO com.atmire.dspace.discovery.AtmireSolrService @ Wrote Collection: 10568/76454 to Index +2016-11-02 15:09:48,584 INFO com.atmire.dspace.discovery.AtmireSolrService @ Wrote Community: 10568/3202 to Index +2016-11-02 15:09:48,589 INFO com.atmire.dspace.discovery.AtmireSolrService @ Wrote Collection: 10568/76455 to Index +2016-11-02 15:09:48,590 INFO com.atmire.dspace.discovery.AtmireSolrService @ Wrote Community: 10568/51693 to Index +2016-11-02 15:09:48,590 INFO org.dspace.discovery.IndexClient @ Done with indexing +2016-11-02 15:09:48,600 INFO com.atmire.dspace.discovery.AtmireSolrService @ Wrote Collection: 10568/76456 to Index +2016-11-02 15:09:48,613 INFO org.dspace.discovery.SolrServiceImpl @ Wrote Item: 10568/55536 to Index +2016-11-02 15:09:48,616 INFO com.atmire.dspace.discovery.AtmireSolrService @ Wrote Collection: 10568/76457 to Index +2016-11-02 15:09:48,634 ERROR com.atmire.dspace.discovery.AtmireSolrService @ +java.lang.NullPointerException + at org.dspace.discovery.SearchUtils.getDiscoveryConfiguration(SourceFile:57) + at org.dspace.discovery.SolrServiceImpl.buildDocument(SolrServiceImpl.java:824) + at com.atmire.dspace.discovery.AtmireSolrService.indexContent(AtmireSolrService.java:821) + at com.atmire.dspace.discovery.AtmireSolrService.updateIndex(AtmireSolrService.java:898) + at org.dspace.discovery.SolrServiceImpl.createIndex(SolrServiceImpl.java:370) + at org.dspace.storage.rdbms.DatabaseUtils$ReindexerThread.run(DatabaseUtils.java:945) +</code></pre> + +<ul> +<li>DSpace is still up, and a few minutes later I see the default DSpace indexer is still running</li> +<li>Sure enough, looking back before the first one finished, I see output from both indexers interleaved in the log:</li> +</ul> + +<pre><code>2016-11-02 15:09:28,545 INFO org.dspace.discovery.SolrServiceImpl @ Wrote Item: 10568/47242 to Index +2016-11-02 15:09:28,633 INFO org.dspace.discovery.SolrServiceImpl @ Wrote Item: 10568/60785 to Index +2016-11-02 15:09:28,678 INFO com.atmire.dspace.discovery.AtmireSolrService @ Processing (55695 of 55722): 43557 +2016-11-02 15:09:28,688 INFO com.atmire.dspace.discovery.AtmireSolrService @ Processing (55703 of 55722): 34476 +</code></pre> + +<ul> +<li>I will raise a ticket with Atmire to ask them</li> </ul> diff --git a/public/tags/notes/index.html b/public/tags/notes/index.html index 3a3f52f83..2a12024c5 100644 --- a/public/tags/notes/index.html +++ b/public/tags/notes/index.html @@ -88,7 +88,7 @@

    - 2016-11-01 Add dc.type to the output options for Atmire’s Listings and Reports module (#286) 2016-11-02 Migrate DSpace Test to DSpace 5.5 (notes Run all updates on DSpace Test and reboot the server Looks like the OAI bug from DSpace 5.1 that caused validation at Base Search to fail is now fixed and DSpace Test passes validation! (#63) + 2016-11-01 Add dc.type to the output options for Atmire’s Listings and Reports module (#286) 2016-11-02 Migrate DSpace Test to DSpace 5.5 (notes Run all updates on DSpace Test and reboot the server Looks like the OAI bug from DSpace 5.1 that caused validation at Base Search to fail is now fixed and DSpace Test passes validation! (#63) Indexing Discovery on DSpace Test took 332 minutes, which is like five times as long as it usually takes At the end it appeared to finish correctly but there were lots of errors right after it finished: 2016-11-02 15:09:48,578 INFO com. Read more → diff --git a/public/tags/notes/index.xml b/public/tags/notes/index.xml index 60cc08e94..f1931352b 100644 --- a/public/tags/notes/index.xml +++ b/public/tags/notes/index.xml @@ -30,6 +30,41 @@ <li>Migrate DSpace Test to DSpace 5.5 (<a href="https://gist.github.com/alanorth/61013895c6efe7095d7f81000953d1cf">notes</a></li> <li>Run all updates on DSpace Test and reboot the server</li> <li>Looks like the OAI bug from DSpace 5.1 that caused validation at Base Search to fail is now fixed and DSpace Test passes validation! (<a href="https://github.com/ilri/DSpace/issues/63">#63</a>)</li> +<li>Indexing Discovery on DSpace Test took 332 minutes, which is like five times as long as it usually takes</li> +<li>At the end it appeared to finish correctly but there were lots of errors right after it finished:</li> +</ul> + +<pre><code>2016-11-02 15:09:48,578 INFO com.atmire.dspace.discovery.AtmireSolrService @ Wrote Collection: 10568/76454 to Index +2016-11-02 15:09:48,584 INFO com.atmire.dspace.discovery.AtmireSolrService @ Wrote Community: 10568/3202 to Index +2016-11-02 15:09:48,589 INFO com.atmire.dspace.discovery.AtmireSolrService @ Wrote Collection: 10568/76455 to Index +2016-11-02 15:09:48,590 INFO com.atmire.dspace.discovery.AtmireSolrService @ Wrote Community: 10568/51693 to Index +2016-11-02 15:09:48,590 INFO org.dspace.discovery.IndexClient @ Done with indexing +2016-11-02 15:09:48,600 INFO com.atmire.dspace.discovery.AtmireSolrService @ Wrote Collection: 10568/76456 to Index +2016-11-02 15:09:48,613 INFO org.dspace.discovery.SolrServiceImpl @ Wrote Item: 10568/55536 to Index +2016-11-02 15:09:48,616 INFO com.atmire.dspace.discovery.AtmireSolrService @ Wrote Collection: 10568/76457 to Index +2016-11-02 15:09:48,634 ERROR com.atmire.dspace.discovery.AtmireSolrService @ +java.lang.NullPointerException + at org.dspace.discovery.SearchUtils.getDiscoveryConfiguration(SourceFile:57) + at org.dspace.discovery.SolrServiceImpl.buildDocument(SolrServiceImpl.java:824) + at com.atmire.dspace.discovery.AtmireSolrService.indexContent(AtmireSolrService.java:821) + at com.atmire.dspace.discovery.AtmireSolrService.updateIndex(AtmireSolrService.java:898) + at org.dspace.discovery.SolrServiceImpl.createIndex(SolrServiceImpl.java:370) + at org.dspace.storage.rdbms.DatabaseUtils$ReindexerThread.run(DatabaseUtils.java:945) +</code></pre> + +<ul> +<li>DSpace is still up, and a few minutes later I see the default DSpace indexer is still running</li> +<li>Sure enough, looking back before the first one finished, I see output from both indexers interleaved in the log:</li> +</ul> + +<pre><code>2016-11-02 15:09:28,545 INFO org.dspace.discovery.SolrServiceImpl @ Wrote Item: 10568/47242 to Index +2016-11-02 15:09:28,633 INFO org.dspace.discovery.SolrServiceImpl @ Wrote Item: 10568/60785 to Index +2016-11-02 15:09:28,678 INFO com.atmire.dspace.discovery.AtmireSolrService @ Processing (55695 of 55722): 43557 +2016-11-02 15:09:28,688 INFO com.atmire.dspace.discovery.AtmireSolrService @ Processing (55703 of 55722): 34476 +</code></pre> + +<ul> +<li>I will raise a ticket with Atmire to ask them</li> </ul>