mirror of
https://github.com/alanorth/cgspace-notes.git
synced 2024-11-22 14:45:03 +01:00
Regenerate public
This commit is contained in:
parent
69b054c2ed
commit
f0b176e04a
@ -119,14 +119,6 @@ $ psql -c 'SELECT * from pg_stat_activity;' | grep idle | grep -c cgspac
|
|||||||
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
||||||
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/">CGSpace Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/notes/">Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/post/">Posts</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/">Tags</a>
|
|
||||||
|
|
||||||
|
|
||||||
</nav>
|
</nav>
|
||||||
</div>
|
</div>
|
||||||
|
@ -122,14 +122,6 @@ Replace lzop with xz in log compression cron jobs on DSpace Test—it uses less
|
|||||||
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
||||||
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/">CGSpace Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/notes/">Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/post/">Posts</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/">Tags</a>
|
|
||||||
|
|
||||||
|
|
||||||
</nav>
|
</nav>
|
||||||
</div>
|
</div>
|
||||||
|
@ -107,14 +107,6 @@ Update GitHub wiki for documentation of maintenance tasks.
|
|||||||
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
||||||
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/">CGSpace Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/notes/">Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/post/">Posts</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/">Tags</a>
|
|
||||||
|
|
||||||
|
|
||||||
</nav>
|
</nav>
|
||||||
</div>
|
</div>
|
||||||
|
@ -128,14 +128,6 @@ Also, lots of things like “COTE D`LVOIRE” and “COTE D IVOIRE&r
|
|||||||
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
||||||
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/">CGSpace Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/notes/">Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/post/">Posts</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/">Tags</a>
|
|
||||||
|
|
||||||
|
|
||||||
</nav>
|
</nav>
|
||||||
</div>
|
</div>
|
||||||
|
@ -107,14 +107,6 @@ Reinstall my local (Mac OS X) DSpace stack with Tomcat 7, PostgreSQL 9.3, and Ja
|
|||||||
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
||||||
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/">CGSpace Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/notes/">Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/post/">Posts</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/">Tags</a>
|
|
||||||
|
|
||||||
|
|
||||||
</nav>
|
</nav>
|
||||||
</div>
|
</div>
|
||||||
|
@ -113,14 +113,6 @@ Also, I noticed the checker log has some errors we should pay attention to:
|
|||||||
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
||||||
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/">CGSpace Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/notes/">Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/post/">Posts</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/">Tags</a>
|
|
||||||
|
|
||||||
|
|
||||||
</nav>
|
</nav>
|
||||||
</div>
|
</div>
|
||||||
|
@ -119,14 +119,6 @@ There are 3,000 IPs accessing the REST API in a 24-hour period!
|
|||||||
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
||||||
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/">CGSpace Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/notes/">Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/post/">Posts</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/">Tags</a>
|
|
||||||
|
|
||||||
|
|
||||||
</nav>
|
</nav>
|
||||||
</div>
|
</div>
|
||||||
|
@ -116,14 +116,6 @@ Working on second phase of metadata migration, looks like this will work for mov
|
|||||||
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
||||||
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/">CGSpace Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/notes/">Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/post/">Posts</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/">Tags</a>
|
|
||||||
|
|
||||||
|
|
||||||
</nav>
|
</nav>
|
||||||
</div>
|
</div>
|
||||||
|
@ -140,14 +140,6 @@ In this case the select query was showing 95 results before the update
|
|||||||
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
||||||
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/">CGSpace Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/notes/">Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/post/">Posts</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/">Tags</a>
|
|
||||||
|
|
||||||
|
|
||||||
</nav>
|
</nav>
|
||||||
</div>
|
</div>
|
||||||
|
@ -131,14 +131,6 @@ $ git rebase -i dspace-5.5
|
|||||||
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
||||||
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/">CGSpace Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/notes/">Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/post/">Posts</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/">Tags</a>
|
|
||||||
|
|
||||||
|
|
||||||
</nav>
|
</nav>
|
||||||
</div>
|
</div>
|
||||||
|
@ -119,14 +119,6 @@ $ ldapsearch -x -H ldaps://svcgroot2.cgiarad.org:3269/ -b "dc=cgiarad,dc=or
|
|||||||
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
||||||
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/">CGSpace Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/notes/">Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/post/">Posts</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/">Tags</a>
|
|
||||||
|
|
||||||
|
|
||||||
</nav>
|
</nav>
|
||||||
</div>
|
</div>
|
||||||
|
@ -83,14 +83,6 @@
|
|||||||
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
||||||
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/">CGSpace Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/notes/">Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/post/">Posts</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/">Tags</a>
|
|
||||||
|
|
||||||
|
|
||||||
</nav>
|
</nav>
|
||||||
</div>
|
</div>
|
||||||
|
@ -83,14 +83,6 @@
|
|||||||
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
||||||
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/">CGSpace Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/notes/">Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/post/">Posts</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/">Tags</a>
|
|
||||||
|
|
||||||
|
|
||||||
</nav>
|
</nav>
|
||||||
</div>
|
</div>
|
||||||
|
@ -83,14 +83,6 @@
|
|||||||
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
||||||
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/">CGSpace Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/notes/">Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/post/">Posts</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/">Tags</a>
|
|
||||||
|
|
||||||
|
|
||||||
</nav>
|
</nav>
|
||||||
</div>
|
</div>
|
||||||
|
@ -8,7 +8,7 @@
|
|||||||
<!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags -->
|
<!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags -->
|
||||||
|
|
||||||
<meta property="og:title" content="January, 2017" />
|
<meta property="og:title" content="January, 2017" />
|
||||||
<meta property="og:description" content=" 2017-01-02 I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error I tested on DSpace Test as well and it doesn’t work there either I asked on the dspace-tech mailing list because it seems to be broken, and actually now I’m not sure if we’ve ever had the sharding task run successfully over all these years " />
|
<meta property="og:description" content="2017-01-02 I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error I tested on DSpace Test as well and it doesn’t work there either I asked on the dspace-tech mailing list because it seems to be broken, and actually now I’m not sure if we’ve ever had the sharding task run successfully over all these years 2017-01-04 I tried to shard my local dev instance and it fails the same way: $ JAVA_OPTS="-Xms768m -Xmx768m -Dfile." />
|
||||||
<meta property="og:type" content="article" />
|
<meta property="og:type" content="article" />
|
||||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-01/" />
|
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2017-01/" />
|
||||||
|
|
||||||
@ -26,11 +26,11 @@
|
|||||||
|
|
||||||
|
|
||||||
<meta itemprop="name" content="January, 2017">
|
<meta itemprop="name" content="January, 2017">
|
||||||
<meta itemprop="description" content=" 2017-01-02 I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error I tested on DSpace Test as well and it doesn’t work there either I asked on the dspace-tech mailing list because it seems to be broken, and actually now I’m not sure if we’ve ever had the sharding task run successfully over all these years ">
|
<meta itemprop="description" content="2017-01-02 I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error I tested on DSpace Test as well and it doesn’t work there either I asked on the dspace-tech mailing list because it seems to be broken, and actually now I’m not sure if we’ve ever had the sharding task run successfully over all these years 2017-01-04 I tried to shard my local dev instance and it fails the same way: $ JAVA_OPTS="-Xms768m -Xmx768m -Dfile.">
|
||||||
|
|
||||||
|
|
||||||
<meta itemprop="dateModified" content="2017-01-02T10:43:00+03:00" />
|
<meta itemprop="dateModified" content="2017-01-02T10:43:00+03:00" />
|
||||||
<meta itemprop="wordCount" content="71">
|
<meta itemprop="wordCount" content="401">
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
@ -43,7 +43,7 @@
|
|||||||
|
|
||||||
|
|
||||||
<meta name="twitter:title" content="January, 2017"/>
|
<meta name="twitter:title" content="January, 2017"/>
|
||||||
<meta name="twitter:description" content=" 2017-01-02 I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error I tested on DSpace Test as well and it doesn’t work there either I asked on the dspace-tech mailing list because it seems to be broken, and actually now I’m not sure if we’ve ever had the sharding task run successfully over all these years "/>
|
<meta name="twitter:description" content="2017-01-02 I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error I tested on DSpace Test as well and it doesn’t work there either I asked on the dspace-tech mailing list because it seems to be broken, and actually now I’m not sure if we’ve ever had the sharding task run successfully over all these years 2017-01-04 I tried to shard my local dev instance and it fails the same way: $ JAVA_OPTS="-Xms768m -Xmx768m -Dfile."/>
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
@ -83,14 +83,6 @@
|
|||||||
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
||||||
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/">CGSpace Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/notes/">Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/post/">Posts</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/">Tags</a>
|
|
||||||
|
|
||||||
|
|
||||||
</nav>
|
</nav>
|
||||||
</div>
|
</div>
|
||||||
@ -129,6 +121,88 @@
|
|||||||
<li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I’m not sure if we’ve ever had the sharding task run successfully over all these years</li>
|
<li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I’m not sure if we’ve ever had the sharding task run successfully over all these years</li>
|
||||||
</ul>
|
</ul>
|
||||||
|
|
||||||
|
<h2 id="2017-01-04">2017-01-04</h2>
|
||||||
|
|
||||||
|
<ul>
|
||||||
|
<li>I tried to shard my local dev instance and it fails the same way:</li>
|
||||||
|
</ul>
|
||||||
|
|
||||||
|
<pre><code>$ JAVA_OPTS="-Xms768m -Xmx768m -Dfile.encoding=UTF-8" ~/dspace/bin/dspace stats-util -s
|
||||||
|
Moving: 9318 into core statistics-2016
|
||||||
|
Exception: IOException occured when talking to server at: http://localhost:8081/solr//statistics-2016
|
||||||
|
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://localhost:8081/solr//statistics-2016
|
||||||
|
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:566)
|
||||||
|
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
|
||||||
|
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
|
||||||
|
at org.dspace.statistics.SolrLogger.shardSolrIndex(SourceFile:2291)
|
||||||
|
at org.dspace.statistics.util.StatisticsClient.main(StatisticsClient.java:106)
|
||||||
|
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
|
||||||
|
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
|
||||||
|
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
|
||||||
|
at java.lang.reflect.Method.invoke(Method.java:498)
|
||||||
|
at org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:226)
|
||||||
|
at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:78)
|
||||||
|
Caused by: org.apache.http.client.ClientProtocolException
|
||||||
|
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:867)
|
||||||
|
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
|
||||||
|
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
|
||||||
|
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
|
||||||
|
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:448)
|
||||||
|
... 10 more
|
||||||
|
Caused by: org.apache.http.client.NonRepeatableRequestException: Cannot retry request with a non-repeatable request entity. The cause lists the reason the original request failed.
|
||||||
|
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:659)
|
||||||
|
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
|
||||||
|
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
|
||||||
|
... 14 more
|
||||||
|
Caused by: java.net.SocketException: Broken pipe (Write failed)
|
||||||
|
at java.net.SocketOutputStream.socketWrite0(Native Method)
|
||||||
|
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:109)
|
||||||
|
at java.net.SocketOutputStream.write(SocketOutputStream.java:153)
|
||||||
|
at org.apache.http.impl.io.AbstractSessionOutputBuffer.write(AbstractSessionOutputBuffer.java:181)
|
||||||
|
at org.apache.http.impl.io.ChunkedOutputStream.flushCacheWithAppend(ChunkedOutputStream.java:124)
|
||||||
|
at org.apache.http.impl.io.ChunkedOutputStream.write(ChunkedOutputStream.java:181)
|
||||||
|
at org.apache.http.entity.InputStreamEntity.writeTo(InputStreamEntity.java:132)
|
||||||
|
at org.apache.http.entity.HttpEntityWrapper.writeTo(HttpEntityWrapper.java:89)
|
||||||
|
at org.apache.http.impl.client.EntityEnclosingRequestWrapper$EntityWrapper.writeTo(EntityEnclosingRequestWrapper.java:108)
|
||||||
|
at org.apache.http.impl.entity.EntitySerializer.serialize(EntitySerializer.java:117)
|
||||||
|
at org.apache.http.impl.AbstractHttpClientConnection.sendRequestEntity(AbstractHttpClientConnection.java:265)
|
||||||
|
at org.apache.http.impl.conn.ManagedClientConnectionImpl.sendRequestEntity(ManagedClientConnectionImpl.java:203)
|
||||||
|
at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:236)
|
||||||
|
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:121)
|
||||||
|
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
|
||||||
|
... 16 more
|
||||||
|
</code></pre>
|
||||||
|
|
||||||
|
<ul>
|
||||||
|
<li>And the DSpace log shows:</li>
|
||||||
|
</ul>
|
||||||
|
|
||||||
|
<pre><code>2017-01-04 22:39:05,412 INFO org.dspace.statistics.SolrLogger @ Created core with name: statistics-2016
|
||||||
|
2017-01-04 22:39:05,412 INFO org.dspace.statistics.SolrLogger @ Moving: 9318 records into core statistics-2016
|
||||||
|
2017-01-04 22:39:07,310 INFO org.apache.http.impl.client.SystemDefaultHttpClient @ I/O exception (java.net.SocketException) caught when processing request to {}->http://localhost:8081: Broken pipe (Write failed)
|
||||||
|
2017-01-04 22:39:07,310 INFO org.apache.http.impl.client.SystemDefaultHttpClient @ Retrying request to {}->http://localhost:8081
|
||||||
|
</code></pre>
|
||||||
|
|
||||||
|
<ul>
|
||||||
|
<li>Despite failing instantly, a <code>statistics-2016</code> directory was created, but it only has a data dir (no conf)</li>
|
||||||
|
<li>The Tomcat access logs show more:</li>
|
||||||
|
</ul>
|
||||||
|
|
||||||
|
<pre><code>127.0.0.1 - - [04/Jan/2017:22:39:05 +0200] "GET /solr/statistics/select?q=type%3A2+AND+id%3A1&wt=javabin&version=2 HTTP/1.1" 200 107
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:39:05 +0200] "GET /solr/statistics/select?q=*%3A*&rows=0&facet=true&facet.range=time&facet.range.start=NOW%2FYEAR-17YEARS&facet.range.end=NOW%2FYEAR%2B0YEARS&facet.range.gap=%2B1YEAR&facet.mincount=1&wt=javabin&version=2 HTTP/1.1" 200 423
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:39:05 +0200] "GET /solr/admin/cores?action=STATUS&core=statistics-2016&indexInfo=true&wt=javabin&version=2 HTTP/1.1" 200 77
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:39:05 +0200] "GET /solr/admin/cores?action=CREATE&name=statistics-2016&instanceDir=statistics&dataDir=%2FUsers%2Faorth%2Fdspace%2Fsolr%2Fstatistics-2016%2Fdata&wt=javabin&version=2 HTTP/1.1" 200 63
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:39:07 +0200] "GET /solr/statistics/select?csv.mv.separator=%7C&q=*%3A*&fq=time%3A%28%5B2016%5C-01%5C-01T00%5C%3A00%5C%3A00Z+TO+2017%5C-01%5C-01T00%5C%3A00%5C%3A00Z%5D+NOT+2017%5C-01%5C-01T00%5C%3A00%5C%3A00Z%29&rows=10000&wt=csv HTTP/1.1" 200 4359517
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:39:07 +0200] "GET /solr/statistics/admin/luke?show=schema&wt=javabin&version=2 HTTP/1.1" 200 16248
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:39:07 +0200] "POST /solr//statistics-2016/update/csv?commit=true&softCommit=false&waitSearcher=true&f.previousWorkflowStep.split=true&f.previousWorkflowStep.separator=%7C&f.previousWorkflowStep.encapsulator=%22&f.actingGroupId.split=true&f.actingGroupId.separator=%7C&f.actingGroupId.encapsulator=%22&f.containerCommunity.split=true&f.containerCommunity.separator=%7C&f.containerCommunity.encapsulator=%22&f.range.split=true&f.range.separator=%7C&f.range.encapsulator=%22&f.containerItem.split=true&f.containerItem.separator=%7C&f.containerItem.encapsulator=%22&f.p_communities_map.split=true&f.p_communities_map.separator=%7C&f.p_communities_map.encapsulator=%22&f.ngram_query_search.split=true&f.ngram_query_search.separator=%7C&f.ngram_query_search.encapsulator=%22&f.containerBitstream.split=true&f.containerBitstream.separator=%7C&f.containerBitstream.encapsulator=%22&f.owningItem.split=true&f.owningItem.separator=%7C&f.owningItem.encapsulator=%22&f.actingGroupParentId.split=true&f.actingGroupParentId.separator=%7C&f.actingGroupParentId.encapsulator=%22&f.text.split=true&f.text.separator=%7C&f.text.encapsulator=%22&f.simple_query_search.split=true&f.simple_query_search.separator=%7C&f.simple_query_search.encapsulator=%22&f.owningComm.split=true&f.owningComm.separator=%7C&f.owningComm.encapsulator=%22&f.owner.split=true&f.owner.separator=%7C&f.owner.encapsulator=%22&f.filterquery.split=true&f.filterquery.separator=%7C&f.filterquery.encapsulator=%22&f.p_group_map.split=true&f.p_group_map.separator=%7C&f.p_group_map.encapsulator=%22&f.actorMemberGroupId.split=true&f.actorMemberGroupId.separator=%7C&f.actorMemberGroupId.encapsulator=%22&f.bitstreamId.split=true&f.bitstreamId.separator=%7C&f.bitstreamId.encapsulator=%22&f.group_name.split=true&f.group_name.separator=%7C&f.group_name.encapsulator=%22&f.p_communities_name.split=true&f.p_communities_name.separator=%7C&f.p_communities_name.encapsulator=%22&f.query.split=true&f.query.separator=%7C&f.query.encapsulator=%22&f.workflowStep.split=true&f.workflowStep.separator=%7C&f.workflowStep.encapsulator=%22&f.containerCollection.split=true&f.containerCollection.separator=%7C&f.containerCollection.encapsulator=%22&f.complete_query_search.split=true&f.complete_query_search.separator=%7C&f.complete_query_search.encapsulator=%22&f.p_communities_id.split=true&f.p_communities_id.separator=%7C&f.p_communities_id.encapsulator=%22&f.rangeDescription.split=true&f.rangeDescription.separator=%7C&f.rangeDescription.encapsulator=%22&f.group_id.split=true&f.group_id.separator=%7C&f.group_id.encapsulator=%22&f.bundleName.split=true&f.bundleName.separator=%7C&f.bundleName.encapsulator=%22&f.ngram_simplequery_search.split=true&f.ngram_simplequery_search.separator=%7C&f.ngram_simplequery_search.encapsulator=%22&f.group_map.split=true&f.group_map.separator=%7C&f.group_map.encapsulator=%22&f.owningColl.split=true&f.owningColl.separator=%7C&f.owningColl.encapsulator=%22&f.p_group_id.split=true&f.p_group_id.separator=%7C&f.p_group_id.encapsulator=%22&f.p_group_name.split=true&f.p_group_name.separator=%7C&f.p_group_name.encapsulator=%22&wt=javabin&version=2 HTTP/1.1" 409 156
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:44:00 +0200] "POST /solr/datatables/update?wt=javabin&version=2 HTTP/1.1" 200 41
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:44:00 +0200] "POST /solr/datatables/update HTTP/1.1" 200 40
|
||||||
|
</code></pre>
|
||||||
|
|
||||||
|
<ul>
|
||||||
|
<li>Very interesting… it creates the core and then fails somehow</li>
|
||||||
|
</ul>
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
|
6
public/css/cookieconsent.min.css
vendored
6
public/css/cookieconsent.min.css
vendored
@ -1,6 +1,6 @@
|
|||||||
.cc-window{opacity:1;transition:opacity 1s ease}.cc-window.cc-invisible{opacity:0}.cc-animate.cc-revoke{transition:transform 1s ease}.cc-animate.cc-revoke.cc-top{transform:translateY(-2em)}.cc-animate.cc-revoke.cc-bottom{transform:translateY(2em)}.cc-animate.cc-revoke.cc-active.cc-bottom,.cc-animate.cc-revoke.cc-active.cc-top,.cc-revoke:hover{transform:translateY(0)}.cc-grower{max-height:0;overflow:hidden;transition:max-height 1s}
|
.cc-window{opacity:1;transition:opacity 1s ease}.cc-window.cc-invisible{opacity:0}.cc-animate.cc-revoke{transition:transform 1s ease}.cc-animate.cc-revoke.cc-top{transform:translateY(-2em)}.cc-animate.cc-revoke.cc-bottom{transform:translateY(2em)}.cc-animate.cc-revoke.cc-active.cc-bottom,.cc-animate.cc-revoke.cc-active.cc-top,.cc-revoke:hover{transform:translateY(0)}.cc-grower{max-height:0;overflow:hidden;transition:max-height 1s}
|
||||||
.cc-link,.cc-revoke:hover{text-decoration:underline}.cc-revoke,.cc-window{position:fixed;overflow:hidden;box-sizing:border-box;font-family:Helvetica,Calibri,Arial,sans-serif;font-size:16px;line-height:1.5em;display:-ms-flexbox;display:flex;-ms-flex-wrap:nowrap;flex-wrap:nowrap;z-index:9999}.cc-window.cc-static{position:static}.cc-window.cc-floating{padding:2em;max-width:24em;-ms-flex-direction:column;flex-direction:column}.cc-window.cc-banner{padding:1em 1.8em;width:100%;-ms-flex-direction:row;flex-direction:row}.cc-revoke{padding:.5em}.cc-header{font-size:18px;font-weight:700}.cc-btn,.cc-close,.cc-link,.cc-revoke{cursor:pointer}.cc-link{opacity:.8;display:inline-block;padding:.2em}.cc-link:hover{opacity:1}.cc-link:active,.cc-link:visited{color:initial}.cc-btn{display:block;padding:.4em .8em;font-size:.9em;font-weight:700;border-width:2px;border-style:solid;text-align:center;white-space:nowrap}.cc-banner .cc-btn:last-child{min-width:140px}.cc-highlight .cc-btn:first-child{background-color:transparent;border-color:transparent}.cc-highlight .cc-btn:first-child:hover{background-color:transparent;text-decoration:underline}.cc-close{display:block;position:absolute;top:.5em;right:.5em;font-size:1.6em;opacity:.9;line-height:.75}.cc-close:hover{opacity:1}
|
.cc-link,.cc-revoke:hover{text-decoration:underline}.cc-revoke,.cc-window{position:fixed;overflow:hidden;box-sizing:border-box;font-family:Helvetica,Calibri,Arial,sans-serif;font-size:16px;line-height:1.5em;display:-ms-flexbox;display:flex;-ms-flex-wrap:nowrap;flex-wrap:nowrap;z-index:9999}.cc-window.cc-static{position:static}.cc-window.cc-floating{padding:2em;max-width:24em;-ms-flex-direction:column;flex-direction:column}.cc-window.cc-banner{padding:1em 1.8em;width:100%;-ms-flex-direction:row;flex-direction:row}.cc-revoke{padding:.5em}.cc-header{font-size:18px;font-weight:700}.cc-btn,.cc-close,.cc-link,.cc-revoke{cursor:pointer}.cc-link{opacity:.8;display:inline-block;padding:.2em}.cc-link:hover{opacity:1}.cc-link:active,.cc-link:visited{color:initial}.cc-btn{display:block;padding:.4em .8em;font-size:.9em;font-weight:700;border-width:2px;border-style:solid;text-align:center;white-space:nowrap}.cc-banner .cc-btn:last-child{min-width:140px}.cc-highlight .cc-btn:first-child{background-color:transparent;border-color:transparent}.cc-highlight .cc-btn:first-child:focus,.cc-highlight .cc-btn:first-child:hover{background-color:transparent;text-decoration:underline}.cc-close{display:block;position:absolute;top:.5em;right:.5em;font-size:1.6em;opacity:.9;line-height:.75}.cc-close:focus,.cc-close:hover{opacity:1}
|
||||||
.cc-revoke.cc-top{top:0;left:3em;border-bottom-left-radius:.5em;border-bottom-right-radius:.5em}.cc-revoke.cc-bottom{bottom:0;left:3em;border-top-left-radius:.5em;border-top-right-radius:.5em}.cc-revoke.cc-left{left:3em;right:unset}.cc-revoke.cc-right{right:3em;left:unset}.cc-top{top:1em}.cc-left{left:1em}.cc-right{right:1em}.cc-bottom{bottom:1em}.cc-floating>.cc-link{margin-bottom:1em}.cc-floating .cc-message{display:block;margin-bottom:1em}.cc-window.cc-floating .cc-compliance{-ms-flex:1;flex:1}.cc-window.cc-banner{-ms-flex-align:center;-ms-grid-row-align:center;align-items:center}.cc-banner.cc-top{left:0;right:0;top:0}.cc-banner.cc-bottom{left:0;right:0;bottom:0}.cc-banner .cc-message{-ms-flex:1;flex:1}.cc-compliance{display:-ms-flexbox;display:flex;-ms-flex-align:center;align-items:center;-ms-flex-line-pack:justify;align-content:space-between}.cc-compliance>.cc-btn{-ms-flex:1;flex:1}.cc-btn+.cc-btn{margin-left:.5em}
|
.cc-revoke.cc-top{top:0;left:3em;border-bottom-left-radius:.5em;border-bottom-right-radius:.5em}.cc-revoke.cc-bottom{bottom:0;left:3em;border-top-left-radius:.5em;border-top-right-radius:.5em}.cc-revoke.cc-left{left:3em;right:unset}.cc-revoke.cc-right{right:3em;left:unset}.cc-top{top:1em}.cc-left{left:1em}.cc-right{right:1em}.cc-bottom{bottom:1em}.cc-floating>.cc-link{margin-bottom:1em}.cc-floating .cc-message{display:block;margin-bottom:1em}.cc-window.cc-floating .cc-compliance{-ms-flex:1;flex:1}.cc-window.cc-banner{-ms-flex-align:center;align-items:center}.cc-banner.cc-top{left:0;right:0;top:0}.cc-banner.cc-bottom{left:0;right:0;bottom:0}.cc-banner .cc-message{-ms-flex:1;flex:1}.cc-compliance{display:-ms-flexbox;display:flex;-ms-flex-align:center;align-items:center;-ms-flex-line-pack:justify;align-content:space-between}.cc-compliance>.cc-btn{-ms-flex:1;flex:1}.cc-btn+.cc-btn{margin-left:.5em}
|
||||||
@media print{.cc-revoke,.cc-window{display:none}}@media screen and (max-width:900px){.cc-btn{white-space:normal}}@media screen and (max-width:414px) and (orientation:portrait),screen and (max-width:736px) and (orientation:landscape){.cc-window.cc-top{top:0}.cc-window.cc-bottom{bottom:0}.cc-window.cc-banner,.cc-window.cc-left,.cc-window.cc-right{left:0;right:0}.cc-window.cc-banner{-ms-flex-direction:column;flex-direction:column}.cc-window.cc-banner .cc-compliance{-ms-flex:1;flex:1}.cc-window.cc-floating{max-width:none}.cc-window .cc-message{margin-bottom:1em}.cc-window.cc-banner{-ms-flex-align:unset;-ms-grid-row-align:unset;align-items:unset}}
|
@media print{.cc-revoke,.cc-window{display:none}}@media screen and (max-width:900px){.cc-btn{white-space:normal}}@media screen and (max-width:414px) and (orientation:portrait),screen and (max-width:736px) and (orientation:landscape){.cc-window.cc-top{top:0}.cc-window.cc-bottom{bottom:0}.cc-window.cc-banner,.cc-window.cc-left,.cc-window.cc-right{left:0;right:0}.cc-window.cc-banner{-ms-flex-direction:column;flex-direction:column}.cc-window.cc-banner .cc-compliance{-ms-flex:1;flex:1}.cc-window.cc-floating{max-width:none}.cc-window .cc-message{margin-bottom:1em}.cc-window.cc-banner{-ms-flex-align:unset;align-items:unset}}
|
||||||
.cc-floating.cc-theme-classic{padding:1.2em;border-radius:5px}.cc-floating.cc-type-info.cc-theme-classic .cc-compliance{text-align:center;display:inline;-ms-flex:none;flex:none}.cc-theme-classic .cc-btn{border-radius:5px}.cc-theme-classic .cc-btn:last-child{min-width:140px}.cc-floating.cc-type-info.cc-theme-classic .cc-btn{display:inline-block}
|
.cc-floating.cc-theme-classic{padding:1.2em;border-radius:5px}.cc-floating.cc-type-info.cc-theme-classic .cc-compliance{text-align:center;display:inline;-ms-flex:none;flex:none}.cc-theme-classic .cc-btn{border-radius:5px}.cc-theme-classic .cc-btn:last-child{min-width:140px}.cc-floating.cc-type-info.cc-theme-classic .cc-btn{display:inline-block}
|
||||||
.cc-theme-edgeless.cc-window{padding:0}.cc-floating.cc-theme-edgeless .cc-message{margin:2em 2em 1.5em}.cc-banner.cc-theme-edgeless .cc-btn{margin:0;padding:.8em 1.8em;height:100%}.cc-banner.cc-theme-edgeless .cc-message{margin-left:1em}.cc-floating.cc-theme-edgeless .cc-btn+.cc-btn{margin-left:0}
|
.cc-theme-edgeless.cc-window{padding:0}.cc-floating.cc-theme-edgeless .cc-message{margin:2em 2em 1.5em}.cc-banner.cc-theme-edgeless .cc-btn{margin:0;padding:.8em 1.8em;height:100%}.cc-banner.cc-theme-edgeless .cc-message{margin-left:1em}.cc-floating.cc-theme-edgeless .cc-btn+.cc-btn{margin-left:0}
|
@ -69,14 +69,6 @@
|
|||||||
<a class="nav-link active" href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
<a class="nav-link active" href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
||||||
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/">CGSpace Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/notes/">Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/post/">Posts</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/">Tags</a>
|
|
||||||
|
|
||||||
|
|
||||||
</nav>
|
</nav>
|
||||||
</div>
|
</div>
|
||||||
@ -108,7 +100,7 @@
|
|||||||
|
|
||||||
</p>
|
</p>
|
||||||
</header>
|
</header>
|
||||||
2017-01-02 I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error I tested on DSpace Test as well and it doesn’t work there either I asked on the dspace-tech mailing list because it seems to be broken, and actually now I’m not sure if we’ve ever had the sharding task run successfully over all these years
|
2017-01-02 I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error I tested on DSpace Test as well and it doesn’t work there either I asked on the dspace-tech mailing list because it seems to be broken, and actually now I’m not sure if we’ve ever had the sharding task run successfully over all these years 2017-01-04 I tried to shard my local dev instance and it fails the same way: $ JAVA_OPTS="-Xms768m -Xmx768m -Dfile.
|
||||||
<a href='https://alanorth.github.io/cgspace-notes/2017-01/'>Read more →</a>
|
<a href='https://alanorth.github.io/cgspace-notes/2017-01/'>Read more →</a>
|
||||||
</article>
|
</article>
|
||||||
|
|
||||||
|
@ -24,6 +24,88 @@
|
|||||||
<li>I tested on DSpace Test as well and it doesn&rsquo;t work there either</li>
|
<li>I tested on DSpace Test as well and it doesn&rsquo;t work there either</li>
|
||||||
<li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&rsquo;m not sure if we&rsquo;ve ever had the sharding task run successfully over all these years</li>
|
<li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&rsquo;m not sure if we&rsquo;ve ever had the sharding task run successfully over all these years</li>
|
||||||
</ul>
|
</ul>
|
||||||
|
|
||||||
|
<h2 id="2017-01-04">2017-01-04</h2>
|
||||||
|
|
||||||
|
<ul>
|
||||||
|
<li>I tried to shard my local dev instance and it fails the same way:</li>
|
||||||
|
</ul>
|
||||||
|
|
||||||
|
<pre><code>$ JAVA_OPTS=&quot;-Xms768m -Xmx768m -Dfile.encoding=UTF-8&quot; ~/dspace/bin/dspace stats-util -s
|
||||||
|
Moving: 9318 into core statistics-2016
|
||||||
|
Exception: IOException occured when talking to server at: http://localhost:8081/solr//statistics-2016
|
||||||
|
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://localhost:8081/solr//statistics-2016
|
||||||
|
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:566)
|
||||||
|
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
|
||||||
|
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
|
||||||
|
at org.dspace.statistics.SolrLogger.shardSolrIndex(SourceFile:2291)
|
||||||
|
at org.dspace.statistics.util.StatisticsClient.main(StatisticsClient.java:106)
|
||||||
|
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
|
||||||
|
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
|
||||||
|
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
|
||||||
|
at java.lang.reflect.Method.invoke(Method.java:498)
|
||||||
|
at org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:226)
|
||||||
|
at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:78)
|
||||||
|
Caused by: org.apache.http.client.ClientProtocolException
|
||||||
|
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:867)
|
||||||
|
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
|
||||||
|
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
|
||||||
|
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
|
||||||
|
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:448)
|
||||||
|
... 10 more
|
||||||
|
Caused by: org.apache.http.client.NonRepeatableRequestException: Cannot retry request with a non-repeatable request entity. The cause lists the reason the original request failed.
|
||||||
|
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:659)
|
||||||
|
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
|
||||||
|
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
|
||||||
|
... 14 more
|
||||||
|
Caused by: java.net.SocketException: Broken pipe (Write failed)
|
||||||
|
at java.net.SocketOutputStream.socketWrite0(Native Method)
|
||||||
|
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:109)
|
||||||
|
at java.net.SocketOutputStream.write(SocketOutputStream.java:153)
|
||||||
|
at org.apache.http.impl.io.AbstractSessionOutputBuffer.write(AbstractSessionOutputBuffer.java:181)
|
||||||
|
at org.apache.http.impl.io.ChunkedOutputStream.flushCacheWithAppend(ChunkedOutputStream.java:124)
|
||||||
|
at org.apache.http.impl.io.ChunkedOutputStream.write(ChunkedOutputStream.java:181)
|
||||||
|
at org.apache.http.entity.InputStreamEntity.writeTo(InputStreamEntity.java:132)
|
||||||
|
at org.apache.http.entity.HttpEntityWrapper.writeTo(HttpEntityWrapper.java:89)
|
||||||
|
at org.apache.http.impl.client.EntityEnclosingRequestWrapper$EntityWrapper.writeTo(EntityEnclosingRequestWrapper.java:108)
|
||||||
|
at org.apache.http.impl.entity.EntitySerializer.serialize(EntitySerializer.java:117)
|
||||||
|
at org.apache.http.impl.AbstractHttpClientConnection.sendRequestEntity(AbstractHttpClientConnection.java:265)
|
||||||
|
at org.apache.http.impl.conn.ManagedClientConnectionImpl.sendRequestEntity(ManagedClientConnectionImpl.java:203)
|
||||||
|
at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:236)
|
||||||
|
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:121)
|
||||||
|
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
|
||||||
|
... 16 more
|
||||||
|
</code></pre>
|
||||||
|
|
||||||
|
<ul>
|
||||||
|
<li>And the DSpace log shows:</li>
|
||||||
|
</ul>
|
||||||
|
|
||||||
|
<pre><code>2017-01-04 22:39:05,412 INFO org.dspace.statistics.SolrLogger @ Created core with name: statistics-2016
|
||||||
|
2017-01-04 22:39:05,412 INFO org.dspace.statistics.SolrLogger @ Moving: 9318 records into core statistics-2016
|
||||||
|
2017-01-04 22:39:07,310 INFO org.apache.http.impl.client.SystemDefaultHttpClient @ I/O exception (java.net.SocketException) caught when processing request to {}-&gt;http://localhost:8081: Broken pipe (Write failed)
|
||||||
|
2017-01-04 22:39:07,310 INFO org.apache.http.impl.client.SystemDefaultHttpClient @ Retrying request to {}-&gt;http://localhost:8081
|
||||||
|
</code></pre>
|
||||||
|
|
||||||
|
<ul>
|
||||||
|
<li>Despite failing instantly, a <code>statistics-2016</code> directory was created, but it only has a data dir (no conf)</li>
|
||||||
|
<li>The Tomcat access logs show more:</li>
|
||||||
|
</ul>
|
||||||
|
|
||||||
|
<pre><code>127.0.0.1 - - [04/Jan/2017:22:39:05 +0200] &quot;GET /solr/statistics/select?q=type%3A2+AND+id%3A1&amp;wt=javabin&amp;version=2 HTTP/1.1&quot; 200 107
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:39:05 +0200] &quot;GET /solr/statistics/select?q=*%3A*&amp;rows=0&amp;facet=true&amp;facet.range=time&amp;facet.range.start=NOW%2FYEAR-17YEARS&amp;facet.range.end=NOW%2FYEAR%2B0YEARS&amp;facet.range.gap=%2B1YEAR&amp;facet.mincount=1&amp;wt=javabin&amp;version=2 HTTP/1.1&quot; 200 423
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:39:05 +0200] &quot;GET /solr/admin/cores?action=STATUS&amp;core=statistics-2016&amp;indexInfo=true&amp;wt=javabin&amp;version=2 HTTP/1.1&quot; 200 77
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:39:05 +0200] &quot;GET /solr/admin/cores?action=CREATE&amp;name=statistics-2016&amp;instanceDir=statistics&amp;dataDir=%2FUsers%2Faorth%2Fdspace%2Fsolr%2Fstatistics-2016%2Fdata&amp;wt=javabin&amp;version=2 HTTP/1.1&quot; 200 63
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:39:07 +0200] &quot;GET /solr/statistics/select?csv.mv.separator=%7C&amp;q=*%3A*&amp;fq=time%3A%28%5B2016%5C-01%5C-01T00%5C%3A00%5C%3A00Z+TO+2017%5C-01%5C-01T00%5C%3A00%5C%3A00Z%5D+NOT+2017%5C-01%5C-01T00%5C%3A00%5C%3A00Z%29&amp;rows=10000&amp;wt=csv HTTP/1.1&quot; 200 4359517
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:39:07 +0200] &quot;GET /solr/statistics/admin/luke?show=schema&amp;wt=javabin&amp;version=2 HTTP/1.1&quot; 200 16248
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:39:07 +0200] &quot;POST /solr//statistics-2016/update/csv?commit=true&amp;softCommit=false&amp;waitSearcher=true&amp;f.previousWorkflowStep.split=true&amp;f.previousWorkflowStep.separator=%7C&amp;f.previousWorkflowStep.encapsulator=%22&amp;f.actingGroupId.split=true&amp;f.actingGroupId.separator=%7C&amp;f.actingGroupId.encapsulator=%22&amp;f.containerCommunity.split=true&amp;f.containerCommunity.separator=%7C&amp;f.containerCommunity.encapsulator=%22&amp;f.range.split=true&amp;f.range.separator=%7C&amp;f.range.encapsulator=%22&amp;f.containerItem.split=true&amp;f.containerItem.separator=%7C&amp;f.containerItem.encapsulator=%22&amp;f.p_communities_map.split=true&amp;f.p_communities_map.separator=%7C&amp;f.p_communities_map.encapsulator=%22&amp;f.ngram_query_search.split=true&amp;f.ngram_query_search.separator=%7C&amp;f.ngram_query_search.encapsulator=%22&amp;f.containerBitstream.split=true&amp;f.containerBitstream.separator=%7C&amp;f.containerBitstream.encapsulator=%22&amp;f.owningItem.split=true&amp;f.owningItem.separator=%7C&amp;f.owningItem.encapsulator=%22&amp;f.actingGroupParentId.split=true&amp;f.actingGroupParentId.separator=%7C&amp;f.actingGroupParentId.encapsulator=%22&amp;f.text.split=true&amp;f.text.separator=%7C&amp;f.text.encapsulator=%22&amp;f.simple_query_search.split=true&amp;f.simple_query_search.separator=%7C&amp;f.simple_query_search.encapsulator=%22&amp;f.owningComm.split=true&amp;f.owningComm.separator=%7C&amp;f.owningComm.encapsulator=%22&amp;f.owner.split=true&amp;f.owner.separator=%7C&amp;f.owner.encapsulator=%22&amp;f.filterquery.split=true&amp;f.filterquery.separator=%7C&amp;f.filterquery.encapsulator=%22&amp;f.p_group_map.split=true&amp;f.p_group_map.separator=%7C&amp;f.p_group_map.encapsulator=%22&amp;f.actorMemberGroupId.split=true&amp;f.actorMemberGroupId.separator=%7C&amp;f.actorMemberGroupId.encapsulator=%22&amp;f.bitstreamId.split=true&amp;f.bitstreamId.separator=%7C&amp;f.bitstreamId.encapsulator=%22&amp;f.group_name.split=true&amp;f.group_name.separator=%7C&amp;f.group_name.encapsulator=%22&amp;f.p_communities_name.split=true&amp;f.p_communities_name.separator=%7C&amp;f.p_communities_name.encapsulator=%22&amp;f.query.split=true&amp;f.query.separator=%7C&amp;f.query.encapsulator=%22&amp;f.workflowStep.split=true&amp;f.workflowStep.separator=%7C&amp;f.workflowStep.encapsulator=%22&amp;f.containerCollection.split=true&amp;f.containerCollection.separator=%7C&amp;f.containerCollection.encapsulator=%22&amp;f.complete_query_search.split=true&amp;f.complete_query_search.separator=%7C&amp;f.complete_query_search.encapsulator=%22&amp;f.p_communities_id.split=true&amp;f.p_communities_id.separator=%7C&amp;f.p_communities_id.encapsulator=%22&amp;f.rangeDescription.split=true&amp;f.rangeDescription.separator=%7C&amp;f.rangeDescription.encapsulator=%22&amp;f.group_id.split=true&amp;f.group_id.separator=%7C&amp;f.group_id.encapsulator=%22&amp;f.bundleName.split=true&amp;f.bundleName.separator=%7C&amp;f.bundleName.encapsulator=%22&amp;f.ngram_simplequery_search.split=true&amp;f.ngram_simplequery_search.separator=%7C&amp;f.ngram_simplequery_search.encapsulator=%22&amp;f.group_map.split=true&amp;f.group_map.separator=%7C&amp;f.group_map.encapsulator=%22&amp;f.owningColl.split=true&amp;f.owningColl.separator=%7C&amp;f.owningColl.encapsulator=%22&amp;f.p_group_id.split=true&amp;f.p_group_id.separator=%7C&amp;f.p_group_id.encapsulator=%22&amp;f.p_group_name.split=true&amp;f.p_group_name.separator=%7C&amp;f.p_group_name.encapsulator=%22&amp;wt=javabin&amp;version=2 HTTP/1.1&quot; 409 156
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:44:00 +0200] &quot;POST /solr/datatables/update?wt=javabin&amp;version=2 HTTP/1.1&quot; 200 41
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:44:00 +0200] &quot;POST /solr/datatables/update HTTP/1.1&quot; 200 40
|
||||||
|
</code></pre>
|
||||||
|
|
||||||
|
<ul>
|
||||||
|
<li>Very interesting&hellip; it creates the core and then fails somehow</li>
|
||||||
|
</ul>
|
||||||
</description>
|
</description>
|
||||||
</item>
|
</item>
|
||||||
|
|
||||||
|
2
public/js/cookieconsent.min.js
vendored
2
public/js/cookieconsent.min.js
vendored
File diff suppressed because one or more lines are too long
@ -69,14 +69,6 @@
|
|||||||
<a class="nav-link active" href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
<a class="nav-link active" href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
||||||
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/">CGSpace Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/notes/">Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/post/">Posts</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/">Tags</a>
|
|
||||||
|
|
||||||
|
|
||||||
</nav>
|
</nav>
|
||||||
</div>
|
</div>
|
||||||
|
@ -69,14 +69,6 @@
|
|||||||
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
||||||
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/">CGSpace Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/notes/">Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/post/">Posts</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/">Tags</a>
|
|
||||||
|
|
||||||
|
|
||||||
</nav>
|
</nav>
|
||||||
</div>
|
</div>
|
||||||
@ -108,7 +100,7 @@
|
|||||||
|
|
||||||
</p>
|
</p>
|
||||||
</header>
|
</header>
|
||||||
2017-01-02 I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error I tested on DSpace Test as well and it doesn’t work there either I asked on the dspace-tech mailing list because it seems to be broken, and actually now I’m not sure if we’ve ever had the sharding task run successfully over all these years
|
2017-01-02 I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error I tested on DSpace Test as well and it doesn’t work there either I asked on the dspace-tech mailing list because it seems to be broken, and actually now I’m not sure if we’ve ever had the sharding task run successfully over all these years 2017-01-04 I tried to shard my local dev instance and it fails the same way: $ JAVA_OPTS="-Xms768m -Xmx768m -Dfile.
|
||||||
<a href='https://alanorth.github.io/cgspace-notes/2017-01/'>Read more →</a>
|
<a href='https://alanorth.github.io/cgspace-notes/2017-01/'>Read more →</a>
|
||||||
</article>
|
</article>
|
||||||
|
|
||||||
|
@ -24,6 +24,88 @@
|
|||||||
<li>I tested on DSpace Test as well and it doesn&rsquo;t work there either</li>
|
<li>I tested on DSpace Test as well and it doesn&rsquo;t work there either</li>
|
||||||
<li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&rsquo;m not sure if we&rsquo;ve ever had the sharding task run successfully over all these years</li>
|
<li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&rsquo;m not sure if we&rsquo;ve ever had the sharding task run successfully over all these years</li>
|
||||||
</ul>
|
</ul>
|
||||||
|
|
||||||
|
<h2 id="2017-01-04">2017-01-04</h2>
|
||||||
|
|
||||||
|
<ul>
|
||||||
|
<li>I tried to shard my local dev instance and it fails the same way:</li>
|
||||||
|
</ul>
|
||||||
|
|
||||||
|
<pre><code>$ JAVA_OPTS=&quot;-Xms768m -Xmx768m -Dfile.encoding=UTF-8&quot; ~/dspace/bin/dspace stats-util -s
|
||||||
|
Moving: 9318 into core statistics-2016
|
||||||
|
Exception: IOException occured when talking to server at: http://localhost:8081/solr//statistics-2016
|
||||||
|
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://localhost:8081/solr//statistics-2016
|
||||||
|
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:566)
|
||||||
|
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
|
||||||
|
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
|
||||||
|
at org.dspace.statistics.SolrLogger.shardSolrIndex(SourceFile:2291)
|
||||||
|
at org.dspace.statistics.util.StatisticsClient.main(StatisticsClient.java:106)
|
||||||
|
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
|
||||||
|
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
|
||||||
|
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
|
||||||
|
at java.lang.reflect.Method.invoke(Method.java:498)
|
||||||
|
at org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:226)
|
||||||
|
at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:78)
|
||||||
|
Caused by: org.apache.http.client.ClientProtocolException
|
||||||
|
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:867)
|
||||||
|
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
|
||||||
|
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
|
||||||
|
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
|
||||||
|
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:448)
|
||||||
|
... 10 more
|
||||||
|
Caused by: org.apache.http.client.NonRepeatableRequestException: Cannot retry request with a non-repeatable request entity. The cause lists the reason the original request failed.
|
||||||
|
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:659)
|
||||||
|
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
|
||||||
|
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
|
||||||
|
... 14 more
|
||||||
|
Caused by: java.net.SocketException: Broken pipe (Write failed)
|
||||||
|
at java.net.SocketOutputStream.socketWrite0(Native Method)
|
||||||
|
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:109)
|
||||||
|
at java.net.SocketOutputStream.write(SocketOutputStream.java:153)
|
||||||
|
at org.apache.http.impl.io.AbstractSessionOutputBuffer.write(AbstractSessionOutputBuffer.java:181)
|
||||||
|
at org.apache.http.impl.io.ChunkedOutputStream.flushCacheWithAppend(ChunkedOutputStream.java:124)
|
||||||
|
at org.apache.http.impl.io.ChunkedOutputStream.write(ChunkedOutputStream.java:181)
|
||||||
|
at org.apache.http.entity.InputStreamEntity.writeTo(InputStreamEntity.java:132)
|
||||||
|
at org.apache.http.entity.HttpEntityWrapper.writeTo(HttpEntityWrapper.java:89)
|
||||||
|
at org.apache.http.impl.client.EntityEnclosingRequestWrapper$EntityWrapper.writeTo(EntityEnclosingRequestWrapper.java:108)
|
||||||
|
at org.apache.http.impl.entity.EntitySerializer.serialize(EntitySerializer.java:117)
|
||||||
|
at org.apache.http.impl.AbstractHttpClientConnection.sendRequestEntity(AbstractHttpClientConnection.java:265)
|
||||||
|
at org.apache.http.impl.conn.ManagedClientConnectionImpl.sendRequestEntity(ManagedClientConnectionImpl.java:203)
|
||||||
|
at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:236)
|
||||||
|
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:121)
|
||||||
|
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
|
||||||
|
... 16 more
|
||||||
|
</code></pre>
|
||||||
|
|
||||||
|
<ul>
|
||||||
|
<li>And the DSpace log shows:</li>
|
||||||
|
</ul>
|
||||||
|
|
||||||
|
<pre><code>2017-01-04 22:39:05,412 INFO org.dspace.statistics.SolrLogger @ Created core with name: statistics-2016
|
||||||
|
2017-01-04 22:39:05,412 INFO org.dspace.statistics.SolrLogger @ Moving: 9318 records into core statistics-2016
|
||||||
|
2017-01-04 22:39:07,310 INFO org.apache.http.impl.client.SystemDefaultHttpClient @ I/O exception (java.net.SocketException) caught when processing request to {}-&gt;http://localhost:8081: Broken pipe (Write failed)
|
||||||
|
2017-01-04 22:39:07,310 INFO org.apache.http.impl.client.SystemDefaultHttpClient @ Retrying request to {}-&gt;http://localhost:8081
|
||||||
|
</code></pre>
|
||||||
|
|
||||||
|
<ul>
|
||||||
|
<li>Despite failing instantly, a <code>statistics-2016</code> directory was created, but it only has a data dir (no conf)</li>
|
||||||
|
<li>The Tomcat access logs show more:</li>
|
||||||
|
</ul>
|
||||||
|
|
||||||
|
<pre><code>127.0.0.1 - - [04/Jan/2017:22:39:05 +0200] &quot;GET /solr/statistics/select?q=type%3A2+AND+id%3A1&amp;wt=javabin&amp;version=2 HTTP/1.1&quot; 200 107
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:39:05 +0200] &quot;GET /solr/statistics/select?q=*%3A*&amp;rows=0&amp;facet=true&amp;facet.range=time&amp;facet.range.start=NOW%2FYEAR-17YEARS&amp;facet.range.end=NOW%2FYEAR%2B0YEARS&amp;facet.range.gap=%2B1YEAR&amp;facet.mincount=1&amp;wt=javabin&amp;version=2 HTTP/1.1&quot; 200 423
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:39:05 +0200] &quot;GET /solr/admin/cores?action=STATUS&amp;core=statistics-2016&amp;indexInfo=true&amp;wt=javabin&amp;version=2 HTTP/1.1&quot; 200 77
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:39:05 +0200] &quot;GET /solr/admin/cores?action=CREATE&amp;name=statistics-2016&amp;instanceDir=statistics&amp;dataDir=%2FUsers%2Faorth%2Fdspace%2Fsolr%2Fstatistics-2016%2Fdata&amp;wt=javabin&amp;version=2 HTTP/1.1&quot; 200 63
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:39:07 +0200] &quot;GET /solr/statistics/select?csv.mv.separator=%7C&amp;q=*%3A*&amp;fq=time%3A%28%5B2016%5C-01%5C-01T00%5C%3A00%5C%3A00Z+TO+2017%5C-01%5C-01T00%5C%3A00%5C%3A00Z%5D+NOT+2017%5C-01%5C-01T00%5C%3A00%5C%3A00Z%29&amp;rows=10000&amp;wt=csv HTTP/1.1&quot; 200 4359517
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:39:07 +0200] &quot;GET /solr/statistics/admin/luke?show=schema&amp;wt=javabin&amp;version=2 HTTP/1.1&quot; 200 16248
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:39:07 +0200] &quot;POST /solr//statistics-2016/update/csv?commit=true&amp;softCommit=false&amp;waitSearcher=true&amp;f.previousWorkflowStep.split=true&amp;f.previousWorkflowStep.separator=%7C&amp;f.previousWorkflowStep.encapsulator=%22&amp;f.actingGroupId.split=true&amp;f.actingGroupId.separator=%7C&amp;f.actingGroupId.encapsulator=%22&amp;f.containerCommunity.split=true&amp;f.containerCommunity.separator=%7C&amp;f.containerCommunity.encapsulator=%22&amp;f.range.split=true&amp;f.range.separator=%7C&amp;f.range.encapsulator=%22&amp;f.containerItem.split=true&amp;f.containerItem.separator=%7C&amp;f.containerItem.encapsulator=%22&amp;f.p_communities_map.split=true&amp;f.p_communities_map.separator=%7C&amp;f.p_communities_map.encapsulator=%22&amp;f.ngram_query_search.split=true&amp;f.ngram_query_search.separator=%7C&amp;f.ngram_query_search.encapsulator=%22&amp;f.containerBitstream.split=true&amp;f.containerBitstream.separator=%7C&amp;f.containerBitstream.encapsulator=%22&amp;f.owningItem.split=true&amp;f.owningItem.separator=%7C&amp;f.owningItem.encapsulator=%22&amp;f.actingGroupParentId.split=true&amp;f.actingGroupParentId.separator=%7C&amp;f.actingGroupParentId.encapsulator=%22&amp;f.text.split=true&amp;f.text.separator=%7C&amp;f.text.encapsulator=%22&amp;f.simple_query_search.split=true&amp;f.simple_query_search.separator=%7C&amp;f.simple_query_search.encapsulator=%22&amp;f.owningComm.split=true&amp;f.owningComm.separator=%7C&amp;f.owningComm.encapsulator=%22&amp;f.owner.split=true&amp;f.owner.separator=%7C&amp;f.owner.encapsulator=%22&amp;f.filterquery.split=true&amp;f.filterquery.separator=%7C&amp;f.filterquery.encapsulator=%22&amp;f.p_group_map.split=true&amp;f.p_group_map.separator=%7C&amp;f.p_group_map.encapsulator=%22&amp;f.actorMemberGroupId.split=true&amp;f.actorMemberGroupId.separator=%7C&amp;f.actorMemberGroupId.encapsulator=%22&amp;f.bitstreamId.split=true&amp;f.bitstreamId.separator=%7C&amp;f.bitstreamId.encapsulator=%22&amp;f.group_name.split=true&amp;f.group_name.separator=%7C&amp;f.group_name.encapsulator=%22&amp;f.p_communities_name.split=true&amp;f.p_communities_name.separator=%7C&amp;f.p_communities_name.encapsulator=%22&amp;f.query.split=true&amp;f.query.separator=%7C&amp;f.query.encapsulator=%22&amp;f.workflowStep.split=true&amp;f.workflowStep.separator=%7C&amp;f.workflowStep.encapsulator=%22&amp;f.containerCollection.split=true&amp;f.containerCollection.separator=%7C&amp;f.containerCollection.encapsulator=%22&amp;f.complete_query_search.split=true&amp;f.complete_query_search.separator=%7C&amp;f.complete_query_search.encapsulator=%22&amp;f.p_communities_id.split=true&amp;f.p_communities_id.separator=%7C&amp;f.p_communities_id.encapsulator=%22&amp;f.rangeDescription.split=true&amp;f.rangeDescription.separator=%7C&amp;f.rangeDescription.encapsulator=%22&amp;f.group_id.split=true&amp;f.group_id.separator=%7C&amp;f.group_id.encapsulator=%22&amp;f.bundleName.split=true&amp;f.bundleName.separator=%7C&amp;f.bundleName.encapsulator=%22&amp;f.ngram_simplequery_search.split=true&amp;f.ngram_simplequery_search.separator=%7C&amp;f.ngram_simplequery_search.encapsulator=%22&amp;f.group_map.split=true&amp;f.group_map.separator=%7C&amp;f.group_map.encapsulator=%22&amp;f.owningColl.split=true&amp;f.owningColl.separator=%7C&amp;f.owningColl.encapsulator=%22&amp;f.p_group_id.split=true&amp;f.p_group_id.separator=%7C&amp;f.p_group_id.encapsulator=%22&amp;f.p_group_name.split=true&amp;f.p_group_name.separator=%7C&amp;f.p_group_name.encapsulator=%22&amp;wt=javabin&amp;version=2 HTTP/1.1&quot; 409 156
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:44:00 +0200] &quot;POST /solr/datatables/update?wt=javabin&amp;version=2 HTTP/1.1&quot; 200 41
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:44:00 +0200] &quot;POST /solr/datatables/update HTTP/1.1&quot; 200 40
|
||||||
|
</code></pre>
|
||||||
|
|
||||||
|
<ul>
|
||||||
|
<li>Very interesting&hellip; it creates the core and then fails somehow</li>
|
||||||
|
</ul>
|
||||||
</description>
|
</description>
|
||||||
</item>
|
</item>
|
||||||
|
|
||||||
|
@ -69,14 +69,6 @@
|
|||||||
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
||||||
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/">CGSpace Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/notes/">Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/post/">Posts</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/">Tags</a>
|
|
||||||
|
|
||||||
|
|
||||||
</nav>
|
</nav>
|
||||||
</div>
|
</div>
|
||||||
|
@ -69,14 +69,6 @@
|
|||||||
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
||||||
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/">CGSpace Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/notes/">Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/post/">Posts</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/">Tags</a>
|
|
||||||
|
|
||||||
|
|
||||||
</nav>
|
</nav>
|
||||||
</div>
|
</div>
|
||||||
@ -108,7 +100,7 @@
|
|||||||
|
|
||||||
</p>
|
</p>
|
||||||
</header>
|
</header>
|
||||||
2017-01-02 I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error I tested on DSpace Test as well and it doesn’t work there either I asked on the dspace-tech mailing list because it seems to be broken, and actually now I’m not sure if we’ve ever had the sharding task run successfully over all these years
|
2017-01-02 I checked to see if the Solr sharding task that is supposed to run on January 1st had run and saw there was an error I tested on DSpace Test as well and it doesn’t work there either I asked on the dspace-tech mailing list because it seems to be broken, and actually now I’m not sure if we’ve ever had the sharding task run successfully over all these years 2017-01-04 I tried to shard my local dev instance and it fails the same way: $ JAVA_OPTS="-Xms768m -Xmx768m -Dfile.
|
||||||
<a href='https://alanorth.github.io/cgspace-notes/2017-01/'>Read more →</a>
|
<a href='https://alanorth.github.io/cgspace-notes/2017-01/'>Read more →</a>
|
||||||
</article>
|
</article>
|
||||||
|
|
||||||
|
@ -23,6 +23,88 @@
|
|||||||
<li>I tested on DSpace Test as well and it doesn&rsquo;t work there either</li>
|
<li>I tested on DSpace Test as well and it doesn&rsquo;t work there either</li>
|
||||||
<li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&rsquo;m not sure if we&rsquo;ve ever had the sharding task run successfully over all these years</li>
|
<li>I asked on the dspace-tech mailing list because it seems to be broken, and actually now I&rsquo;m not sure if we&rsquo;ve ever had the sharding task run successfully over all these years</li>
|
||||||
</ul>
|
</ul>
|
||||||
|
|
||||||
|
<h2 id="2017-01-04">2017-01-04</h2>
|
||||||
|
|
||||||
|
<ul>
|
||||||
|
<li>I tried to shard my local dev instance and it fails the same way:</li>
|
||||||
|
</ul>
|
||||||
|
|
||||||
|
<pre><code>$ JAVA_OPTS=&quot;-Xms768m -Xmx768m -Dfile.encoding=UTF-8&quot; ~/dspace/bin/dspace stats-util -s
|
||||||
|
Moving: 9318 into core statistics-2016
|
||||||
|
Exception: IOException occured when talking to server at: http://localhost:8081/solr//statistics-2016
|
||||||
|
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://localhost:8081/solr//statistics-2016
|
||||||
|
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:566)
|
||||||
|
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
|
||||||
|
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
|
||||||
|
at org.dspace.statistics.SolrLogger.shardSolrIndex(SourceFile:2291)
|
||||||
|
at org.dspace.statistics.util.StatisticsClient.main(StatisticsClient.java:106)
|
||||||
|
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
|
||||||
|
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
|
||||||
|
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
|
||||||
|
at java.lang.reflect.Method.invoke(Method.java:498)
|
||||||
|
at org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:226)
|
||||||
|
at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:78)
|
||||||
|
Caused by: org.apache.http.client.ClientProtocolException
|
||||||
|
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:867)
|
||||||
|
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
|
||||||
|
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
|
||||||
|
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
|
||||||
|
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:448)
|
||||||
|
... 10 more
|
||||||
|
Caused by: org.apache.http.client.NonRepeatableRequestException: Cannot retry request with a non-repeatable request entity. The cause lists the reason the original request failed.
|
||||||
|
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:659)
|
||||||
|
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
|
||||||
|
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
|
||||||
|
... 14 more
|
||||||
|
Caused by: java.net.SocketException: Broken pipe (Write failed)
|
||||||
|
at java.net.SocketOutputStream.socketWrite0(Native Method)
|
||||||
|
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:109)
|
||||||
|
at java.net.SocketOutputStream.write(SocketOutputStream.java:153)
|
||||||
|
at org.apache.http.impl.io.AbstractSessionOutputBuffer.write(AbstractSessionOutputBuffer.java:181)
|
||||||
|
at org.apache.http.impl.io.ChunkedOutputStream.flushCacheWithAppend(ChunkedOutputStream.java:124)
|
||||||
|
at org.apache.http.impl.io.ChunkedOutputStream.write(ChunkedOutputStream.java:181)
|
||||||
|
at org.apache.http.entity.InputStreamEntity.writeTo(InputStreamEntity.java:132)
|
||||||
|
at org.apache.http.entity.HttpEntityWrapper.writeTo(HttpEntityWrapper.java:89)
|
||||||
|
at org.apache.http.impl.client.EntityEnclosingRequestWrapper$EntityWrapper.writeTo(EntityEnclosingRequestWrapper.java:108)
|
||||||
|
at org.apache.http.impl.entity.EntitySerializer.serialize(EntitySerializer.java:117)
|
||||||
|
at org.apache.http.impl.AbstractHttpClientConnection.sendRequestEntity(AbstractHttpClientConnection.java:265)
|
||||||
|
at org.apache.http.impl.conn.ManagedClientConnectionImpl.sendRequestEntity(ManagedClientConnectionImpl.java:203)
|
||||||
|
at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:236)
|
||||||
|
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:121)
|
||||||
|
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
|
||||||
|
... 16 more
|
||||||
|
</code></pre>
|
||||||
|
|
||||||
|
<ul>
|
||||||
|
<li>And the DSpace log shows:</li>
|
||||||
|
</ul>
|
||||||
|
|
||||||
|
<pre><code>2017-01-04 22:39:05,412 INFO org.dspace.statistics.SolrLogger @ Created core with name: statistics-2016
|
||||||
|
2017-01-04 22:39:05,412 INFO org.dspace.statistics.SolrLogger @ Moving: 9318 records into core statistics-2016
|
||||||
|
2017-01-04 22:39:07,310 INFO org.apache.http.impl.client.SystemDefaultHttpClient @ I/O exception (java.net.SocketException) caught when processing request to {}-&gt;http://localhost:8081: Broken pipe (Write failed)
|
||||||
|
2017-01-04 22:39:07,310 INFO org.apache.http.impl.client.SystemDefaultHttpClient @ Retrying request to {}-&gt;http://localhost:8081
|
||||||
|
</code></pre>
|
||||||
|
|
||||||
|
<ul>
|
||||||
|
<li>Despite failing instantly, a <code>statistics-2016</code> directory was created, but it only has a data dir (no conf)</li>
|
||||||
|
<li>The Tomcat access logs show more:</li>
|
||||||
|
</ul>
|
||||||
|
|
||||||
|
<pre><code>127.0.0.1 - - [04/Jan/2017:22:39:05 +0200] &quot;GET /solr/statistics/select?q=type%3A2+AND+id%3A1&amp;wt=javabin&amp;version=2 HTTP/1.1&quot; 200 107
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:39:05 +0200] &quot;GET /solr/statistics/select?q=*%3A*&amp;rows=0&amp;facet=true&amp;facet.range=time&amp;facet.range.start=NOW%2FYEAR-17YEARS&amp;facet.range.end=NOW%2FYEAR%2B0YEARS&amp;facet.range.gap=%2B1YEAR&amp;facet.mincount=1&amp;wt=javabin&amp;version=2 HTTP/1.1&quot; 200 423
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:39:05 +0200] &quot;GET /solr/admin/cores?action=STATUS&amp;core=statistics-2016&amp;indexInfo=true&amp;wt=javabin&amp;version=2 HTTP/1.1&quot; 200 77
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:39:05 +0200] &quot;GET /solr/admin/cores?action=CREATE&amp;name=statistics-2016&amp;instanceDir=statistics&amp;dataDir=%2FUsers%2Faorth%2Fdspace%2Fsolr%2Fstatistics-2016%2Fdata&amp;wt=javabin&amp;version=2 HTTP/1.1&quot; 200 63
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:39:07 +0200] &quot;GET /solr/statistics/select?csv.mv.separator=%7C&amp;q=*%3A*&amp;fq=time%3A%28%5B2016%5C-01%5C-01T00%5C%3A00%5C%3A00Z+TO+2017%5C-01%5C-01T00%5C%3A00%5C%3A00Z%5D+NOT+2017%5C-01%5C-01T00%5C%3A00%5C%3A00Z%29&amp;rows=10000&amp;wt=csv HTTP/1.1&quot; 200 4359517
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:39:07 +0200] &quot;GET /solr/statistics/admin/luke?show=schema&amp;wt=javabin&amp;version=2 HTTP/1.1&quot; 200 16248
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:39:07 +0200] &quot;POST /solr//statistics-2016/update/csv?commit=true&amp;softCommit=false&amp;waitSearcher=true&amp;f.previousWorkflowStep.split=true&amp;f.previousWorkflowStep.separator=%7C&amp;f.previousWorkflowStep.encapsulator=%22&amp;f.actingGroupId.split=true&amp;f.actingGroupId.separator=%7C&amp;f.actingGroupId.encapsulator=%22&amp;f.containerCommunity.split=true&amp;f.containerCommunity.separator=%7C&amp;f.containerCommunity.encapsulator=%22&amp;f.range.split=true&amp;f.range.separator=%7C&amp;f.range.encapsulator=%22&amp;f.containerItem.split=true&amp;f.containerItem.separator=%7C&amp;f.containerItem.encapsulator=%22&amp;f.p_communities_map.split=true&amp;f.p_communities_map.separator=%7C&amp;f.p_communities_map.encapsulator=%22&amp;f.ngram_query_search.split=true&amp;f.ngram_query_search.separator=%7C&amp;f.ngram_query_search.encapsulator=%22&amp;f.containerBitstream.split=true&amp;f.containerBitstream.separator=%7C&amp;f.containerBitstream.encapsulator=%22&amp;f.owningItem.split=true&amp;f.owningItem.separator=%7C&amp;f.owningItem.encapsulator=%22&amp;f.actingGroupParentId.split=true&amp;f.actingGroupParentId.separator=%7C&amp;f.actingGroupParentId.encapsulator=%22&amp;f.text.split=true&amp;f.text.separator=%7C&amp;f.text.encapsulator=%22&amp;f.simple_query_search.split=true&amp;f.simple_query_search.separator=%7C&amp;f.simple_query_search.encapsulator=%22&amp;f.owningComm.split=true&amp;f.owningComm.separator=%7C&amp;f.owningComm.encapsulator=%22&amp;f.owner.split=true&amp;f.owner.separator=%7C&amp;f.owner.encapsulator=%22&amp;f.filterquery.split=true&amp;f.filterquery.separator=%7C&amp;f.filterquery.encapsulator=%22&amp;f.p_group_map.split=true&amp;f.p_group_map.separator=%7C&amp;f.p_group_map.encapsulator=%22&amp;f.actorMemberGroupId.split=true&amp;f.actorMemberGroupId.separator=%7C&amp;f.actorMemberGroupId.encapsulator=%22&amp;f.bitstreamId.split=true&amp;f.bitstreamId.separator=%7C&amp;f.bitstreamId.encapsulator=%22&amp;f.group_name.split=true&amp;f.group_name.separator=%7C&amp;f.group_name.encapsulator=%22&amp;f.p_communities_name.split=true&amp;f.p_communities_name.separator=%7C&amp;f.p_communities_name.encapsulator=%22&amp;f.query.split=true&amp;f.query.separator=%7C&amp;f.query.encapsulator=%22&amp;f.workflowStep.split=true&amp;f.workflowStep.separator=%7C&amp;f.workflowStep.encapsulator=%22&amp;f.containerCollection.split=true&amp;f.containerCollection.separator=%7C&amp;f.containerCollection.encapsulator=%22&amp;f.complete_query_search.split=true&amp;f.complete_query_search.separator=%7C&amp;f.complete_query_search.encapsulator=%22&amp;f.p_communities_id.split=true&amp;f.p_communities_id.separator=%7C&amp;f.p_communities_id.encapsulator=%22&amp;f.rangeDescription.split=true&amp;f.rangeDescription.separator=%7C&amp;f.rangeDescription.encapsulator=%22&amp;f.group_id.split=true&amp;f.group_id.separator=%7C&amp;f.group_id.encapsulator=%22&amp;f.bundleName.split=true&amp;f.bundleName.separator=%7C&amp;f.bundleName.encapsulator=%22&amp;f.ngram_simplequery_search.split=true&amp;f.ngram_simplequery_search.separator=%7C&amp;f.ngram_simplequery_search.encapsulator=%22&amp;f.group_map.split=true&amp;f.group_map.separator=%7C&amp;f.group_map.encapsulator=%22&amp;f.owningColl.split=true&amp;f.owningColl.separator=%7C&amp;f.owningColl.encapsulator=%22&amp;f.p_group_id.split=true&amp;f.p_group_id.separator=%7C&amp;f.p_group_id.encapsulator=%22&amp;f.p_group_name.split=true&amp;f.p_group_name.separator=%7C&amp;f.p_group_name.encapsulator=%22&amp;wt=javabin&amp;version=2 HTTP/1.1&quot; 409 156
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:44:00 +0200] &quot;POST /solr/datatables/update?wt=javabin&amp;version=2 HTTP/1.1&quot; 200 41
|
||||||
|
127.0.0.1 - - [04/Jan/2017:22:44:00 +0200] &quot;POST /solr/datatables/update HTTP/1.1&quot; 200 40
|
||||||
|
</code></pre>
|
||||||
|
|
||||||
|
<ul>
|
||||||
|
<li>Very interesting&hellip; it creates the core and then fails somehow</li>
|
||||||
|
</ul>
|
||||||
</description>
|
</description>
|
||||||
</item>
|
</item>
|
||||||
|
|
||||||
|
@ -69,14 +69,6 @@
|
|||||||
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
<a class="nav-link " href="https://alanorth.github.io/cgspace-notes/">Home</a>
|
||||||
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/">CGSpace Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/notes/">Notes</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/post/">Posts</a>
|
|
||||||
|
|
||||||
<a class="nav-link" href="https://alanorth.github.io/cgspace-notes/tags/">Tags</a>
|
|
||||||
|
|
||||||
|
|
||||||
</nav>
|
</nav>
|
||||||
</div>
|
</div>
|
||||||
|
Loading…
Reference in New Issue
Block a user