Update notes

This commit is contained in:
Alan Orth 2020-11-29 08:40:58 +02:00
parent b196186a0c
commit 7a0d067e4c
Signed by: alanorth
GPG Key ID: 0FB860CC9C45B1B9
27 changed files with 158 additions and 36 deletions

View File

@ -485,4 +485,16 @@ facet=true&f.owningComm.facet.limit=5&f.owningComm.facet.offset=5&f.countryCode.
- Atmire responded about the duplicate fields in Solr and said they don't see them
- I sent a few examples that I found after thirty seconds of randomly looking in several Solr cores
## 2020-11-27
- I finished processing the statistics-2016 core with the AtomicStatisticsUpdateCLI tool so I started the statistics-2015 core
## 2020-11-28
- I finished processing the statistics-2015 core with the AtomicStatisticsUpdateCLI tool so I started the statistics-2014 core
- I finished processing the statistics-2014 core with the AtomicStatisticsUpdateCLI tool so I started the statistics-2013 core
- I finished processing the statistics-2014 core with the AtomicStatisticsUpdateCLI tool so I started the statistics-2012 core
- I finished processing the statistics-2014 core with the AtomicStatisticsUpdateCLI tool so I started the statistics-2012 core
- I finished processing the statistics-2014 core with the AtomicStatisticsUpdateCLI tool so I started the statistics-2010 core
<!-- vim: set sw=2 ts=2: -->

View File

@ -451,3 +451,73 @@ $ chrt -b 0 dspace dsrun com.atmire.statistics.util.update.atomic.AtomicStatisti
```
It took ~24 hours to finish processing this core.
## statistics-2016
The statistics-2016 core, in 12-hour batches:
```
$ chrt -b 0 dspace dsrun com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdateCLI -t 12 -c statistics-2016
```
It took ~20 hours to finish processing this core.
## statistics-2015
The statistics-2015 core, in 12-hour batches:
```
$ chrt -b 0 dspace dsrun com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdateCLI -t 12 -c statistics-2015
```
It took ~17 hours to finish processing this core.
## statistics-2014
The statistics-2014 core, in 12-hour batches:
```
$ chrt -b 0 dspace dsrun com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdateCLI -t 12 -c statistics-2014
```
It took ~12 hours to finish processing this core.
## statistics-2013
The statistics-2013 core, in 12-hour batches:
```
$ chrt -b 0 dspace dsrun com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdateCLI -t 12 -c statistics-2013
```
It took ~3 hours to finish processing this core.
## statistics-2012
The statistics-2012 core, in 12-hour batches:
```
$ chrt -b 0 dspace dsrun com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdateCLI -t 12 -c statistics-2012
```
It took ~2 hours to finish processing this core.
## statistics-2011
The statistics-2011 core, in 12-hour batches:
```
$ chrt -b 0 dspace dsrun com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdateCLI -t 12 -c statistics-2011
```
It took 1 hour to finish processing this core.
## statistics-2010
The statistics-2010 core, in 12-hour batches:
```
$ chrt -b 0 dspace dsrun com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdateCLI -t 12 -c statistics-2010
```
It took five minutes to finish processing this core.

View File

@ -17,7 +17,7 @@ So far we&rsquo;ve spent at least fifty hours to process the statistics and stat
<meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2020-11/" />
<meta property="article:published_time" content="2020-11-01T13:11:54+02:00" />
<meta property="article:modified_time" content="2020-11-25T18:36:14+02:00" />
<meta property="article:modified_time" content="2020-11-25T22:32:41+02:00" />
<meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="November, 2020"/>
@ -39,9 +39,9 @@ So far we&rsquo;ve spent at least fifty hours to process the statistics and stat
"@type": "BlogPosting",
"headline": "November, 2020",
"url": "https://alanorth.github.io/cgspace-notes/2020-11/",
"wordCount": "3303",
"wordCount": "3401",
"datePublished": "2020-11-01T13:11:54+02:00",
"dateModified": "2020-11-25T18:36:14+02:00",
"dateModified": "2020-11-25T22:32:41+02:00",
"author": {
"@type": "Person",
"name": "Alan Orth"
@ -657,6 +657,18 @@ COPY 87411
</ul>
</li>
</ul>
<h2 id="2020-11-27">2020-11-27</h2>
<ul>
<li>I finished processing the statistics-2016 core with the AtomicStatisticsUpdateCLI tool so I started the statistics-2015 core</li>
</ul>
<h2 id="2020-11-28">2020-11-28</h2>
<ul>
<li>I finished processing the statistics-2015 core with the AtomicStatisticsUpdateCLI tool so I started the statistics-2014 core</li>
<li>I finished processing the statistics-2014 core with the AtomicStatisticsUpdateCLI tool so I started the statistics-2013 core</li>
<li>I finished processing the statistics-2014 core with the AtomicStatisticsUpdateCLI tool so I started the statistics-2012 core</li>
<li>I finished processing the statistics-2014 core with the AtomicStatisticsUpdateCLI tool so I started the statistics-2012 core</li>
<li>I finished processing the statistics-2014 core with the AtomicStatisticsUpdateCLI tool so I started the statistics-2010 core</li>
</ul>
<!-- raw HTML omitted -->

View File

@ -9,7 +9,7 @@
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
<meta property="og:type" content="website" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/" />
<meta property="og:updated_time" content="2020-11-25T18:36:14+02:00" />
<meta property="og:updated_time" content="2020-11-25T22:32:41+02:00" />
<meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Categories"/>

View File

@ -9,7 +9,7 @@
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
<meta property="og:type" content="website" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
<meta property="og:updated_time" content="2020-11-25T18:36:14+02:00" />
<meta property="og:updated_time" content="2020-11-25T22:32:41+02:00" />
<meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Notes"/>

View File

@ -9,7 +9,7 @@
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
<meta property="og:type" content="website" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
<meta property="og:updated_time" content="2020-11-25T18:36:14+02:00" />
<meta property="og:updated_time" content="2020-11-25T22:32:41+02:00" />
<meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Notes"/>

View File

@ -9,7 +9,7 @@
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
<meta property="og:type" content="website" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
<meta property="og:updated_time" content="2020-11-25T18:36:14+02:00" />
<meta property="og:updated_time" content="2020-11-25T22:32:41+02:00" />
<meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Notes"/>

View File

@ -9,7 +9,7 @@
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
<meta property="og:type" content="website" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
<meta property="og:updated_time" content="2020-11-25T18:36:14+02:00" />
<meta property="og:updated_time" content="2020-11-25T22:32:41+02:00" />
<meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Notes"/>

View File

@ -9,7 +9,7 @@
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
<meta property="og:type" content="website" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
<meta property="og:updated_time" content="2020-11-25T18:36:14+02:00" />
<meta property="og:updated_time" content="2020-11-25T22:32:41+02:00" />
<meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Notes"/>

View File

@ -10,7 +10,7 @@
<meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/cgspace-dspace6-upgrade/" />
<meta property="article:published_time" content="2020-11-15T13:27:35+02:00" />
<meta property="article:modified_time" content="2020-11-24T21:47:24+02:00" />
<meta property="article:modified_time" content="2020-11-25T22:32:41+02:00" />
<meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="CGSpace DSpace 6 Upgrade"/>
@ -25,9 +25,9 @@
"@type": "BlogPosting",
"headline": "CGSpace DSpace 6 Upgrade",
"url": "https://alanorth.github.io/cgspace-notes/cgspace-dspace6-upgrade/",
"wordCount": "1381",
"wordCount": "1570",
"datePublished": "2020-11-15T13:27:35+02:00",
"dateModified": "2020-11-24T21:47:24+02:00",
"dateModified": "2020-11-25T22:32:41+02:00",
"author": {
"@type": "Person",
"name": "Alan Orth"
@ -420,6 +420,34 @@ $ chrt -b 0 dspace solr-upgrade-statistics-6x -n 2500000 -i statistics-2018
<p>The statistics-2017 core, in 12-hour batches:</p>
<pre><code>$ chrt -b 0 dspace dsrun com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdateCLI -t 12 -c statistics-2017
</code></pre><p>It took ~24 hours to finish processing this core.</p>
<h2 id="statistics-2016-1">statistics-2016</h2>
<p>The statistics-2016 core, in 12-hour batches:</p>
<pre><code>$ chrt -b 0 dspace dsrun com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdateCLI -t 12 -c statistics-2016
</code></pre><p>It took ~20 hours to finish processing this core.</p>
<h2 id="statistics-2015-1">statistics-2015</h2>
<p>The statistics-2015 core, in 12-hour batches:</p>
<pre><code>$ chrt -b 0 dspace dsrun com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdateCLI -t 12 -c statistics-2015
</code></pre><p>It took ~17 hours to finish processing this core.</p>
<h2 id="statistics-2014-1">statistics-2014</h2>
<p>The statistics-2014 core, in 12-hour batches:</p>
<pre><code>$ chrt -b 0 dspace dsrun com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdateCLI -t 12 -c statistics-2014
</code></pre><p>It took ~12 hours to finish processing this core.</p>
<h2 id="statistics-2013-1">statistics-2013</h2>
<p>The statistics-2013 core, in 12-hour batches:</p>
<pre><code>$ chrt -b 0 dspace dsrun com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdateCLI -t 12 -c statistics-2013
</code></pre><p>It took ~3 hours to finish processing this core.</p>
<h2 id="statistics-2012-1">statistics-2012</h2>
<p>The statistics-2012 core, in 12-hour batches:</p>
<pre><code>$ chrt -b 0 dspace dsrun com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdateCLI -t 12 -c statistics-2012
</code></pre><p>It took ~2 hours to finish processing this core.</p>
<h2 id="statistics-2011-1">statistics-2011</h2>
<p>The statistics-2011 core, in 12-hour batches:</p>
<pre><code>$ chrt -b 0 dspace dsrun com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdateCLI -t 12 -c statistics-2011
</code></pre><p>It took 1 hour to finish processing this core.</p>
<h2 id="statistics-2010-1">statistics-2010</h2>
<p>The statistics-2010 core, in 12-hour batches:</p>
<pre><code>$ chrt -b 0 dspace dsrun com.atmire.statistics.util.update.atomic.AtomicStatisticsUpdateCLI -t 12 -c statistics-2010
</code></pre><p>It took five minutes to finish processing this core.</p>

View File

@ -9,7 +9,7 @@
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
<meta property="og:type" content="website" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
<meta property="og:updated_time" content="2020-11-25T18:36:14+02:00" />
<meta property="og:updated_time" content="2020-11-25T22:32:41+02:00" />
<meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="CGSpace Notes"/>

View File

@ -9,7 +9,7 @@
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
<meta property="og:type" content="website" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
<meta property="og:updated_time" content="2020-11-25T18:36:14+02:00" />
<meta property="og:updated_time" content="2020-11-25T22:32:41+02:00" />
<meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="CGSpace Notes"/>

View File

@ -9,7 +9,7 @@
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
<meta property="og:type" content="website" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
<meta property="og:updated_time" content="2020-11-25T18:36:14+02:00" />
<meta property="og:updated_time" content="2020-11-25T22:32:41+02:00" />
<meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="CGSpace Notes"/>

View File

@ -9,7 +9,7 @@
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
<meta property="og:type" content="website" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
<meta property="og:updated_time" content="2020-11-25T18:36:14+02:00" />
<meta property="og:updated_time" content="2020-11-25T22:32:41+02:00" />
<meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="CGSpace Notes"/>

View File

@ -9,7 +9,7 @@
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
<meta property="og:type" content="website" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
<meta property="og:updated_time" content="2020-11-25T18:36:14+02:00" />
<meta property="og:updated_time" content="2020-11-25T22:32:41+02:00" />
<meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="CGSpace Notes"/>

View File

@ -9,7 +9,7 @@
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
<meta property="og:type" content="website" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
<meta property="og:updated_time" content="2020-11-25T18:36:14+02:00" />
<meta property="og:updated_time" content="2020-11-25T22:32:41+02:00" />
<meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="CGSpace Notes"/>

View File

@ -9,7 +9,7 @@
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
<meta property="og:type" content="website" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
<meta property="og:updated_time" content="2020-11-25T18:36:14+02:00" />
<meta property="og:updated_time" content="2020-11-25T22:32:41+02:00" />
<meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="CGSpace Notes"/>

View File

@ -9,7 +9,7 @@
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
<meta property="og:type" content="website" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
<meta property="og:updated_time" content="2020-11-25T18:36:14+02:00" />
<meta property="og:updated_time" content="2020-11-25T22:32:41+02:00" />
<meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Posts"/>

View File

@ -9,7 +9,7 @@
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
<meta property="og:type" content="website" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
<meta property="og:updated_time" content="2020-11-25T18:36:14+02:00" />
<meta property="og:updated_time" content="2020-11-25T22:32:41+02:00" />
<meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Posts"/>

View File

@ -9,7 +9,7 @@
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
<meta property="og:type" content="website" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
<meta property="og:updated_time" content="2020-11-25T18:36:14+02:00" />
<meta property="og:updated_time" content="2020-11-25T22:32:41+02:00" />
<meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Posts"/>

View File

@ -9,7 +9,7 @@
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
<meta property="og:type" content="website" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
<meta property="og:updated_time" content="2020-11-25T18:36:14+02:00" />
<meta property="og:updated_time" content="2020-11-25T22:32:41+02:00" />
<meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Posts"/>

View File

@ -9,7 +9,7 @@
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
<meta property="og:type" content="website" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
<meta property="og:updated_time" content="2020-11-25T18:36:14+02:00" />
<meta property="og:updated_time" content="2020-11-25T22:32:41+02:00" />
<meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Posts"/>

View File

@ -9,7 +9,7 @@
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
<meta property="og:type" content="website" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
<meta property="og:updated_time" content="2020-11-25T18:36:14+02:00" />
<meta property="og:updated_time" content="2020-11-25T22:32:41+02:00" />
<meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Posts"/>

View File

@ -9,7 +9,7 @@
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
<meta property="og:type" content="website" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
<meta property="og:updated_time" content="2020-11-25T18:36:14+02:00" />
<meta property="og:updated_time" content="2020-11-25T22:32:41+02:00" />
<meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Posts"/>

View File

@ -4,42 +4,42 @@
<url>
<loc>https://alanorth.github.io/cgspace-notes/categories/</loc>
<lastmod>2020-11-25T18:36:14+02:00</lastmod>
<lastmod>2020-11-25T22:32:41+02:00</lastmod>
</url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/cgspace-dspace6-upgrade/</loc>
<lastmod>2020-11-24T21:47:24+02:00</lastmod>
<lastmod>2020-11-25T22:32:41+02:00</lastmod>
</url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/</loc>
<lastmod>2020-11-25T18:36:14+02:00</lastmod>
<lastmod>2020-11-25T22:32:41+02:00</lastmod>
</url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/tags/migration/</loc>
<lastmod>2020-11-24T21:47:24+02:00</lastmod>
<lastmod>2020-11-25T22:32:41+02:00</lastmod>
</url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/categories/notes/</loc>
<lastmod>2020-11-25T18:36:14+02:00</lastmod>
<lastmod>2020-11-25T22:32:41+02:00</lastmod>
</url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/posts/</loc>
<lastmod>2020-11-25T18:36:14+02:00</lastmod>
<lastmod>2020-11-25T22:32:41+02:00</lastmod>
</url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/tags/</loc>
<lastmod>2020-11-24T21:47:24+02:00</lastmod>
<lastmod>2020-11-25T22:32:41+02:00</lastmod>
</url>
<url>
<loc>https://alanorth.github.io/cgspace-notes/2020-11/</loc>
<lastmod>2020-11-25T18:36:14+02:00</lastmod>
<lastmod>2020-11-25T22:32:41+02:00</lastmod>
</url>
<url>

View File

@ -9,7 +9,7 @@
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
<meta property="og:type" content="website" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/tags/" />
<meta property="og:updated_time" content="2020-11-24T21:47:24+02:00" />
<meta property="og:updated_time" content="2020-11-25T22:32:41+02:00" />
<meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Tags"/>

View File

@ -9,7 +9,7 @@
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
<meta property="og:type" content="website" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/tags/migration/" />
<meta property="og:updated_time" content="2020-11-24T21:47:24+02:00" />
<meta property="og:updated_time" content="2020-11-25T22:32:41+02:00" />
<meta name="twitter:card" content="summary"/>
<meta name="twitter:title" content="Migration"/>