Update notes for 2020-02-06

This commit is contained in:
2020-02-06 12:47:25 +02:00
parent 82e9a61c18
commit ef006037c1
3 changed files with 52 additions and 9 deletions

View File

@ -251,4 +251,28 @@ $ ./check-spider-hits.sh -d -p -f /tmp/jersey -s statistics -u http://localhost:
$ for year in 2018 2017 2016 2015; do ./check-spider-hits.sh -d -p -f /tmp/jersey -s "statistics-${year}" -u http://localhost:8081/solr; done
```
- I noticed another user agen in the logs that we should add to the list:
```
ReactorNetty/0.9.2.RELEASE
```
- I made [an issue on the COUNTER-Robots repository](https://github.com/atmire/COUNTER-Robots/issues/31)
- I found a [nice tool for exporting and importing Solr records](https://github.com/freedev/solr-import-export-json) and it seems to workfor exporting our 2019 stats from the large statistics core!
```
$ ./run.sh -s http://localhost:8081/solr/statistics -a export -o /tmp/statistics-2019-01.json -f 'dateYearMonth:2019-01' -k uid
$ ls -lh /tmp/statistics-2019-01.json
-rw-rw-r-- 1 aorth aorth 3.7G Feb 6 09:26 /tmp/statistics-2019-01.json
```
- Then I tested importing this by creating a new core in my development environment:
```
$ curl 'http://localhost:8080/solr/admin/cores?action=CREATE&name=statistics-2019&instanceDir=/home/aorth/dspace63/solr/statistics&dataDir=/home/aorth/dspace63/solr/statistics-2019/data'
$ ./run.sh -s http://localhost:8080/solr/statistics-2019 -a import -o ~/Downloads/statistics-2019-01.json -k uid
```
- This imports the records into the core, but DSpace can't see them, and when I restart Tomcat the core is not seen by Solr...
<!-- vim: set sw=2 ts=2: -->