mirror of
https://github.com/alanorth/cgspace-notes.git
synced 2025-01-27 05:49:12 +01:00
Add notes
This commit is contained in:
@ -206,5 +206,11 @@ Purging 35816 hits from ^mozilla in statistics
|
||||
Total number of bot hits purged: 35816
|
||||
```
|
||||
|
||||
## 2023-11-30
|
||||
|
||||
- Minor updates to our OAI MODS crosswalk
|
||||
- Stefano found a minor markup issue with our alternative titles (`<titleInfo>` tag)
|
||||
- Very high load on CGSpace since after lunch
|
||||
- I killed some locks that had been stuck for a few hours
|
||||
|
||||
<!-- vim: set sw=2 ts=2: -->
|
||||
|
76
content/posts/2023-12.md
Normal file
76
content/posts/2023-12.md
Normal file
@ -0,0 +1,76 @@
|
||||
---
|
||||
title: "December, 2023"
|
||||
date: 2023-12-01T08:48:36+03:00
|
||||
author: "Alan Orth"
|
||||
categories: ["Notes"]
|
||||
---
|
||||
|
||||
## 2023-12-01
|
||||
|
||||
- There is still high load on CGSpace and I don't know why
|
||||
- I don't see a high number of sessions compared to previous days in the last few weeks
|
||||
|
||||
<!-- more -->
|
||||
|
||||
```console
|
||||
$ for file in dspace.log.2023-11-[23]*; do echo "$file"; grep -a -oE 'session_id=[A-Z0-9]{32}' "$file" | sort | uniq | wc -l; done
|
||||
dspace.log.2023-11-20
|
||||
22865
|
||||
dspace.log.2023-11-21
|
||||
20296
|
||||
dspace.log.2023-11-22
|
||||
19688
|
||||
dspace.log.2023-11-23
|
||||
17906
|
||||
dspace.log.2023-11-24
|
||||
18453
|
||||
dspace.log.2023-11-25
|
||||
17513
|
||||
dspace.log.2023-11-26
|
||||
19037
|
||||
dspace.log.2023-11-27
|
||||
21103
|
||||
dspace.log.2023-11-28
|
||||
23023
|
||||
dspace.log.2023-11-29
|
||||
23545
|
||||
dspace.log.2023-11-30
|
||||
21298
|
||||
```
|
||||
|
||||
- Even the number of unique IPs is not very high compared to the last week or so:
|
||||
|
||||
```console
|
||||
# awk '{print $1}' /var/log/nginx/{access,library-access,oai,rest}.log.1 | sort | uniq | wc -l
|
||||
17023
|
||||
# awk '{print $1}' /var/log/nginx/{access,library-access,oai,rest}.log.2.gz | sort | uniq | wc -l
|
||||
17294
|
||||
# awk '{print $1}' /var/log/nginx/{access,library-access,oai,rest}.log.3.gz | sort | uniq | wc -l
|
||||
22057
|
||||
# awk '{print $1}' /var/log/nginx/{access,library-access,oai,rest}.log.4.gz | sort | uniq | wc -l
|
||||
32956
|
||||
# awk '{print $1}' /var/log/nginx/{access,library-access,oai,rest}.log.5.gz | sort | uniq | wc -l
|
||||
11415
|
||||
# awk '{print $1}' /var/log/nginx/{access,library-access,oai,rest}.log.6.gz | sort | uniq | wc -l
|
||||
15444
|
||||
# awk '{print $1}' /var/log/nginx/{access,library-access,oai,rest}.log.7.gz | sort | uniq | wc -l
|
||||
12648
|
||||
```
|
||||
|
||||
- It doesn't make any sense so I think I'm going to restart the server...
|
||||
- After restarting the server the load went down to normal levels... who knows...
|
||||
- I started trying to see how I'm going to generate the fake statistics for the Alliance bitstream that was replaced
|
||||
- I exported all the statistics for the owningItem now:
|
||||
|
||||
```console
|
||||
$ chrt -b 0 ./run.sh -s http://localhost:8081/solr/statistics -a export -o /tmp/stats-export.json -f 'owningItem:b5862bfa-9799-4167-b1cf-76f0f4ea1e18' -k uid
|
||||
```
|
||||
|
||||
- Importing them into DSpace Test didn't show the statistics in the Atmire module, but I see them in Solr...
|
||||
|
||||
## 2023-12-02
|
||||
|
||||
- Export CGSpace to check for missing Initiative collection mappings
|
||||
- Start a harvest on AReS
|
||||
|
||||
<!-- vim: set sw=2 ts=2: -->
|
Reference in New Issue
Block a user