alanorth/cgspace-notes
1
0
Fork 0
mirror of https://github.com/alanorth/cgspace-notes.git synced 2025-01-27 05:49:12 +01:00
Code Issues Projects Releases Wiki Activity

Add notes for 2024-09-14

Browse Source
This commit is contained in:
Alan Orth
2024-09-14 23:02:16 +03:00
parent a5298945a3
commit 79708bd30c
39 changed files with 112 additions and 44 deletions
Download Patch File Download Diff File Expand all files Collapse all files

41
docs/2024-09/index.html
View File

@ -14,7 +14,7 @@ Upgrade CGSpace to DSpace 7.6.2
<meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2024-09/" />
<meta property="article:published_time" content="2024-09-01T21:16:00-07:00" />
<meta property="article:modified_time" content="2024-09-01T21:16:00-07:00" />
<meta property="article:modified_time" content="2024-09-09T10:20:09+03:00" />
@ -34,9 +34,9 @@ Upgrade CGSpace to DSpace 7.6.2
"@type": "BlogPosting",
"headline": "September, 2024",
"url": "https://alanorth.github.io/cgspace-notes/2024-09/",
"wordCount": "353",
"wordCount": "523",
"datePublished": "2024-09-01T21:16:00-07:00",
"dateModified": "2024-09-01T21:16:00-07:00",
"dateModified": "2024-09-09T10:20:09+03:00",
"author": {
"@type": "Person",
"name": "Alan Orth"
@ -157,6 +157,41 @@ Sep 06 00:00:25 server systemd[1]: tomcat9.service: Failed with result &#39;oom-
<ul>
<li>I put some of these changes in on DSpace Test and will monitor this week</li>
</ul>
<h2 id="2024-09-10">2024-09-10</h2>
<ul>
<li>Some bot in South Africa made a ton of requests on the API and made the load hit the roof:</li>
</ul>
<pre tabindex="0"><code># grep -E &#39;10/Sep/2024:[10-11]&#39; /var/log/nginx/api-access.log | awk &#39;{print $1}&#39; | sort | uniq -c | sort -h
...
149720 102.182.38.90
</code></pre><ul>
<li>They are using several user agents so are obviously a bot:</li>
</ul>
<pre tabindex="0"><code>Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:130.0) Gecko/20100101 Firefox/130.0
Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/111.0
Mozilla/5.0 (Windows; U; Windows NT 6.1; rv:11.0) Gecko/20100101 Firefox/11.0
</code></pre><ul>
<li>I added them to the list of bot networks in nginx and the load went down</li>
</ul>
<h2 id="2024-09-11">2024-09-11</h2>
<ul>
<li>Upgrade DSpace 7 Test to Ubuntu 24.04</li>
<li>I did some minor maintenance to test dspace-statistics-api with Python 3.12
<ul>
<li>I tagged version 1.4.4 and released it on GitHub</li>
</ul>
</li>
</ul>
<h2 id="2024-09-14">2024-09-14</h2>
<ul>
<li>Noticed a persistent higher than usual load on CGSpace and checked the server logs
<ul>
<li>Found some new data center subnets to block because they were making thousands of requests with normal user agents</li>
</ul>
</li>
<li>I enabled HTTP/3 in nginx</li>
<li>I enabled the SSR patch in Angular: <a href="https://github.com/DSpace/dspace-angular/issues/3110">https://github.com/DSpace/dspace-angular/issues/3110</a></li>
</ul>
<!-- raw HTML omitted -->