alanorth/cgspace-notes
1
0
Fork 0
mirror of https://github.com/alanorth/cgspace-notes.git synced 2025-01-27 05:49:12 +01:00
Code Issues Projects Releases Wiki Activity

Add notes for 2023-08-07

Browse Source
This commit is contained in:
Alan Orth
2023-08-07 10:48:56 +02:00
parent 021a92c0d9
commit e0f9e484ee
32 changed files with 79 additions and 37 deletions
Download Patch File Download Diff File Expand all files Collapse all files

31
docs/2023-08/index.html
View File

@ -19,7 +19,7 @@ Start working on some batch uploads for IFPRI
<meta property="og:type" content="article" />
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2023-08/" />
<meta property="article:published_time" content="2023-08-03T11:18:36+03:00" />
<meta property="article:modified_time" content="2023-08-04T18:05:44+03:00" />
<meta property="article:modified_time" content="2023-08-05T17:27:43+03:00" />
@ -44,9 +44,9 @@ Start working on some batch uploads for IFPRI
"@type": "BlogPosting",
"headline": "August, 2023",
"url": "https://alanorth.github.io/cgspace-notes/2023-08/",
"wordCount": "174",
"wordCount": "334",
"datePublished": "2023-08-03T11:18:36+03:00",
"dateModified": "2023-08-04T18:05:44+03:00",
"dateModified": "2023-08-05T17:27:43+03:00",
"author": {
"@type": "Person",
"name": "Alan Orth"
@ -155,6 +155,31 @@ Start working on some batch uploads for IFPRI
<li>Export CGSpace to check for missing Initiative collection mappings</li>
<li>Start a harvest on AReS</li>
</ul>
<h2 id="2023-08-07">2023-08-07</h2>
<ul>
<li>I&rsquo;m checking the PostgreSQL logs now that statement logging has been enabled for a few days on DSpace Test
<ul>
<li>I see the logs are about 7 or 8 GB, which is larger than expected—and this is the test server!</li>
<li>I will now play with pgbadger to see if it gives any useful insights</li>
<li>Hmm, it sems the <code>log_statement</code> advice was old as pgbadger itself says:</li>
</ul>
</li>
</ul>
<blockquote>
<p>Do not enable log_statement as its log format will not be parsed by pgBadger.</p>
</blockquote>
<p>&hellip; and:</p>
<blockquote>
<p>Warning: Do not enable both log_min_duration_statement, log_duration and log_statement all together, this will result in wrong counter values. Note that this will also increase drastically the size of your log. log_min_duration_statement should always be preferred.</p>
</blockquote>
<ul>
<li>So we need to follow pgbadger&rsquo;s instructions rather to get a suitable log file
<ul>
<li>After enabling the new settings I see that our log file is going to be reaallllly big&hellip; hmmmm will check tomorrow morning</li>
</ul>
</li>
<li>More work on the IFPRI batch uploads</li>
</ul>
<!-- raw HTML omitted -->