mirror of
https://github.com/alanorth/cgspace-notes.git
synced 2024-11-22 06:35:03 +01:00
Add notes for 2023-08-07
This commit is contained in:
parent
021a92c0d9
commit
e0f9e484ee
GPG Key ID:
0FB860CC9C45B1B9
@ -30,4 +30,21 @@ categories: ["Notes"]
|
||||
- Export CGSpace to check for missing Initiative collection mappings
|
||||
- Start a harvest on AReS
|
||||
|
||||
## 2023-08-07
|
||||
|
||||
- I'm checking the PostgreSQL logs now that statement logging has been enabled for a few days on DSpace Test
|
||||
- I see the logs are about 7 or 8 GB, which is larger than expected—and this is the test server!
|
||||
- I will now play with pgbadger to see if it gives any useful insights
|
||||
- Hmm, it sems the `log_statement` advice was old as pgbadger itself says:
|
||||
|
||||
> Do not enable log_statement as its log format will not be parsed by pgBadger.
|
||||
|
||||
... and:
|
||||
|
||||
> Warning: Do not enable both log_min_duration_statement, log_duration and log_statement all together, this will result in wrong counter values. Note that this will also increase drastically the size of your log. log_min_duration_statement should always be preferred.
|
||||
|
||||
- So we need to follow pgbadger's instructions rather to get a suitable log file
|
||||
- After enabling the new settings I see that our log file is going to be reaallllly big... hmmmm will check tomorrow morning
|
||||
- More work on the IFPRI batch uploads
|
||||
|
||||
<!-- vim: set sw=2 ts=2: -->
|
||||
|
||||
@ -19,7 +19,7 @@ Start working on some batch uploads for IFPRI
|
||||
<meta property="og:type" content="article" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/2023-08/" />
|
||||
<meta property="article:published_time" content="2023-08-03T11:18:36+03:00" />
|
||||
<meta property="article:modified_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="article:modified_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
@ -44,9 +44,9 @@ Start working on some batch uploads for IFPRI
|
||||
"@type": "BlogPosting",
|
||||
"headline": "August, 2023",
|
||||
"url": "https://alanorth.github.io/cgspace-notes/2023-08/",
|
||||
"wordCount": "174",
|
||||
"wordCount": "334",
|
||||
"datePublished": "2023-08-03T11:18:36+03:00",
|
||||
"dateModified": "2023-08-04T18:05:44+03:00",
|
||||
"dateModified": "2023-08-05T17:27:43+03:00",
|
||||
"author": {
|
||||
"@type": "Person",
|
||||
"name": "Alan Orth"
|
||||
@ -155,6 +155,31 @@ Start working on some batch uploads for IFPRI
|
||||
<li>Export CGSpace to check for missing Initiative collection mappings</li>
|
||||
<li>Start a harvest on AReS</li>
|
||||
</ul>
|
||||
<h2 id="2023-08-07">2023-08-07</h2>
|
||||
<ul>
|
||||
<li>I’m checking the PostgreSQL logs now that statement logging has been enabled for a few days on DSpace Test
|
||||
<ul>
|
||||
<li>I see the logs are about 7 or 8 GB, which is larger than expected—and this is the test server!</li>
|
||||
<li>I will now play with pgbadger to see if it gives any useful insights</li>
|
||||
<li>Hmm, it sems the <code>log_statement</code> advice was old as pgbadger itself says:</li>
|
||||
</ul>
|
||||
</li>
|
||||
</ul>
|
||||
<blockquote>
|
||||
<p>Do not enable log_statement as its log format will not be parsed by pgBadger.</p>
|
||||
</blockquote>
|
||||
<p>… and:</p>
|
||||
<blockquote>
|
||||
<p>Warning: Do not enable both log_min_duration_statement, log_duration and log_statement all together, this will result in wrong counter values. Note that this will also increase drastically the size of your log. log_min_duration_statement should always be preferred.</p>
|
||||
</blockquote>
|
||||
<ul>
|
||||
<li>So we need to follow pgbadger’s instructions rather to get a suitable log file
|
||||
<ul>
|
||||
<li>After enabling the new settings I see that our log file is going to be reaallllly big… hmmmm will check tomorrow morning</li>
|
||||
</ul>
|
||||
</li>
|
||||
<li>More work on the IFPRI batch uploads</li>
|
||||
</ul>
|
||||
<!-- raw HTML omitted -->
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/categories/notes/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -10,7 +10,7 @@
|
||||
<meta property="og:description" content="Documenting day-to-day work on the [CGSpace](https://cgspace.cgiar.org) repository." />
|
||||
<meta property="og:type" content="website" />
|
||||
<meta property="og:url" content="https://alanorth.github.io/cgspace-notes/posts/" />
|
||||
<meta property="og:updated_time" content="2023-08-04T18:05:44+03:00" />
|
||||
<meta property="og:updated_time" content="2023-08-05T17:27:43+03:00" />
|
||||
|
||||
|
||||
|
||||
|
||||
@ -3,19 +3,19 @@
|
||||
xmlns:xhtml="http://www.w3.org/1999/xhtml">
|
||||
<url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/2023-08/</loc>
|
||||
<lastmod>2023-08-04T18:05:44+03:00</lastmod>
|
||||
<lastmod>2023-08-05T17:27:43+03:00</lastmod>
|
||||
</url><url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/categories/</loc>
|
||||
<lastmod>2023-08-04T18:05:44+03:00</lastmod>
|
||||
<lastmod>2023-08-05T17:27:43+03:00</lastmod>
|
||||
</url><url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/</loc>
|
||||
<lastmod>2023-08-04T18:05:44+03:00</lastmod>
|
||||
<lastmod>2023-08-05T17:27:43+03:00</lastmod>
|
||||
</url><url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/categories/notes/</loc>
|
||||
<lastmod>2023-08-04T18:05:44+03:00</lastmod>
|
||||
<lastmod>2023-08-05T17:27:43+03:00</lastmod>
|
||||
</url><url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/posts/</loc>
|
||||
<lastmod>2023-08-04T18:05:44+03:00</lastmod>
|
||||
<lastmod>2023-08-05T17:27:43+03:00</lastmod>
|
||||
</url><url>
|
||||
<loc>https://alanorth.github.io/cgspace-notes/2023-07/</loc>
|
||||
<lastmod>2023-08-02T23:04:11+03:00</lastmod>
|
||||
|
||||
Loading…
Reference in New Issue
Block a user