diff --git a/content/post/2017-09.md b/content/post/2017-09.md index 18f9609ff..205ec9428 100644 --- a/content/post/2017-09.md +++ b/content/post/2017-09.md @@ -438,3 +438,22 @@ $ schedtool -D -e ionice -c2 -n7 nice -n19 dspace filter-media -f -i 10947/1 -p - Experimenting with setting up a global JNDI database resource that can be pooled among all the DSpace webapps (reference the [April, 2017 DCAT meeting](https://wiki.duraspace.org/display/cmtygp/DCAT+Meeting+April+2017) comments) - See: https://www.journaldev.com/2513/tomcat-datasource-jndi-example-java - See: http://memorynotfound.com/configure-jndi-datasource-tomcat/ + +## 2017-09-24 + +- Start investigating other platforms for CGSpace due to linear instance pricing on Linode +- We need to figure out how much memory is used by applications, caches, etc, and how much disk space the asset store needs +- First, here's the last week of memory usage on CGSpace and DSpace Test: + +![CGSpace memory week](/cgspace-notes/2017/09/cgspace-memory-week.png) +![DSpace Test memory week](/cgspace-notes/2017/09/dspace-test-memory-week.png) + +- 8GB of RAM seems to be good for DSpace Test for now, with Tomcat's JVM heap taking 3GB, caches and buffers taking 3–4GB, and then ~1GB unused +- 24GB of RAM is _way_ too much for CGSpace, with Tomcat's JVM heap taking 5.5GB and caches and buffers happily using 14GB or so +- As far as disk space, the CGSpace assetstore currently uses 51GB and Solr cores use 86GB (mostly in the statistics core) +- DSpace Test currently doesn't even have enough space to store a full copy of CGSpace, as its Linode instance only has 96GB of disk space +- I've heard Google Cloud is nice (cheap and performant) but it's definitely more complicated than Linode and instances aren't _that_ much cheaper to make it worth it +- Here are some theoretical instances on Google Cloud: + - DSpace Test, `n1-standard-2 ` with 2 vCPUs, 7.5GB RAM, 300GB persistent SSD: $99/month + - CGSpace, `n1-standard-4 ` with 4 vCPUs, 15GB RAM, 300GB persistent SSD: $148/month +- Looking at [Linode's instance pricing](https://www.linode.com/pricing#all) it seems we could use the same 8GB instance for $40/month, and then add [block storage](https://www.linode.com/docs/platform/how-to-use-block-storage-with-your-linode) of ~300GB for $30 (block storage is currently in beta and priced at $0.10/GiB) diff --git a/public/2017-09/index.html b/public/2017-09/index.html index a0f828fcf..1dc586e1a 100644 --- a/public/2017-09/index.html +++ b/public/2017-09/index.html @@ -25,7 +25,7 @@ Ask Sisay to clean up the WLE approvers a bit, as Marianne’s user account - + @@ -61,9 +61,9 @@ Ask Sisay to clean up the WLE approvers a bit, as Marianne’s user account "@type": "BlogPosting", "headline": "September, 2017", "url": "https://alanorth.github.io/cgspace-notes/2017-09/", - "wordCount": "3093", + "wordCount": "3333", "datePublished": "2017-09-07T16:54:52+07:00", - "dateModified": "2017-09-21T21:53:05+03:00", + "dateModified": "2017-09-22T17:59:45+03:00", "author": { "@type": "Person", "name": "Alan Orth" @@ -619,6 +619,32 @@ DELETE 207
  • See: http://memorynotfound.com/configure-jndi-datasource-tomcat/
    • +

    2017-09-24

    + + + +

    CGSpace memory week +DSpace Test memory week

    + + + diff --git a/public/2017/09/cgspace-memory-week.png b/public/2017/09/cgspace-memory-week.png new file mode 100644 index 000000000..b5710018a Binary files /dev/null and b/public/2017/09/cgspace-memory-week.png differ diff --git a/public/2017/09/dspace-test-memory-week.png b/public/2017/09/dspace-test-memory-week.png new file mode 100644 index 000000000..a6cd80e78 Binary files /dev/null and b/public/2017/09/dspace-test-memory-week.png differ diff --git a/public/robots.txt b/public/robots.txt index defa6419a..bb802e51c 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -27,7 +27,7 @@ Disallow: /cgspace-notes/2015-12/ Disallow: /cgspace-notes/2015-11/ Disallow: /cgspace-notes/ Disallow: /cgspace-notes/categories/ -Disallow: /cgspace-notes/categories/notes/ Disallow: /cgspace-notes/tags/notes/ +Disallow: /cgspace-notes/categories/notes/ Disallow: /cgspace-notes/post/ Disallow: /cgspace-notes/tags/ diff --git a/public/sitemap.xml b/public/sitemap.xml index 3bf2c25c5..72e80dc29 100644 --- a/public/sitemap.xml +++ b/public/sitemap.xml @@ -9,7 +9,7 @@ https://alanorth.github.io/cgspace-notes/2017-09/ - 2017-09-21T21:53:05+03:00 + 2017-09-22T17:59:45+03:00 @@ -133,27 +133,27 @@ 0 + + https://alanorth.github.io/cgspace-notes/tags/notes/ + 2017-09-22T17:59:45+03:00 + 0 + + https://alanorth.github.io/cgspace-notes/categories/notes/ 2017-09-19T22:23:37+03:00 0 - - https://alanorth.github.io/cgspace-notes/tags/notes/ - 2017-09-21T21:53:05+03:00 - 0 - - https://alanorth.github.io/cgspace-notes/post/ - 2017-09-21T21:53:05+03:00 + 2017-09-22T17:59:45+03:00 0 https://alanorth.github.io/cgspace-notes/tags/ - 2017-09-21T21:53:05+03:00 + 2017-09-22T17:59:45+03:00 0 diff --git a/static/2017/09/cgspace-memory-week.png b/static/2017/09/cgspace-memory-week.png new file mode 100644 index 000000000..b5710018a Binary files /dev/null and b/static/2017/09/cgspace-memory-week.png differ diff --git a/static/2017/09/dspace-test-memory-week.png b/static/2017/09/dspace-test-memory-week.png new file mode 100644 index 000000000..a6cd80e78 Binary files /dev/null and b/static/2017/09/dspace-test-memory-week.png differ