Add notes for 2017-09-24

content/post/2017-09.md

@@ -438,3 +438,22 @@ $ schedtool -D -e ionice -c2 -n7 nice -n19 dspace filter-media -f -i 10947/1 -p
 - Experimenting with setting up a global JNDI database resource that can be pooled among all the DSpace webapps (reference the [April, 2017 DCAT meeting](https://wiki.duraspace.org/display/cmtygp/DCAT+Meeting+April+2017) comments)
 - See: https://www.journaldev.com/2513/tomcat-datasource-jndi-example-java
 - See: http://memorynotfound.com/configure-jndi-datasource-tomcat/
+
+## 2017-09-24
+
+- Start investigating other platforms for CGSpace due to linear instance pricing on Linode
+- We need to figure out how much memory is used by applications, caches, etc, and how much disk space the asset store needs
+- First, here's the last week of memory usage on CGSpace and DSpace Test:
+
+![CGSpace memory week](/cgspace-notes/2017/09/cgspace-memory-week.png)
+![DSpace Test memory week](/cgspace-notes/2017/09/dspace-test-memory-week.png)
+
+- 8GB of RAM seems to be good for DSpace Test for now, with Tomcat's JVM heap taking 3GB, caches and buffers taking 3–4GB, and then ~1GB unused
+- 24GB of RAM is _way_ too much for CGSpace, with Tomcat's JVM heap taking 5.5GB and caches and buffers happily using 14GB or so
+- As far as disk space, the CGSpace assetstore currently uses 51GB and Solr cores use 86GB (mostly in the statistics core)
+- DSpace Test currently doesn't even have enough space to store a full copy of CGSpace, as its Linode instance only has 96GB of disk space
+- I've heard Google Cloud is nice (cheap and performant) but it's definitely more complicated than Linode and instances aren't _that_ much cheaper to make it worth it
+- Here are some theoretical instances on Google Cloud:
+  - DSpace Test, `n1-standard-2 ` with 2 vCPUs, 7.5GB RAM, 300GB persistent SSD: $99/month
+  - CGSpace, `n1-standard-4 ` with 4 vCPUs, 15GB RAM, 300GB persistent SSD: $148/month
+- Looking at [Linode's instance pricing](https://www.linode.com/pricing#all) it seems we could use the same 8GB instance for $40/month, and then add [block storage](https://www.linode.com/docs/platform/how-to-use-block-storage-with-your-linode) of ~300GB for $30 (block storage is currently in beta and priced at $0.10/GiB)

public/2017-09/index.html

@@ -25,7 +25,7 @@ Ask Sisay to clean up the WLE approvers a bit, as Marianne’s user account
 
 
 <meta property="article:published_time" content="2017-09-07T16:54:52&#43;07:00"/>
-<meta property="article:modified_time" content="2017-09-21T21:53:05&#43;03:00"/>
+<meta property="article:modified_time" content="2017-09-22T17:59:45&#43;03:00"/>
 
 
 
@@ -61,9 +61,9 @@ Ask Sisay to clean up the WLE approvers a bit, as Marianne&rsquo;s user account
   "@type": "BlogPosting",
   "headline": "September, 2017",
   "url": "https://alanorth.github.io/cgspace-notes/2017-09/",
-  "wordCount": "3093",
+  "wordCount": "3333",
   "datePublished": "2017-09-07T16:54:52&#43;07:00",
-  "dateModified": "2017-09-21T21:53:05&#43;03:00",
+  "dateModified": "2017-09-22T17:59:45&#43;03:00",
   "author": {
     "@type": "Person",
     "name": "Alan Orth"
@@ -619,6 +619,32 @@ DELETE 207
 <li>See: <a href="http://memorynotfound.com/configure-jndi-datasource-tomcat/">http://memorynotfound.com/configure-jndi-datasource-tomcat/</a></li>
 </ul>
 
+<h2 id="2017-09-24">2017-09-24</h2>
+
+<ul>
+<li>Start investigating other platforms for CGSpace due to linear instance pricing on Linode</li>
+<li>We need to figure out how much memory is used by applications, caches, etc, and how much disk space the asset store needs</li>
+<li>First, here&rsquo;s the last week of memory usage on CGSpace and DSpace Test:</li>
+</ul>
+
+<p><img src="/cgspace-notes/2017/09/cgspace-memory-week.png" alt="CGSpace memory week" />
+<img src="/cgspace-notes/2017/09/dspace-test-memory-week.png" alt="DSpace Test memory week" /></p>
+
+<ul>
+<li>8GB of RAM seems to be good for DSpace Test for now, with Tomcat&rsquo;s JVM heap taking 3GB, caches and buffers taking 3–4GB, and then ~1GB unused</li>
+<li>24GB of RAM is <em>way</em> too much for CGSpace, with Tomcat&rsquo;s JVM heap taking 5.5GB and caches and buffers happily using 14GB or so</li>
+<li>As far as disk space, the CGSpace assetstore currently uses 51GB and Solr cores use 86GB (mostly in the statistics core)</li>
+<li>DSpace Test currently doesn&rsquo;t even have enough space to store a full copy of CGSpace, as its Linode instance only has 96GB of disk space</li>
+<li>I&rsquo;ve heard Google Cloud is nice (cheap and performant) but it&rsquo;s definitely more complicated than Linode and instances aren&rsquo;t <em>that</em> much cheaper to make it worth it</li>
+<li>Here are some theoretical instances on Google Cloud:
+
+<ul>
+<li>DSpace Test, <code>n1-standard-2</code> with 2 vCPUs, 7.5GB RAM, 300GB persistent SSD: $99/month</li>
+<li>CGSpace, <code>n1-standard-4</code> with 4 vCPUs, 15GB RAM, 300GB persistent SSD: $148/month</li>
+</ul></li>
+<li>Looking at <a href="https://www.linode.com/pricing#all">Linode&rsquo;s instance pricing</a> it seems we could use the same 8GB instance for $40/month, and then add <a href="https://www.linode.com/docs/platform/how-to-use-block-storage-with-your-linode">block storage</a> of ~300GB for $30 (block storage is currently in beta and priced at $0.10/GiB)</li>
+</ul>
+
   
 
   

public/robots.txt

@@ -27,7 +27,7 @@ Disallow: /cgspace-notes/2015-12/
 Disallow: /cgspace-notes/2015-11/
 Disallow: /cgspace-notes/
 Disallow: /cgspace-notes/categories/
-Disallow: /cgspace-notes/categories/notes/
 Disallow: /cgspace-notes/tags/notes/
+Disallow: /cgspace-notes/categories/notes/
 Disallow: /cgspace-notes/post/
 Disallow: /cgspace-notes/tags/

public/sitemap.xml

@@ -9,7 +9,7 @@
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/2017-09/</loc>
-    <lastmod>2017-09-21T21:53:05+03:00</lastmod>
+    <lastmod>2017-09-22T17:59:45+03:00</lastmod>
   </url>
   
   <url>
@@ -133,27 +133,27 @@
     <priority>0</priority>
   </url>
   
+  <url>
+    <loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
+    <lastmod>2017-09-22T17:59:45+03:00</lastmod>
+    <priority>0</priority>
+  </url>
+  
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/categories/notes/</loc>
     <lastmod>2017-09-19T22:23:37+03:00</lastmod>
     <priority>0</priority>
   </url>
   
-  <url>
-    <loc>https://alanorth.github.io/cgspace-notes/tags/notes/</loc>
-    <lastmod>2017-09-21T21:53:05+03:00</lastmod>
-    <priority>0</priority>
-  </url>
-  
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/post/</loc>
-    <lastmod>2017-09-21T21:53:05+03:00</lastmod>
+    <lastmod>2017-09-22T17:59:45+03:00</lastmod>
     <priority>0</priority>
   </url>
   
   <url>
     <loc>https://alanorth.github.io/cgspace-notes/tags/</loc>
-    <lastmod>2017-09-21T21:53:05+03:00</lastmod>
+    <lastmod>2017-09-22T17:59:45+03:00</lastmod>
     <priority>0</priority>
   </url>