diff --git a/content/posts/2018-09.md b/content/posts/2018-09.md index 4d71ffecc..a67913c67 100644 --- a/content/posts/2018-09.md +++ b/content/posts/2018-09.md @@ -554,5 +554,7 @@ sys 2m18.485s - Udana and Mia from WLE were asking some questions about their [WLE Feedburner feed](https://feeds.feedburner.com/WLEcgspace) - It's pretty confusing, because until recently they were entering issue dates as only YYYY (like 2018) and their feeds were all showing items in the wrong order - I'm not exactly sure what their problem now is, though (confusing) +- I updated the dspace-statistiscs-api to use psycopg2's `execute_values()` to insert batches of 100 values into PostgreSQL instead of doing every insert individually +- On CGSpace this reduces the total run time of `indexer.py` from 432 seconds to 400 seconds (most of the time is actually spent in getting the data from Solr though) diff --git a/docs/2018-09/index.html b/docs/2018-09/index.html index 838dbc4f6..4c7f54b50 100644 --- a/docs/2018-09/index.html +++ b/docs/2018-09/index.html @@ -18,7 +18,7 @@ I’m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I " /> - + Udana and Mia from WLE were asking some questions about their WLE Feedburner feed
  • It’s pretty confusing, because until recently they were entering issue dates as only YYYY (like 2018) and their feeds were all showing items in the wrong order
  • I’m not exactly sure what their problem now is, though (confusing)
  • +
  • I updated the dspace-statistiscs-api to use psycopg2’s execute_values() to insert batches of 100 values into PostgreSQL instead of doing every insert individually
  • +
  • On CGSpace this reduces the total run time of indexer.py from 432 seconds to 400 seconds (most of the time is actually spent in getting the data from Solr though)
  • diff --git a/docs/sitemap.xml b/docs/sitemap.xml index 6ea69e12c..ce8aa3e5e 100644 --- a/docs/sitemap.xml +++ b/docs/sitemap.xml @@ -4,7 +4,7 @@ https://alanorth.github.io/cgspace-notes/2018-09/ - 2018-09-26T17:36:50+03:00 + 2018-09-26T20:13:29+03:00 @@ -184,7 +184,7 @@ https://alanorth.github.io/cgspace-notes/ - 2018-09-26T17:36:50+03:00 + 2018-09-26T20:13:29+03:00 0 @@ -195,7 +195,7 @@ https://alanorth.github.io/cgspace-notes/tags/notes/ - 2018-09-26T17:36:50+03:00 + 2018-09-26T20:13:29+03:00 0 @@ -207,13 +207,13 @@ https://alanorth.github.io/cgspace-notes/posts/ - 2018-09-26T17:36:50+03:00 + 2018-09-26T20:13:29+03:00 0 https://alanorth.github.io/cgspace-notes/tags/ - 2018-09-26T17:36:50+03:00 + 2018-09-26T20:13:29+03:00 0