diff --git a/content/posts/2018-09.md b/content/posts/2018-09.md index 4d71ffecc..a67913c67 100644 --- a/content/posts/2018-09.md +++ b/content/posts/2018-09.md @@ -554,5 +554,7 @@ sys 2m18.485s - Udana and Mia from WLE were asking some questions about their [WLE Feedburner feed](https://feeds.feedburner.com/WLEcgspace) - It's pretty confusing, because until recently they were entering issue dates as only YYYY (like 2018) and their feeds were all showing items in the wrong order - I'm not exactly sure what their problem now is, though (confusing) +- I updated the dspace-statistiscs-api to use psycopg2's `execute_values()` to insert batches of 100 values into PostgreSQL instead of doing every insert individually +- On CGSpace this reduces the total run time of `indexer.py` from 432 seconds to 400 seconds (most of the time is actually spent in getting the data from Solr though) diff --git a/docs/2018-09/index.html b/docs/2018-09/index.html index 838dbc4f6..4c7f54b50 100644 --- a/docs/2018-09/index.html +++ b/docs/2018-09/index.html @@ -18,7 +18,7 @@ I’m testing the new DSpace 5.8 branch in my Ubuntu 18.04 environment and I " /> - + Udana and Mia from WLE were asking some questions about their WLE Feedburner feed
execute_values()
to insert batches of 100 values into PostgreSQL instead of doing every insert individuallyindexer.py
from 432 seconds to 400 seconds (most of the time is actually spent in getting the data from Solr though)