Over the last 2 releases I made some improvements to our Source Preparation and Source Upload processing.
In production these changes have reduced Source Archival time by around 70%.
I have selected a build with a large number of Source Files (36,000) and enough historical builds to be accurate and verified that the underlying build process has not changed.
Total Build Time
In February, with the original Source Archival load process, the total build time was 25-30 minutes.
In May, with the first set of changes to Source Archival , the total build time was 15 minutes.
In June, with the second set of change to Source Archival , the total build time was 10 minutes.
In the graph we can see the first set of changes making a significant improvement in May, and then the second set of changes showing further improvement in June.
Average Source Archival in Feb: 1524 seconds
Average Source Archival in June: 452 seconds
Percentage change: (452 – 1524) / 1524 * 100 = -70%
These changes have also been applied to the Artefact Archival process, so we should see similar improvements there.
We are continuing to look at ways to further improve this process!
