Engine Snapshot Stats Update

in Programming & Dev2 years ago (edited)

I just had to upgrade the storage of my snapshot server again and thought this is a good opportunity to give a short update about the current state of engine snapshots.

If you are curious how the process of creating engine snapshots works, please check out the previous post over here.

I have given the last update about engine snapshots just about 5 months ago on September 25. Back then an engine FULL node snapshot had roughly 60GB in size.

Right now (on February 26) the size of full node snapshots is roughly 82GB, which means the snapshot grew ~22GB in the last 5 months. This would account to about 150MB the snapshot grew every single day on average.

If we have a look at the chart we can see that it is growing almost linearly:

But if we have a closer look at the following chart, we can see, that activity on the engine sidechain did actually increase a bit in the last few months, compared to the previous year, with a bit of a down at the beginning of the year. The chart shows the daily increase in the snapshot size, with a few outliers, when the snapshot script failed for a day:


LIGHT node snapshots on the other hand had just about 4.5GB on September 25. Keep in mind that light node snapshots don't really grow much, but are fluctuating around that size, depending on how much the engine sidechain is used on a given day, as they only store about 30 days of history.

Today (on February 26) the size of light node snapshots is around 5.3GB, which does also amount in a slight increase (in activity also). The chart confirms our observation:

The big hole in the middle was when I had to rebuild the light node history, as I messed up the backup node (and the one at the start when I initially built up the 30 day history).

The chart again nicely shows, how the engine sidechain activity increased at the end of 2022, then dropped at the start of 2023 and now seems to be at an all time (activity) high again.

This is also shown in the chart with the daily increase / decrease of the light node snapshot size in MB:

The large blue areas at the start and in the middle are again the build up of the history at the start and when I had to rebuild it.

That's all stats I've got for the moment. I will be giving an update again in a few months time. For now, the storage upgrade went well and I should be good for the next few months.




Vote for my Hive Witness using Keychain.

Sort:  

Always interesting to see these stats. Thanks for sharing them. Engine is getting quite large.

Yeah we will be hitting 100GB with the full snapshots in the next few months... and the running nodes are getting insanely large. Luckily doing a full node restore is not required anymore.

Congratulations @primersion! You have completed the following achievement on the Hive blockchain And have been rewarded with New badge(s)

You received more than 9000 HP as payout for your posts, comments and curation.
Your next payout target is 10000 HP.
The unit is Hive Power equivalent because post and comment rewards can be split into HP and HBD

You can view your badges on your board and compare yourself to others in the Ranking
If you no longer want to receive notifications, reply to this comment with the word STOP

To support your work, I also upvoted your post!

Check out our last posts:

Hive Power Up Day - March 1st 2023
The Hive Gamification Proposal
Support the HiveBuzz project. Vote for our proposal!