Turns out the recent bandwidth issue was a bit more complicated then we initially expected - increasing block size reduced the errors for a little while - but it lead to the discovery of a deeper overflow bug in the bandwidth algorithm.
I was really impressed with how efficiently this was examined by our witnesses and development team, and an updated version of Steemd was released this morning to fix the bandwidth algorithm.
Here's the relevant part from the release notes on the fresh Steemd v0.19.1rc1 :
Smooth Bandwidth Algorithm
There were two big problems with the bandwidth algorithm. The first was an integer overflow that caused max_virtual_bandwidth to be calculated incorrectly. The second was a programmed behavior that caused bandwidth requirements to increase too rapidly for a small increase in traffic. We have implemented a new algorithm for how to calculate global bandwidth requirements that still protects the blockchain under extreme circumstances, but is less aggressive during small deviations from past behavior. Overall, this should improve the user experience when it comes to bandwidth rate limiting. 1257
The update also includes a few other needed features that will mostly interest witnesses, and a safety check to stop people accidentally broadcasting their private key in the memo field of a transfer.
I've upgraded my main node to this new version, and I've reduced my block size back to its previous 65536 value while we wait for this to become the dominant version in use amongst the witnesses .
Relevant Links :
- Steemd v0.19.1rc1 release notes
- Github Issue 1257 - Change Bandwidth Reserve Ratio Algorithm
- All Witnesses - Important Update v0.19.1rc1 (Steem-in-a-box is updated)
- SteemD changelog on github
- Bandwidth Limit Exceeded? How Witnesses Help You
- Bandwidth Error Code Bug Explained! Fix Coming!
- A thought about recent STEEM bandwidth issues ...
- Down the Rabbit Hole. "The case of the Bandwidth Bug"
- Ausbitbank Witness Update 17/7/17 (SBD interest changed to 1%)
- SteemDB Witness List (check versions)
twitter / gab.ai / keybase / steemit.chat / patreon
steemviz / steemvids / more tools / post index
Please vote for me as a witness here
So it looks like my increase in traffic did cause the algorithm to trigger. Just so happened to also have this code related issue.
I am glad I was able to help uncover this at an early state in STEEM.
Many complaint about bandwidth issues but many did not vote for witness!
Start voting for witness to ensure our longevity in this platform. Great update! what is witness? there are a lot of post about it but for minnows, here
https://steemit.com/steemit/@cikxaijen/steemit-beginners-guide-what-is-witness-noob-explanation
Thanks for spreading the word about us witnesses. Votes matter
Hi @netuoso , the witness page is still down is it right?
Nope it is up.
https://steemit.com/~witnesses
I'd love your vote :)
Sure will do! I have 29 spots left! ^_^
as of this moment, 11 out of the top 20 witnesses are updated to 19.1
ah, I was wondering about this! Thanks to all who worked on fixing this.....many new people I helped get onto Steemit had this issue, so I am glad to see it resolved.
Wow mate, ur getting a lot done. Great to see so much progress. You have had my vote for a while now and you deserve it for a lot of reasons.
You approach the witness thing quite a bit differently than most top witnesses and it seems like you also work on more projects. Though maybe thats just cause I follow you more closely. However in your updates it seems like your working on a lot more or at least sharing more about it.
Its nice ur not bribing people for votes, not that its wrong per say but I think witnesses should be witnesses because of true dedication, quality of character and reliable consistency.
Thanks for all you do.
Hello @ausbitbank, thank you for the update on the bandwidth issue. Even I had faced this issue day before yesterday and was wondering what's going on.
Also, would you please take a look at one of my posts and provide your valuable thoughts? A suggestion from a whale, like yourself will be the impetus I need to improve the quality of my posts.
https://steemit.com/success/@vinyprop/traits-of-successful-men-or-by-vinyprop-original
Thanks in advance!!
Great post , Really helpful for people facing bandwidth issue, I will also share this information with my friends, thanks much.
I'm new to steemit and a nature lover ..please check my post, I would appreciate feedbacks from whale like you, so that I can improve myself.
https://steemit.com/travel/@nehachauhan/2-global-couple-travel-diaries-mauritius--
I Just Voted Your Witness Bro, Please Be Kind Enough And Upvote My Comment :)
Bandwidth issue fixed fastly. There is no red tape.
This post was referenced in (related post) Easy Witness Voting Guide.
Thanks for this useful update. *Much appreciated!
-ch
I like post.
Awesome! I was wondering why I'm getting bandwidth exception while I shouldn't be!
Oh yes yes
THANKS FOR THE UPDATE. Allows me to better explain the bandwidth issue
Thanks for the updates. Nice to see the fix for memo mistakes!
Shared for others to see this fixed!
Thanks for solving it because it was vital i saw some new members in our group experienced bandwidth issues and somehow losing their interest to continue
Good to see that my witness takes his job seriously. :)
Every time i visit the page there is another feature added!
This time the age and reputation score!!
Big thanks @ausbitbank for his work i was having this trouble a few times in the past days.
So its fixed now?, that was fast!... I notice that i have a bandwidth limit bar now in steemd, and there is a number in "mb" that fluctuates...
The exceeded bandwidth thing really irks me off. Glad to know it has been fixed. :)
But seriously, having been less than a month here in Steemit, i still don't understand the witness thingy here. (Sorry i'm not much of a techie guy.. xD)
Awesome so people won't be getting that buffer overflow anymore right?
Very impressive turnaround time on resolving the issue. The explosive growth and bandwidth demand recently must be keeping all the witnesses on their toes. Great work to all involved!
Thank you for resolving the issue with the Bandwidth.
Increasing the blocksize drastically decreased the problem but hopefully this update will put it to bed.
Thank you for all your great work @ausbitbank for making this platform have a smoother and easier experience.
Thank you so much for fixing it :D finally great news for me
Thanks for mentioning me - I enjoy working on such puzzles - and I hope it speeded up finding the solution.
Writing an article series about Steemit and Witnesses you might like:
Part 1 - https://steemit.com/steemit/@cyberspace/a-social-scientist-s-first-impression-of-steemit-com-part-1-4-ideology-of-steemit
Part 2 - https://steemit.com/steemit/@cyberspace/a-social-scientist-s-first-impression-of-steemit-com-part-2-4-sociology-of-steemit
My Introduceyourself post
The fix works like a charm! Thanks everyone :)
This is great to know! Thank you, I am sharing with a friend who was having some problems with being able to post, even though he had plenty of bandwidth left. Voting for you as a witness now as well!
Dear Steem advanced,
I really appreciate your reply on my post to tell me the real value of steem. I want to invest very much on steem, but with this business plan I am sure it fails in future.
https://steemit.com/steemit/@itman/attention-there-is-no-income-for-steem-so-the-project-value-is-going-to-zero-i-invite-all-steem-fans-to-tell-me-how-steem-earn
Thanks a lot.
Please don't spam your FUD posts here.
@ausbitbank FYI: My article proposing a fix for the SP Delegation Loophole. Hope it helps. Followed. Voted! https://steemit.com/steemit/@cyberspace/proposed-steemit-fix-for-steem-power-delegation-self-voting-loophole
@ausbitbank My critical blockchain intel analysis and report on EOS's possible disruption of Steem and Bitcoin. The Steemit Inc 2017 Roadmap and Steem-Dev priorities may need to be rethought and reset to address what appears to be a real threat - unless Ned worked out something with Dan that is going to keep Steem's head above water?
https://steemit.com/steemit/@cyberspace/the-new-eos-platform-will-disrupt-steem-bitcoin-ethereum-and-all-1st-generation-blockchains-and-cryptocoins-guaranteed
Fascinating, and that explains a lot. I was a bit worried when the error was still occurring after the block size fix. Glad to here the error has been pinpointed! Thank you @ausbitbank
Thanks for the update and keeping us in the loop cheers.