SteemWorld ~ Weekly Support ~ #13

in #steemworld6 years ago (edited)

[EN]


This post is intended to cover the server costs for SteemWorld.org and to enable me to continue my development in the future.

In case you missed the first part:
SteemWorld ~ Weekly Support ~ #1

[DE]


Dieser Post ist dafür gedacht die Serverkosten für SteemWorld.org zu decken und mir in Zukunft weitere Entwicklungen zu ermöglichen.

Falls du den ersten Teil verpasst haben solltest:
SteemWorld ~ Weekly Support ~ #1

We are back


Wow, the blockchain must have grown more than I expected. In my last post I mentioned that re-indexing all blocks would take a few hours, in fact it took my server more than 24 hours to go through all the mess and rebuild the databases. For me as a developer it is clear that we needed something like the resource credits to keep the chain running smoothly.

Since I would have been running out of space in the coming months, I needed to optimize a few more things regarding some heavy database indices. My indexed DBs are now half the size they have been before and there seem to be no measureable performance differences on SteemWorld. Multi-column indices are super fast and I would not go without them, but SSD space has it's limits.

With the additional available disk space I may be able to re-index in a backup path from now on (as originally planned), so that SteemWorld will no longer be affected in times of a full chain replay.

Updates


Key Generator

There is a new tool for generating account keys to be found in Tools:

When typing in an account name and master password, the resulting private and public keys are being calculated and displayed in the table below the form:

Of course, the displayed keys are not the real ones for my account ;)

As I anyway need a random master key generator for the coming Account Creator, I added a button 'Generate Random' in here as well. The keys are being generated in the same way as in the registration process on Steemit.

Claiming Accounts

It is now possible to claim accounts in the Account Creator tool. The amount of pending claimed accounts is being shown at the top:

Creating the claimed accounts will be available soon. Of course, if you have enough SP (currently ~ 5000), you can already claim accounts for later use. Keep in mind that this may take a huge part of your available RCs away.

In the making


  • Account Creator
  • Web service for loading the data in a more efficient way
  • Different views in the Posts Overview
  • Improved Coming Curation Rewards overview
  • RC costs calculation

Links


EN  |  What is SteemWorld?
-> Welcome to SteemWorld.org!

DE  |  Was ist SteemWorld?
-> Willkommen auf SteemWorld.org!

Thank you for supporting my work!


Positive thoughts create a positive world. It all begins with connecting our thoughts with emotions. What we focus on is what becomes powerful. We are the creators of our world.

Much love,

Sort:  
There are 2 pages
Pages

Supported,

Are you really use sql-lite for such a heavy load?

I have worked with many different database systems in my life and as long as only one process needs to write at the same time I will always prefer to use SQLite. Read operations are super fast on SSD, because of the all-in-one-file architecture. No database service is required, therefore there is no interface in between through which the data needs to go.

SQLite is an amazing library that gets embedded inside the application that makes use of. As a self-contained, file-based database, SQLite offers an amazing set of tools to handle all sorts of data with much less constraint and ease compared to hosted, process based (server) relational databases.

When an application uses SQLite, the integration works with functional and direct calls made to a file holding the data (i.e. SQLite database) instead of communicating through an interface of sorts (i.e. ports, sockets). This makes SQLite extremely fast and efficient, and also powerful thanks to the library's underlying technology.

More details can be found in the original article:
SQLite vs MySQL vs PostgreSQL: A Comparison Of Relational Database Management Systems

Well, maybe I used to work with more complex data and data-flows but it seems to me that sooner or later to run into database limitations.

For example 1 simultaneous write is quite a severe catch. Also highload app (imagine you need to scale 10 times with the growth of steemit users) demands data separation into hot and cold sets. Indexes and recent partitions on SSD and old data HDD plus you can decompose most of tables into cold-hot rows. So you really need to write new sets into db and manage/process another chunks simultaneously.

And lets not forget completely about replication/failover... It would be sad if you had lost your data and now end up with 3 days downtime in order to re-process all blockchain data in single thread.

I know full-sale DB engine is an investment of resources but calculated and with strong roi prospects.

Just my 2 satoshis.
Cheers!

Well, maybe I used to work with more complex data ...

Yes, that's exactly the point. I worked for 8 years for large companies in the logistics sector. We mainly used enterprise servers by Oracle, Sybase and Informix, which of course work on a higher level than SQLite, because they are highly configurable and come with huge performance and stability benefits for simultaneous write operations. For such case I would not work with SQLite and I think it would not even be possible.

But as long as I can run SteemWorld with my current setup, I will stick to SQLite. There is only one process that needs to write to the databases and I don't think that this will change in the near future. Re-indexing the data can be executed in a separate backup path without having any server downtime. Maybe at some point in future I will tell you that I needed to upgrade to a more complex engine, who knows :) For now it's working great.

Love steemworld. Are there any plans to intergrate it with steem keychain rather than use the keys directly?

I'm still searching for a secure cross-platform solution that I can implement. Private Keys (if stored) must be encrypted and only readable by the clients, maybe with one or more master passwords for different 'key groups'.

SteemConnect doesn't store the keys but it uses delegated key privileges, which leads to a few Apps having active key privileges for thousands of accounts.

Keychain might really be a better solution but I haven't looked into it in detail yet. Will do soon ;)

Thanks for responding .

Thank you, @SteemChiller, for your service to the Steemit community.

Your tool has completely offset all the other available sites. 😂

Thanks for such a good work! 😊

I'm so happy to (automatically) place my (little) 100% upvote for this so well growing STEEM tool: thank you so much for your continuous effort, dear @steemchiller!

A huge hug from @amico! ^!^/

Not using the Discord like many, this has been my equivalent of the Ginabot. I use this every day. it is an invaluable tool.

@PracticalThought ...Wholeheartedly AGREE... @SteemCHILLER has not only created something highly functional with Incredible Utility, that is used by so many, everyday,,,

...AND HE continuously improves/refines/enhances the SCOPE of SteemWORLD that others here on Steemit, imho, should take notes... This is how to DO It !!....constant, ongoing improvements.

Cheers to @SteemCHILLER, everyone here commenting AND everyone that uses SteemWORLD !!

Resteemed and upvoted. Hope it helps.

Thanks for the updates. Resteemed :-)

Thank you ever so much for all your tremendous effort!
I still have not make the must of the information you have provided us! I think you are spoiling us with such detailed information.

Your world is really in another dimension of virtual reality! I am a mere novice trying to catch up with the blockchain vocabularies.

Cheers.

I haven't really grasped how much info is here either!

Friend, I can tell you again that you will always have my vote, because your program is very, very complete for the needs of many and how friendly it is to show the information, that my 10-year-old daughter @victorialanz understands and uses it.

Greetings from Venezuela, a country where we are fighting to be free, is not easy, but I have to believe that one day we will be free of these communists.

This is really a great update you have really added i must say. I have been using steemworld for a long time and all i can say is that it is wonderful and helpful. Steemworld.org is great and helpful for many steemit user and i must say thank you for creating steemworld.org

This post has received a 20.00% upvote from @jmiller05!

Nice improvements again.

A huge work and effort for this platform, improve day by day, with its single point of view. This the best tools in future for the steemians.

If I try to claim an account your site wants my active key. Can you not do it via Steemconnect? People should not be entering their keys into other sites really.

I've not seen a fill how-to on creating accounts. It's something I'll want to do some time. I just reserved one today and it used up most of my RC.

I'm already thinking about a better solution for the key management. SteemConnect does not store the private keys, but it uses delegated key privileges and I'm not convinced that this can be a secure solution. When I give an external account the right to use my active key privileges, it's nearly the same security risk as storing the key on an external server.

I fully understand your concerns and finding a secure solution is one of my top priorities currently. Using SteemConnect would be the easiest way for me and many people use it, but as I mentioned, there are reasons why I don't want to implement it in my tool.

Upvoted and resteemed. Thank you for your time. Steemworld remains the top tool on the platform.

Can you point us to some explanation about account claiming and creating? Danke!

Posted using Partiko Android

Thanks!

It's a bit more technically speaking but maybe this article by @steemitblog can help you:
https://steemit.com/hf20/@steemitblog/velocity-hardfork-account-creation-guidelines

Hallo @steemchiller

habe da ein Anliegen. Und zwar hast du bei SteemWorld schon die Möglichkeit anhand des eigenen Memo-Keys verschlüsselte Nachrichten anzeigen zu lassen. Leider funktioniert das nur bei den Transaktionen von bis zu den letzten 7 Tagen. Wenn ich aber unten bei Tools nach bestimmten Transaktionen nachsehen möchte wer mir vor 15 Tagen zum Beispiel eine Nachricht gesendet hat, wird mir beim Klick auf die Nachricht leider nur die Verschlüsselte Version angezeigt. Gibt es eine Möglichkeit seinen Memo Key für vielleicht eine bestimmte Zeit von 10 Minuten als Session auf der Seite zu hinterlegen um so dann die Nachrichten lesen zu können? Dieses Feature habe ich gerade echt vermisst da ich versucht habe ältere Nachricht zu bekommen und SteemWorld das einzigste war, welches zumindest sauber und sortiert diese darzustellen.

Wäre auf jeden Fall cool wenn man auch ganz alte Nachrichten bei Steemworld entschlüsseln und lesen könnte.

Vielen Dank und viele Grüße
@louis88


Hello @steemchiller

I have a request. And SteemWorld gives you the possibility to display encrypted messages with your own Memo-Key. Unfortunately, this only works for transactions up to the last 7 days. But if I want to check below at Tools for certain transactions who for example sent me a message 15 days ago, only the encrypted version will be displayed when I click on the message. Is there a possibility to store your Memo Key for a certain time of 10 minutes as a session on the page to be able to read the messages? I really missed this feature because I tried to get older messages and SteemWorld was the only one that was at least clean and sorted to display them.

Would definitely be cool if you could decipher and read old messages at Steemworld.

Many thanks and many greetings
@louis88

Vielen Dank für den Tipp! Ja, das fehlte an der Stelle natürlich noch. Habe ich eben eingebaut und sollte jetzt funktionieren ;)

LG, Chiller

Thank you for everything you do and have done, I send you good vibes all the time <3 <3

Thanks for keeping this up. My 100% upvote is not much but more than happy to contribute.

Excelente tu pagina, todos los días los lo utiliza como herramienta principal para ver mi gestión de mi cuenta, muchas gracias

Your great work needs good support ;)
@steemchiller, I've been wondering, would it be possible, under the "Account Operations" section, to query data older than those last 8 days at the left-hand side navigation?

Thank you, once again!


SteemitBannerLightCaptured400px.jpg

I've been wondering, would it be possible, under the "Account Operations" section, to query data older than those last 8 days at the left-hand side navigation?

Yes, it would be possible but not with the normal Steem API. My goal is to have kind of a date-picker there in future, so that we also can choose a date range for the operations. Storing and indexing the whole account history comes with some crazy hardware requirements and I will definitely need much more space on my servers. With my current earnings and the low STEEM price it's impossible for me to order new hardware, but it is planned for the future.

Absolutely understandable! Hopefully the conditions will improve, I appreciate what you're doing and I'm glad you have those development plans. When I started using Steemit in March, I researched all the "tools and apps" available and in my humble opinion, SteemWorld is one of the best if not THE best.
Thanks to SteemAuto, you have my permanent vote now, it's not worth much at the moment, but I'm working towards getting more SP.

Have a great week,
Damian

Thank you for all you do! Now and then I go over to introduceyourself and let some new folks know about your most excellent service.

I complete understand the database problem on blockchains... it is something that has to evolve otherwise they are not able to become industrialized quickly.

For me, and being part of high performance computing market (where most of things have to consider levels of second/millisecond), it makes me beleive that the next step is tiering on databases... so that, for example neworks become a collection of nodes that are not ALL with the same database. This already "somehow" exists but in a different concept and for other purpouses, for example, on EOS for the historical indexed information that records all the blockchain activity.

Thanks for staying around.

Voted👍😉 Keep on the good work!😁

Posted using Partiko Android

Excelente trabajo, muy buena herramienta, muy completa y detallada!! Saludos!!

Wow this actually shows how dangerous it is to lose your entire account once your master key is lost.

This is a really cool tool to reveal the keys without having the trouble to get into the Steemit platform, although this does raise some security concerns if one person has already obtain the master key then everything is exposed. haha.

This post has been just added as new item to timeline of SteemWorld on Steem Projects.

If you want to be notified about new updates from this project, register on Steem Projects and add SteemWorld to your favorite projects.

Thank you very much, as always. Could not live without your "tool".. first thing I open in the morning!

Vielen Dank.
"Claiming Accounts" und der "Account Creator" ist eine großartige Idee, bei genügend RC ist es damit möglich, schnell auf anderen Wege Accounts zu erstellen. Echt super!
Ich würde rewarding old post in der Tool-Sektion auch sehr begrüßen ;)

Positive thoughts create a positive world.

That's it!!!
steemon2.png

Good job. Thank you for helping us achieve our goals. Happy weekend. @steenchiller

Awesome new updates! Thanks for your continued work!

I assume the claiming accounts is linked to our account?

I assume the claiming accounts is linked to our account?

Yes, the claimed accounts are linked to our account. It's not possible to create anonymous accounts with that, because the created accounts always have a reference to the creator's one.

Steemworld ist meine Welt an Steemit - es zeigt mir was so alles los ist!! Danke dir!

Good job i upvote you!

Great! thank you for all your work! :)

Keep workin it bro!

Posted using Partiko Android

Thank you so much!

Happy to support this. Followed!

it is really great to see the progress, more option more hard work for us as the user @steemchiller. but the new tool is really good to use. It is getting better and better as I noticed

You do such good work, @steemchiller!

Thank you for your efforts!!

Upvoted and resteemed!

I LOVE STEEMWORLD.ORG

Thank you, Thank you, Thank you, Thank you, Thank you, Thank you, Thank you, Thank you @steemchiller

Hello @steemchiller

Can you help maybe? On steemworld.org I used in section ‘Balances’ the feature ‘Convert SBD…’.
It worked and I got the message
Fill convert request: Paid 90.000 STEEM for 46.218 SBD
in my wallet and as you can see here that it was pending:

Bildschirmfoto 2018-11-22 um 20.13.49.png

Now - after 3.5 days the message about the conversion of 46.218 SBD is gone - but no STEEM appeared in my wallet :(
It was 9.679 STEEM before and it’s the same amount now. So it seems I have lost the SBD I want to have converted.

You are definitely more sophisticated than I am in getting some information from the blockchain. Maybe you can help…

Thanks in advance
@retinox

The first message 'Filled convert request...' could be from the internal market where I bought SBD.
But then I used that 'Convert SBD...' feature with the amount of 46.218 SBD (who disappeared now).

Ok, let's see. I found the operation where you executed the convert request. In my timezone it was Nov. 19th 20:03. Adding 3.5 days get's me to Nov. 23th 08:03. Your package is on it's way and will arrive tomorrow in the morning (~ 07:03 UTC ;)

Maybe the conversion hint on Steemit does not take the timezone into consideration...

@steemchiller, you are right - it's always the time zone which is not considered in steemit. It was the same issue with the second conversion. Thank you for your fast help - it prevents me from having a 'sleepless night' about what could have gone wrong...

I tried to find the window you included in your answer on steemworld.org - but couldn't find it. Maybe it's well 'hidden' or on another site? Thanks again... @retinox

Good to hear that it worked!

I tried to find the window you included in your answer on steemworld.org - but couldn't find it.

You can just click on the desired row in the list (account operations) and it will show the details as shown in my screenshot.

Thank you @steemchiller 😃 The easiest solution I haven't tired... 🙈

oh thank you @steemchiller for this hint and your help... I'll look tomorrow morning and let you know as well.
The time zone issue could be a good explanation...
steemit probably have some problems now - my account value is about 851 billion (and I know I haven't put all these money into steem ;)

Hi\Came back to ask a question

Under Coming Rewards
Do people have reason for wanting to see how many $0 comments or posts they've had?

Me - they just make me wonder why I bother

Yes, that will definitely be implemented in the coming weeks ;)

Thanks, as always, for all the awesome you work you do! On a daily basis, I am grateful to have SteemWorld to help "keep me oriented" as I go about my travels on Steemit. Thank you!

=^..^=

Nice job bro! Do you want me to translate this post in spanish?

I cant contribue with a juicy upvote but at least i can help you with that! just send me the text for your next post and ill do the translation work.

[email protected]

Thanks for all your hard work

You're awesome!

Siempre es una grata experiencia usar esta plataforma

Thank you Thank you Thank you!!!

Totally impressed by your work.

There are 2 pages
Pages