Hivesearcher update, indexing improvements

in HiveDevs4 years ago

Last few weeks, we have made few changes to Hivesearcher to make it compatible with new hardfork and improve indexing.

hivesearcher-decentralized-search-engine

As many of you know Hivesearcher is best opensource, decentralized search engine built on Hive. You can find any content regardless of age and author, reward, quickly. Flexibility it offers is huge and of course it is horizontally scalable.

Recent hardfork brought a lot of unexpected changes to Hivemind (layer-2 api), one of those changes were completely removal of hive_posts_cache table.

Hivesearcher is a plugin or extension built on top of Hivemind and hive_posts_cache table was used as source of content for Hivesearcher Elastic search engine. After removal, we had to improve code and make some changes so our indexing could continue and search has up to date information.

Also feeding incorrect information to elastic search instance would disrupt data and thus affects the search results and ranking. That's why we halted syncing after hardfork until Hivemind data was correct and had stable version. Since last week our Hivemind instance seem to be running much better and collecting/giving correct data, so we enabled indexing of newer posts.

No changes required from dapps developers

API endpoint had zero downtime, during those upgrades https://api.hivesearcher.com

API documentation, integrate fast search engine for your Hive dapps, offer custom feed and content filters to your users.

Proposal details

Sort:  

I think it would be good to improve what's displayed for relevance.

image.png

I'd prefer to see the profile with the newest posts when I enter an account name, not some random comments/posts 😄

Screen looks like from Ecency.com, we just added search page quickly in last update to make it ready for desktop app, previously it was forwarding user to hivesearcher.com, we will surely add more options and show power of search engine our team built. Right now, you can type @text in search field, it will find you users, type #text it will find you tags, $text will find you communities. So UI side of things will be improved for sure. As for hivesearcher side, we finished migration last week and we will do some improvements in ranking algorithms in coming weeks. Attached few screenshots of quick search:

find-hive-users-quickly

trending-topics-on-decentralized-web

find-best-rewarding-communities

Good work, as always :)

Reblog it

great!

I felt it was fine and improved login problem on different platforms

Hello, @good-karma. My whole blog, which I started three years ago now with 1450 posts, is about jazz music. However, I write the word "jazz" in the Hivesearcher and non of my posts appear. Why?

You can add author: keyword to filter results even further.
https://ecency.com/search/?q=jazz%20author%3Afjcalduch

Using 1 word usually has different weight on different posts, try adding 2 or 3 words to filter results further. With jazz you probably see your posts as well but your content is competing with other content for ranking and how keyword is used. For example I see many posts with jazz in their title...