Check with @gtg, he can assist you in getting your logging correct. It's not really "custom jussi structure", just a configuration of the log settings. IMO, it shouldn't be difficult, with a little assistance, and I think it should work fine for a usage metric.
I don't think the issue is OVH (other than that one time, when there was an actual fire), but we have seen cases where cloudflare has blocked some locations (while most locations are simultaneously able to access it without a problem). I suspect it's related to their DDOS attack prevention system. There are occasional attacks launched against our jussi node.
I have my doubts about all the remote benchmarking tools I've seen. They mostly seem to report different results depending on where you run them from. That's why I think local data at the node is best, if you're trying to measure performance of the node itself, and not external network issues.
Hmm, might be. OVH's own DDOS protection might be dropping packets too.
I agree, That's why I think looking at active DL/UL rate and overall monthly bandwidth usage, as well as established netstat connections (for 443 should work, more or less) to be able to (at least partially) understand the average use on the node.
It seems like on average in April 2021 (so far)
api.deathwing.meused more than 2.5 TB BW (uploaded) with an average of 10 Mbps. Overall established connections stay at about ~650. I've seen it get close to ~1k whenapi.hive.bloghad an issue a couple of weeks ago. (though this just shows the active users at the time of checking it, so the majority are probably bots.)Even without any statistics and just looking at overall use on logs, I can honestly say that I would not be surprised if
api.deathwing.meis the second most used node on the chain.I was wondering if it would be possible to somewhat implement/upgrade jussi with some new features such as monitoring active connections, calls, chart data etc. In other words, log everything in an organised manner and make it easy so we don't have to scour through tens of gigabytes of logs :P (I know @good-karma was building a project, an upgraded version of jussi, but I don't know it's latest status.)
From my point of view, I'm more interested in the amount of each type of api traffic rather than raw amount as it is more useful for optimization work, that's why I'd like to get the jussi traffic analyzer data.