Hey @badrag, thank you for your feedback!
I just wanted to mention a couple of things. The season you tested with Archmage only included about 1/3 of the time before we made the changes we've been working on. So, a significant part of your test results may not accurately reflect our current optimized code.
The failed submits were due to a lingering issue from a database problem that we were actively resolving while also implementing new code. We are closely monitoring this issue, and it seems to be mostly fixed. Of course, there might still be some new bugs, but we're addressing them promptly.
It might be worth giving it another go for another season or two, especially because our results should keep improving based on how we've built it.
Let me know if you have any more questions or concerns, but either way, thanks for the fair look.
All in all, it looks like Archmage still helped you earn more, even when accounting for fees. With the failed submits being fixed... that should be even better ;)
Question though - are you factoring the rewards with EV or actual rewards? (Edit: Reread and it was answered already)
I just reread - not sure how I missed that you DID mention the EV portion :) That's what I get for reading quickly I guess. @badrag
Thanks for the reply!
Yeah, the updated code was something I had hoped wouldn't be an issue. My logic for going ahead was that the issue happened with the Rebellion release, which was like 6 weeks ago. So I didn't feel too bad penalizing a bot that wasn't able to fix problems in that time frame. And from the messages in the discord, it seemed like the biggest changes were to the lower leagues. AM actually performed pretty well for me early on; it got up to Champ faster than XBOT did.
I do think I'll rerun the test in a season or two and see how much the update did.
And yeah, the final numbers were interesting. If the services were the same fee, I'd go with AM hands down. But 3x the fee, kept it more similar. And importantly, that fee is SPS, the only truly fungible reward we're getting right now. If I could pay the 15% fee in potions I would also choose AM hands down.