There is also a chat rank requirement so if they just registered I am guessing they wont have that requirement met. It only takes a few weeks of interacting for it to be enough though :)
Also the bot only recognizes top level comments and doesn't work retroactively.