There might be consequences. As I indicated in my previous post (link below), employees are never really fired in Japan.
So, if a foreigner refused to do a certain task, s'he might not be fired, but maybe just cruelly tortured psychologically – relentlessly – until said foreigner decided on her own to resign from the company.
And then, everything would return to the perfect blissful state of harmony that the Japanese appreciate so much. Ha ha ha!