In the second season I felt like the plot rambled a lot
Exactly! I really thought that they'd develop those villains from season one, but it seems the plot strayed away from them. I somehow did expect Femt or Aligura to have a serious villain arc but I guess they're meant for something else less serious hehe. Nevertheless, it didn't hinder me from really enjoying its second season.