I made the same mistake. I wasnt aware of the Red Fish level until long after I crossed 500 SP.
Yes I advice powering up as much as possible. It is up to each but I think the benefits are outweigh anything else.
Plus people will be very happy they did in a year or so.