It is happening to a lot of games even if the games are not PvP oriented. I remember playing Warframe and while the game is PvE you can still help new players clear out levels and stuff. It has gone really bad that some players with insane build will clear entire rooms in a sec while the new player is left shocked and it is not the same experience as playing it on single player mode. Balancing a game is not an easy thing for sure.
It would be interesting to test it and try to break things... (which I do to all the things I do...lol)