You've got to make sure every decision you make is right for you as a person. If you think you can go to a better club than the one you're at, then, regardless of what anyone says, you should go.
Regardless of whether it is playing for your school team or playing for Manchester United, winning is great.