The Olympics are great for notoriety right off the bat, but your body of work is what people remember you for.
Plus the public's attention span is so short right now, if a skater doesn't strike while the iron is hot... well it's not like people will forget you, but they just won't care anymore.