Sometimes it is fun to go back and look at old tax records. But for reasons other than nostalgia, it's not necessary to hold on to most of your records for more than three years.
If you want to save tax dollars, deferring your funds into a retirement account is probably the best solution. That money grows tax free and (if you take out a traditional IRA) you reduce your taxable income in the year you make the contribution.