My Dad said the very same thing. He passed away a few years ago at the age of 93, and hunted all his life with only a 30-06. He shot everything from ground squirrels to elk with a good old 30-06.
I really enjoy reloading, as of right now I'm reloading for 8 different rifles. Many of those I have several different loads using different bullets. I'm also retired, so that makes a big difference!
Welcome to the forum! Lots of good advice above.
My M70 25-06 shoots just about everything well, but especially 115g Ballistic tips. I have used RL26, Retumbo, Magpro, IMR7828 and 4831. All have worked well , but RL26 gives the best accuracy and velocity.
If you get a chance try some 115g...
I've shot a lot of mono bullets over the last several years and had the same problem with Barnes TSX in my son's 243 and in my 270 win. We switched to ttsx in his 243 and they were a little better, but still penciled through on a couple deer. Hammer bullets have been amazing on deer from a 243 win.