Might need to have a talk with your wife.
I have personally seen instances where the wife is always trying to undermine the husband in whatever hobby he has.
This has not been a problem for me but with friends of mine or guys I just knew from the hobby.
The guy just wants something for himself, an outlet to tinker with and enjoy himself and for many reasons, the wife is just a pain in the *** about it.
She finds chores that she wants him to do, she claims the kids need shoes or the porch needs to be restored, the walls need to be repainted, whatever.
The guy pinches pennies and tries to build the car on the cheap but the woman complains that there isn't enough money for it because the kids need braces or a new video game.
The family does need attention but the man needs a hobby, he needs something for himself. If you never do anything that is just for you, you put yourself at risk of building resentment. Who wants to get to 60 and deal with a load of regrets and missed opportunities?
Some women with low self esteem do get jealous of the time that their men spend with cars. I've seen it. The best that you can do with them is to explain that THIS is your form of expression, relaxation, therapy and maybe also a way to stay connected to your past. Old cars can allow us to reminisce about the cars we used to see when we were kids when they were everywhere.