Can one start racing too soon?

I'm following a self-modified version of the plan in the power training book however;there is a stage race in vegas I'm considering but it comes at about week 6 or 7 in my plan--I've read somewhere that too much too soon in terms of racing can decrease vo2max-I don't really get that but theres alot I don't get. Should I hold off some? try and find an easier one day race instead? I had also read that if you can choose its best to pick easier early season races so you don't spend too much time "anaerobic"--I kind of think as long as I allow proper recovery after that isn't a big deal.My first big peak is planned for early May at the Gila so I don't want to peak too soon but in the past I don't get going good until late july. I've basically heard conflicting info on this topic😕 and want to pick your brains to see what you guys think