Pretty much my ultimate aspiration too!
I think the measuring stick is far more a product of personality than anything.
Not everyone who wants to get faster/fitter also wants to race.
We are all at the same level…doesn’t matter if you’re pedalling $100 or $10,000.
Cycling is a heavily equipment-dependant activity, we all deal with those headaches.
Refer to this if you start thinking otherwise. 
And you thought equipment troubles were bad!! 