It’s never too late. I think you should go for it.
I am finding that I am able to learn faster and more effectively than when I was younger. I think it’s because we learn a lot more than we realize as we age, and that forms a strong foundation for learning. I’m talking about people who are naturally lifelong learners, like you and I.
If you love doing it, then do it. Before long, you will be world-class. Who will question your position then? Einstein went and became Einstein. Be your Einstein. Be your Bohr. Be who you were destined to be, and be it today and every day.
Nobody can second-guess your passion.