The good news is that weight bearing exercise like Yoga, with focus on alignment and balance, helps maintain bone density and prevents falls. So keep at it!
However, the past emphasis on osteoporosis has been towards women and that “has fostered a sexist view of the bone-weakening disease. That’s harmful to men, whose bones also weaken with age, though later than for women. What’s more, men are twice as likely as women to die within a year of breaking a hip, research shows.”
A change in diet and supplements can help but checking with your primary care doc is probably wise.