There's certainly nothing wrong with going to an ultralight to get in the air. And I'd suggest that starting earlier might be a good way to go, since I've seen too many people who waited 'til retirement (or something else major) before starting flying or buying an RV or trying some other major hobby/endeavor, only to find they either didn't live that long or their lives were cut short so they didn't have long to enjoy it, or they wound up with disabilities that hindered their plans.

So given your comments above, I'd say go for the PPG and learn, possibly with the thought of changing later, but also keeping in mind that there are lots of folks in ultralights who are there just for the joy, and many who were fully licensed that ALSO took up ULs without giving up regular aircraft, so go for it -- you'll likely be glad you did.