Ben, have you thought about flying a glider, ie sailplane? I am not sure where you are, but I know there are some glider operations around. Look in local yellow pages or on line for phone numbers. It is not the same as an ultralight, but might be a lot safer than something like a Wright Flyer homebuilt and it will really fly. Go try an intro flight if you have not done it.