Valley Engineering makes a legal Part 103 called "Backyard Flyer" which has a cantilever wing that swings to align with the craft's longitudinal axis when not flying. Setup and breakdown seems to be very fast, ~10 minutes. Not sure of how popular they are.

You are correct, it would take a real die hard to spend 2+ hrs in setup every time they want to fly for 20 min.