PoE2: Desert Map Mechanic annoying

The desert map mechanic in PoE2 is annoying. Why do I have do drive around the caravan before being able to use the waypoints. It makes sense in the grand scheme of things, but it's just tedious.

Same reason you have to walk around the other places before you can just use the waypoints.

I agree that it is tedious, if we already have the desert map location available, what's the point in excluding it from the waypoint map? No to mention the caravan waypoint is positioned at the opposite end of the caravan.

Maybe I'm tired of the slow progression through A1 & A2 and the infinite health the bosses all seem to have making me extra sensitive to tedium.