I’m not sure which thing you are referring to as ridiculous.
Opening a gateway to the “correct” plane is not a trivial as you might think. Even for the truly skilled, and then which planet do you open it to…how do you avoid opening a gate in the middle of deep space between planets?
We are talking an infinite number of near infinite planes, it is sort of like looking for a needle in a haystack.
Teleportation on a plane requires you to know where you to know your destination very well.
Runic Gateways require gates with links between them on both ends.
Astral Travel requires orientation in the Astral Plane and some sort of map or idea of where you are going and how to get there.
So popping back and forth between two infinite planes with a ‘gateway’ that has no end points is extremely difficult. You could end up anywhere in the Abyss or on Anuropia or worse…