Well, yes - but perhaps I wasn’t clear: The “pull” of “knowing where you are” (or something similar) can be very powerful, leading even pros to ignore other cues.
The most famous example I can think of offhand is the airliner that emerged from the clouds on an instrument approach, saw an illuminated runway dead ahead, and proceeded to land on that runway - 10 miles short of the airport they were actually intending to land on. [This has happened multiple times, btw] They were so used to making the transition from instrument to visual that they ignored all the instrument cues and made the visual approach.
Could this happen to a mariner? I bet it could.
If the navigator is doing it right, of course, then everything works fine - he identifies his visual error and corrects his internal navigation - but not everyone does it right all the time
My point was that visual errors can be very powerful and cause one to ignore other cues. Edit to add: this problem is MOST likely to affect someone in the higher categories you mention