Working the problem the other way. Instead of plotting the position on the wx chart and looking at the weather just do the reverse. Look at the weather and plot your position. Navigate using the wind speed/direction and air pressure.
It would be like using knowing your altitude and a topo map to find your way in the woods. You’d need both current weather maps and the forecast. Should be good for 96 hours of navigation.
Assuming of course the navigator is the “good seaman” of legend.