When the ladder is rigged in the area along the ship’s parallel body the ladder is against the hull which constrains movement of the ladder somewhat. In the case where the ladder is rigged aft the ladder no longer lies against the hull and is going to be free to swing.
Also the spreader can’t function to keep the ladder from twisting so there’d be that movement to contend with as well.