This is something you'd have to prepare for, definitely. The closet ports are in Saxon hands, so you'd have to finance an expedition, acquire transport, find a guide. The ports across the channel are also in Saxon hands, so you're need to find someone willing and able to put you ashore without a seaport.
You're looking at a month, minimum, to pull all this off.
In your absence, your steward would run things on your behalf. Without a wife, your steward is an older non-knightly relative from among the 8 other relatives on your family list.
Meta-game-wise, quests in Pendragon do not necessarily happen in the same season as the hook drops, or necessarily in the same generation as when the hook drops. This may be something for future generations to do. I'm not saying it is, but you may not have the resources to do it just yet.
Survival Guide applies - make your own choices, but keep an eye on the future.