Why residents of a busy UK port are eager for Brexit