Tall tales, traditions and bizarre collections reward the nosy in England’s historic university city.