A long-time fixture of Portsmouth's Olde Towne will close its doors for good after Sunday.