About a year-and-a-half ago, I went through a devastating breakup and, soon after, began a love affair with perhaps the strangest hobby an ex-yeshiva girl could imagine: Sacred Harp singing.

Singers at Holly Springs Primitive Baptist Church in West Georgia treat their red hymnals like extensions of themselves, never straying far from their copies of “The Sacred Harp” and its music notes ...