"I should have remained an outcast from the church visible"

The church visible refers to the visible earthly community of Christians, as opposed to the church invisible, which is populated by saints and God’s elect.