"taking with him a bell, a Bible, a candle, and a cross"

Bell, book and candle refers to an archaic method of excommunication used by the Catholic Church for one who had committed a particularly grievous sin.