"It would be apostasy"

Apostasy means turning away from or compromising your creed. Mr Vladimir implies that the doctrine of anarchy and the institution of marriage are mutually exclusive and it would be impossible for Mr Verloc to be true to both.