Many Bible verses reference the goodness of God. A few examples:
Psalm 145:9: The LORD is good to all, and his mercy is over all that he has made.
Psalm 86:5: For you, O Lord, are good and forgiving, abounding in steadfast love to all who call upon you.
Exodus 34:5-7 (Yahweh’s self-description to Moses): The LORD descended in the cloud and stood with him there, and proclaimed the name of the LORD. The LORD passed before him and proclaimed, "The LORD, the LORD, a God merciful and gracious, slow to anger, and abounding in steadfast love and faithfulness, keeping steadfast love for thousands, forgiving iniquity and transgression and sin, but who will by no means clear the guilty, visiting the iniquity of the fathers on the children and the children’s children, to the third and the fourth generation."
Note in the last passage the two-edged sword of the goodness of God; as Lewis says later on this page, "If God is like the Moral Law, then He is not soft."