This is a line from a poem by Robert Wild, a non-conformist minister and satirical poet. The poem has the catchy title: Poetica Licentia. A Gratulatory Poem Upon His Majesties Gracious Declaration For Liberty of Conscience. With a Friendly Debate betwixt Con and Non.
Geoffrey Sill discusses it further in ‘The Source of Robinson Crusoe’s ‘Sudden Joys’’, Notes and Queries, 45.1, (1998) pp.67-8.