Once again, Mr Bliss is indicating his familiarity with the work of William Shakespeare.
This line is taken from Act II, Scene 1 of Shakespeare's play The Taming of the Shrew. It is said by Petruchio to Katherina, the heroine of the drama, and the shrew of the title:
We will have rings and things and fine array;
And kiss me, Kate, we will be married o' Sunday.
Kiss me Kate is also the title of a musical, with music and lyrics by Cole Porter, which was first performed in 1948. A film version of the musical was released in 1953.
Listen on Spotify to the song Kiss me, Kate from the musical.