"All my life I have been a poor go-to-sleeper "

Nabokov, no master of modesty, tests the reader's  - or rather vaunts his own - literary knowledge in this throwaway line, in which he hitches himself to an already established literary giant, Marcel Proust, by feebly paraphrasing the famous first line of A la Recherche du Temps Perdu: "Longtemps, je me suis couché de bonne heure".  

Earlier in Speak, Memory, on page 66, Nabokov describes his ruses to delay for as long as possible the moment of separation at bedtime, when his mother handed him over to a governess: "I was merely playing for time by extending every second to its utmost". There are echoes here, though nowhere near as neurotic as that of the French writer, of Proust's evocation in A la Recherche du Temps Perdu of the agony of bedtime and his attempts to get his mother to come upstairs to deliver his goodnight kiss.