The "Cleaners" produced in Fairyland were, in fact, a mixed bunch.
Some fairies were deliberately let go by the Light of God Destruction; some truly had conquered despair once; while others were directly manipulated by the consciousness of the Light of God Destruction.
Those Cleaners who were directly manipulated by the Light of God Destruction might have slightly changed personalities, but this didn't draw much attention from others.
That's because, as long as one truly overcame despair once, the Black Energy would find it difficult to affect them again.
Cleaners who "escaped" from despair were often assigned to vital positions combating the Despair Breath, which gave the Light of God Destruction the opportunity it sought.
After years of plotting, the Light of God Destruction finally seized the chance to execute its plan.