Fine-tuning against a modified noise, enables Stable Diffusion to generate very dark or light images easily. https://www.crosslabs.org//blog/diffusion-with-offset-noise