Before we get started, I assume that you are already familiar with the following;
- You know how to run and use various features of Stable Diffusion, locally or on Google Colab.
- You know how to debug stuff when things don’t work correctly.
- You have decent experience in programming and understand how to read/write code.
- You already know all the terminology related to Stable Diffusion.
That said, I will focus only on the critical aspects of a possible algorithm that can get things done for us. I won’t be focusing on the environment setup, installations, etc. This is not a beginner-level tutorial. However, you may casually read to understand the kind of stuff possible with Stable Diffusion.
Problem Statement
Image Source: Adobe
Recently, Adobe revealed their new suite of Generative AI called Firefly. One of the applications was to create stylized text like the above. Can we create similar effects using Stable Diffusion?
When I tried to input the same prompt directly to SD, here’s the result I got.