Projects
Each lesson will have some small exercises for you to try out some of the ideas, but I’ve also designed three larger projects for you to show off your skills. At some point TBD I’d like to figure out getting certificates for those who complete these, but have yet to figure out the details. This page will host the project descriptions and info on submitting yours once that’s all figured out.
Project 1: The Golden Generation
Once you’re done with lessons 1-5, check out the bonus notebook ‘Fun with Generators and Losses’ [TODO link]. Your goal is to come up with a custom pipeline for generating images. A user should be able to provide minimal input (perhaps an input image, or a piece of text, or both) and get back something special. You can acheive this in a number of ways: - Pick an existing generator alongside one or more loss functions and set them up with good default settings - Create a new generator following the template in that notebook - Create your own custom loss function - Chain together a sequence of steps where the output of one step feeds into the next.
Package the resulting pipeline into a gradio interface (see the bonus notebook ‘TODO Gradio NB’ for a guide) and share it as a huggingface space.
For inspiration, check out my ‘waterface’ demo that first processes an input image to look like a sketch then optimizes an imstack of the result towards a CLIP prompt: https://huggingface.co/spaces/johnowhitaker/waterface
Project 2: WE GAN DO IT!
Train a GAN on your own data - synthetic or curated. Try different architectures and training tricks, until you get a result you’re happy with. Document your experiments and results with a nice report. See TODO W&B tutorial for a guide on logging experiments.
TODO example report, sweeps example
Project 3: Looking Fine(tuned)
Fine-tune a diffusion model of your choice using your own dataset. Share it with the world - set up a custom pipeline, share training details in a report, make the model weights available and maybe set up a cool colab notebook for people to try your new model, complete with fancy features like CLIP guidance or image-to-image.
Final Project
Make something amazing! You can adapt one of the projects above or forge your own path off the beated track. Whatever you choose, the goal of this final project is to take it to the next level :)
Page stats: Total Hits: 
Page visitors: