Advanced Fine-Tuning Techniques

Plan:
- PeFT (e.g. LoRA theory)
- Distillation
- Quantization and Low-Precision training
- Distributed Training?
- Adapter networks
- Synthetic Data: InstructPix2Pix case study (maybe also talk about the papers that do chain of thought distillation and other stuff)

This is one we can think hard about.