Some self-explaration works on transformer: audio, images, text, ...
Note Full Parameters Tuning
Note LoRA Adapters