From the course: Fine-Tuning for LLMs: from Beginner to Advanced

Unlock the full course today

Join today to access over 24,700 courses taught by industry experts.

Demo: Transfer learning with FLAN-T5

Demo: Transfer learning with FLAN-T5 - Hugging Face Tutorial

From the course: Fine-Tuning for LLMs: from Beginner to Advanced

Start my 1-month free trial Buy for my team

Demo: Transfer learning with FLAN-T5

“

- In this demo, we are going to do translation from English to Spanish using Flan-T5 and we are going to do it with transfer learning on the opus-100 dataset. This is a very very important task and also it's a very important demo overall because it's one of the things that we're going to do most often. So stating that, let's connect to a GPU. Perfect, now we have our GPU, as you know the first thing that we need to do is to do the pip install. Perfect, now that pip install is done, you may imagine the second step is to download the tokenizer model. Notice that for this specific demo, we are going to use Flan-T5 five base, instead of large and the only reason is to take less time in the training, honestly. You can use large and it's going to work fine, you can use a small if you don't have a GPU, it's going to work out fine, okay? The difference in the size will be the capacity of doing tasks better and better, right? There we go, our model is downloaded, so now we have to load the…

Contents