From the course: AI Text Summarization with Hugging Face

Unlock this course with a free trial

Join today to access over 24,700 courses taught by industry experts.

Loading the CNN Daily Mail dataset

Loading the CNN Daily Mail dataset - Hugging Face Tutorial

From the course: AI Text Summarization with Hugging Face

Start my 1-month free trial Buy for my team

Loading the CNN Daily Mail dataset

“

We'll be using NLP models from the Transformers Library. So import transformers and let's take a look at the transformer version that we are working with, 4.31.0 Just a heads up that we'll be using the PyTorch framework to work with the transformer pipeline on Hugging Face. You can use TensorFlow as well. The code that will be different will be the part where we fine-tune the model. The rest of the code should more or less be the same. It's just regular Python. The Hugging Face community encourages you to develop your models and share them with the entire Hugging Face community. And a way to easily integrate your notebook with your Hugging Face account is to use notebook login. Notebook login makes it easy for you to integrate your models and anything else you develop with this notebook with your Hugging Face account and then share it with the rest of the community. Before we run this code, you'll need an access token from Hugging Face so that you can log in with your credentials…

Contents