From the course: Rust LLMOps

Unlock this course with a free trial

Join today to access over 24,700 courses taught by industry experts.

Installing and setting up Rust-BERT

Installing and setting up Rust-BERT - Rust Tutorial

From the course: Rust LLMOps

Installing and setting up Rust-BERT

- [Instructor] Here we have Rust-Bert. You can see it's a Rust-native state-of-the-art Natural Language Processing model and pipeline crate, and it's a port of the Hugging Face Transformer library, using the Rust PI towards bindings or the onyx runtime bindings and also the pre-processing rust tokenizers. Some of the things it can do that are very powerful is multi-threaded, rust based tokenization. So you're going to get some amazing performance and also GPU inference. And if you look at the way it works, it's as simple as you could possibly imagine here. You would actually put a few different statements together and really be able to use any model. Now if we take a look at some of the things that it can do, it can do translation, summarization, multi turn dialogue, zero shot classification, et cetera, et cetera. And you can actually look through all of these different things and see what it supports. So it's a very powerful way to get started with high performance hugging face in…

Contents