Book : Mastering Transformers Build State-of-the-art Models.

-Titulo Original : Mastering Transformers Build State-of-the-art Models From Scratch With Advanced Natural Language Processing Techniques

-Fabricante :

Packt Publishing

-Descripcion Original:

Take a problem-solving approach to learning all about transformers and get up and running in no time by implementing methodologies that will build the future of NLP Key Features Explore quick prototyping with up-to-date Python libraries to create effective solutions to industrial problems Solve advanced NLP problems such as named-entity recognition, information extraction, language generation, and conversational AI Monitor your models performance with the help of BertViz, exBERT, and TensorBoard Book Description Transformer-based language models have dominated natural language processing (NLP) studies and have now become a new paradigm. With this book, youll learn how to build various transformer-based NLP applications using the Python Transformers library. The book gives you an introduction to Transformers by showing you how to write your first hello-world program. Youll then learn how a tokenizer works and how to train your own tokenizer. As you advance, youll explore the architecture of autoencoding models, such as BERT, and autoregressive models, such as GPT. Youll see how to train and fine-tune models for a variety of natural language understanding (NLU) and natural language generation (NLG) problems, including text classification, token classification, and text representation. This book also helps you to learn efficient models for challenging problems, such as long-context NLP tasks with limited computational capacity. Youll also work with multilingual and cross-lingual problems, optimize models by monitoring their performance, and discover how to deconstruct these models for interpretability and explainability. Finally, youll be able to deploy your transformer models in a production environment. By the end of this NLP book, youll have learned how to use Transformers to solve advanced NLP problems using advanced models. What you will learn Explore state-of-the-art NLP solutions with the Transformers library Train a language model in any language with any transformer architecture Fine-tune a pre-trained language model to perform several downstream tasks Select the right framework for the training, evaluation, and production of an end-to-end solution Get hands-on experience in using TensorBoard and Weights & Biases Visualize the internal representation of transformer models for interpretability Who this book is for This book is for deep learning researchers, hands-on NLP practitioners, as well as ML/NLP educators and students who want to start their journey with Transformers. Beginner-level machine learning knowledge and a good command of Python will help you get the best out of this book. Table of Contents From Bag-of-Words to the Transformers A Hands-On Introduction to the Subject Autoencoding Language Models Autoregressive and Other Language Models Fine-Tuning Language Models for Text Classification Fine-Tuning Language Models for Token Classification Text Representation Working with Efficient Transformers Cross-Lingual and Multilingual Language Modeling Serving Transformer Models Attention Visualization and Experiment Tracking Review In recent years, the combination of large-scale language models, based on transformers, with transfer learning techniques has played a crucial role in the advancement of the Natural Language Processing field. This book offers a gentle introduction to transformer architectures, starting from the building blocks of these networks and diving into practical and diverse applications. It is a great read for both NLP researchers and industry practitioners. Students with beginner-level knowledge of machine learning can easily pick up this book and demystify the methods that brought so many breakthroughs, but there is also a lot of valuable information for more advanced readers. Review Transformers rule for a lot of NLP tasks now, and this is a great book about them. Beginners will appreciate clear explanations and experienced progr