The Transformer Model

We have already familiarized ourselves with the concept of self-attention as implemented by the Transformer attention mechanism for neural machine translation. We will now be shifting our focus to the details of the Transformer architecture itself to discover how self-attention can be implemented without relying on the use of recurrence and convolutions. In this tutorial, […]

How to Use Transformer-based NLP Models

Attention Is All You Need: The Core Idea of the Transformer, by Zain ul Abideen

Transformer (machine learning model) - Wikipedia

What Is a Transformer Model in Machine Learning?

The Illustrated Transformer – Jay Alammar – Visualizing machine learning one concept at a time.

An introduction to transformer models

Energies, Free Full-Text

How do Transformers work? - Hugging Face NLP Course

An In-Depth Look at the Transformer Based Models, by Yule Wang, PhD

Transformer models and BERT model: Overview

New transformer architecture can make language models faster and resource-efficient