In this workshop, we will dive into the transformers neural network architecture which is very powerful in image processing. We will review the attention is all you need paper and deep dive into the concepts and intuition. We will understand how the transformer are constructed and how they are used for processing images such as classification. We will conduct a very simple example using PyTorch with transformer.