BERT Authors: Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova Publication Date: May 24, 2019 Published In: arXiv Number of Citations: Highly cited (exact number varies) Link to Paper: arXiv.org/attention Table of Contents Brief Description Main Topic Key Concepts 1. Bidirectional Transformers 2. Masked …

Read More

Attention is All You Need Authors: Ashish Vaswani, Noam Shazeer, Niki Parmar et al. Publication Date: June 2017 Published In: NeurIPS 2017 Number of Citations: 80,000+ Link to Paper: arXiv.org/attention Table of Contents Brief Description Main Topic Key Concepts 1. Self-Attention Mechanism 2. Multi-Head Attention 3. …

Read More