[PyTorch] BERT Architecture Implementation Note
Last Updated on 2024-09-07 by Clay
Introduction
My advisor used to tell me, “Don't just use other people's libraries; you have to write your own to truly understand.” Back then, I didn’t have much time to implement various technologies I was interested in since I was fully occupied with my dissertation. However, I often recall his earnest advice even now, and it prompted me to finally attempt the implementation of BERT, a classic encoder-only transformer model.
Read More »[PyTorch] BERT Architecture Implementation Note