Neural Networks & Deep Learning - Computer Assignment #5 - Fall 2022

University of Tehran

Q1: Implementing BERT from scratch
Papers:
- Attention Is All You Need!
- GAUSSIAN ERROR LINEAR UNITS (GELUS)
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Q2: Image Segmentation & Classification with BEIT
- BEIT: BERT Pre-Training of Image Transformers

Name		Name	Last commit message	Last commit date
Latest commit History 6 Commits
Q1		Q1
Q2		Q2
HW5-Description.pdf		HW5-Description.pdf
HW5-Report.pdf		HW5-Report.pdf
NNDL-HW5-Q1-transformer-BERT.ipynb		NNDL-HW5-Q1-transformer-BERT.ipynb
NNDL-HW5-Q1-transformer-TODO.ipynb		NNDL-HW5-Q1-transformer-TODO.ipynb
NNDL-HW5-Q2-BeitClassifier.ipynb		NNDL-HW5-Q2-BeitClassifier.ipynb
NNDL-HW5-Q2-BeitSegmentation.ipynb		NNDL-HW5-Q2-BeitSegmentation.ipynb
NNDL-HW5-Q2-MLPClassifier.ipynb		NNDL-HW5-Q2-MLPClassifier.ipynb
README.md		README.md