2021
Extraction-Based MRC
October 13, 2021Extraction-based machine reading comprehension: span prediction with BERT, preprocessing, fine-tuning, and post-processing.
1 min read·naver-boostcampRecent NLP Models
October 13, 2021Survey of post-BERT NLP models including XLNet, RoBERTa, BART, T5, Meena, and controllable language models like PPLM.
3 min read·nlpGPT Language Models
October 12, 2021Evolution of GPT language models from GPT-1 to GPT-3: architecture changes, zero/few-shot learning, and scaling effects.
2 min read·nlpUnicode, Tokenization
October 12, 2021Basics of Unicode handling in Python and subword tokenization methods including BPE (Byte-Pair Encoding).
1 min read·nlppythonMRC
October 12, 2021Introduction to Machine Reading Comprehension covering dataset types, key challenges like coreference resolution and multi-hop reasoning, and evaluation metrics.
2 min read·nlpNaver Boostcamp AI Tech 2nd - Week 10 Report
October 8, 2021Week 10 of Naver Boostcamp AI Tech with a retrospective on the Relation Extraction competition.
1 min read·naver-boostcamp