December 28, 2020
Greggory Elias
Tutorial: How to Fine-Tune BERT for Extractive Summarization Originally published by Skim AI’s Machine Learning Researcher, Chris Tran 1. Introduction Summarization has long been a challenge in Natural Language Processing. To generate a short version of a document while retaining its most important information, we need a model capable of accurately extracting the key points…
April 29, 2020
Greggory Elias
SpanBERTa: How We Trained RoBERTa Language Model for Spanish from Scratch Originally published by Skim AI’s Machine Learning Research Intern, Chris Tran. spanberta_pretraining_bert_from_scratch Introduction¶ Self-training methods with transformer models have achieved state-of-the-art performance on most NLP tasks. However, because training them is computationally expensive, most currently available pretrained transformer models are only for English. Therefore,…
April 15, 2020
Greggory Elias
No comments exist
Tutorial: Fine tuning BERT for Sentiment Analysis Originally published by Skim AI’s Machine Learning Researcher, Chris Tran. BERT_for_Sentiment_Analysis A – Introduction¶ In recent years the NLP community has seen many breakthoughs in Natural Language Processing, especially the shift to transfer learning. Models like ELMo, fast.ai’s ULMFiT, Transformer and OpenAI’s GPT have allowed researchers to achieves…