Month: December 2020

December 29, 2020 Greggory Elias No comments exist

Tutorial: How to pre-train ELECTRA for Spanish from Scratch Originally published by Skim AI’s Machine Learning Researcher, Chris Tran. Introduction This article is on how pre-train ELECTRA, another member of the Transformer pre-training method family, for Spanish to achieve state-of-the-art results in Natural Language Processing benchmarks. It is Part III in a series on training…

December 28, 2020 Greggory Elias No comments exist

Tutorial: How to Fine-tune BERT for NER Originally published by Skim AI’s Machine Learning Researcher, Chris Tran. Introduction This article is on how to fine-tune BERT for Named Entity Recognition (NER). Specifically, how to train a BERT variation, SpanBERTa, for NER. It is Part II of III in a series on training custom BERT Language…

December 28, 2020 Greggory Elias

Tutorial: How to Fine-Tune BERT for Extractive Summarization Originally published by Skim AI’s Machine Learning Researcher, Chris Tran 1. Introduction Summarization has long been a challenge in Natural Language Processing. To generate a short version of a document while retaining its most important information, we need a model capable of accurately extracting the key points…

December 28, 2020 Greggory Elias No comments exist

Named Entity Recognition with Transformers IntroductionPermalink Part I: How We Trained RoBERTa Language Model for Spanish from Scratch In my previous blog post, we discussed how we pretrained SpanBERTa, a transformer language model for Spanish, on a big corpus from scratch. The model has shown to be able to predict correctly masked words in a…

December 11, 2020 Greggory Elias

8 Ways News & Content Companies use A.I. to Save Money and Improve UX The best way to understand the impact of technology is to understand the specifics, examples of how to actually apply technology to solve current problems. The following are 8 common AI Solutions our clients in Newspapers, Magazines, Content and Digital Media…

December 9, 2020 Greggory Elias

6 Problems AI is Good At Solving Over 85% of data science projects fail to go beyond testing and into production. If everyone is starting a Machine Learning / Artificial Intelligence project, where is it going wrong?      With this post it should help you to focus on the types of problems that AI…