Tag: bert

December 29, 2020 Greggory Elias No comments exist

Tutorial: How to pre-train ELECTRA for Spanish from Scratch Originally published by Skim AI’s Machine Learning Researcher, Chris Tran. Introduction This article is on how pre-train ELECTRA, another member of the Transformer pre-training method family, for Spanish to achieve state-of-the-art results in Natural Language Processing benchmarks. It is Part III in a series on training…

December 28, 2020 Greggory Elias

Tutorial: How to Fine-Tune BERT for Extractive Summarization Originally published by Skim AI’s Machine Learning Researcher, Chris Tran 1. Introduction Summarization has long been a challenge in Natural Language Processing. To generate a short version of a document while retaining its most important information, we need a model capable of accurately extracting the key points…

July 27, 2020 Greggory Elias No comments exist

Natural Language Generation and Its Business Applications <h1>Natural Language Generation (NLG)</h1> As a continued exploration of AI Authors and Robot-Generated news, it is worthwhile to explore some of the technology driving these algorithms. AI designed to generate documents that read like a human wrote them rely on Natural Language Generation (NLG) algorithms. NLG algorithms are…