Tag: tranformer

December 29, 2020 Greggory Elias No comments exist

Tutorial: How to pre-train ELECTRA for Spanish from Scratch Originally published by Skim AI’s Machine Learning Researcher, Chris Tran. Introduction This article is on how pre-train ELECTRA, another member of the Transformer pre-training method family, for Spanish to achieve state-of-the-art results in Natural Language Processing benchmarks. It is Part III in a series on training…