December 29, 2020
Greggory Elias
No comments exist
Tutorial: How to pre-train ELECTRA for Spanish from Scratch Originally published by Skim AI’s Machine Learning Researcher, Chris Tran. Introduction This article is on how pre-train ELECTRA, another member of the Transformer pre-training method family, for Spanish to achieve state-of-the-art results in Natural Language Processing benchmarks. It is Part III in a series on training…
December 28, 2020
Greggory Elias
No comments exist
Tutorial: How to Fine-tune BERT for NER Originally published by Skim AI’s Machine Learning Researcher, Chris Tran. Introduction This article is on how to fine-tune BERT for Named Entity Recognition (NER). Specifically, how to train a BERT variation, SpanBERTa, for NER. It is Part II of III in a series on training custom BERT Language…
December 28, 2020
Greggory Elias
Tutorial: How to Fine-Tune BERT for Extractive Summarization Originally published by Skim AI’s Machine Learning Researcher, Chris Tran 1. Introduction Summarization has long been a challenge in Natural Language Processing. To generate a short version of a document while retaining its most important information, we need a model capable of accurately extracting the key points…
December 11, 2020
Greggory Elias
8 Ways News & Content Companies use A.I. to Save Money and Improve UX The best way to understand the impact of technology is to understand the specifics, examples of how to actually apply technology to solve current problems. The following are 8 common AI Solutions our clients in Newspapers, Magazines, Content and Digital Media…
July 27, 2020
Greggory Elias
No comments exist
Natural Language Generation and Its Business Applications Natural Language Generation (NLG) As a continued exploration of AI Authors and Robot-Generated news, it is worthwhile to explore some of the technology driving these algorithms. AI designed to generate documents that read like a human wrote them rely on Natural Language Generation (NLG) algorithms. NLG algorithms are…
April 29, 2020
Greggory Elias
SpanBERTa: How We Trained RoBERTa Language Model for Spanish from Scratch Originally published by Skim AI’s Machine Learning Research Intern, Chris Tran. spanberta_pretraining_bert_from_scratch Introduction¶ Self-training methods with transformer models have achieved state-of-the-art performance on most NLP tasks. However, because training them is computationally expensive, most currently available pretrained transformer models are only for English. Therefore,…
April 15, 2020
Greggory Elias
No comments exist
Tutorial: Fine tuning BERT for Sentiment Analysis Originally published by Skim AI’s Machine Learning Researcher, Chris Tran. BERT_for_Sentiment_Analysis A – Introduction¶ In recent years the NLP community has seen many breakthoughs in Natural Language Processing, especially the shift to transfer learning. Models like ELMo, fast.ai’s ULMFiT, Transformer and OpenAI’s GPT have allowed researchers to achieves…
March 20, 2020
Greggory Elias
10 Questions to Ask Before Starting a Machine Learning Project Over 80% of data science projects fail to go beyond testing and into production. If everyone is starting a machine learning project, where is it going wrong? Undoubtedly, ML solutions increase efficiencies for those who are in the business of gathering or analyzing large swaths…
December 5, 2019
Greggory Elias
Topic Modeling for Product Managers What is Topic Modeling? Topic modeling is a type of natural language processing (NLP) used to find “topics,” or commonly occurring words or groups of words, within a set of documents. Topic models are critical to product managers because they enable them to sort and analyze the huge amounts of…
November 6, 2019
Greggory Elias
Every sentiment model requires training data, referred to as a sentiment analysis dataset. There are a few things you should know before you make your decision as to which popular dataset to use.