Introducing ABENA: BERT Natural Language Processing for Twi

By Medium - 2020-10-23

Description

Transformer Language Modeling for Akuapem and Asante Twi

Summary

BERT Natural Language Processing for Twi Introduction In our previous blog post we introduced a preliminary Twi embedding model based on fastText and visualized it using the Tensorflow Embedding Projector.
It is typically trained with a “fill-in-the-blanks” objective which is very practical to implement and does not require labeled data — just randomly drop some words and try to predict them.
ABENA Twi BERT Models The first thing we do is initialize a BERT architecture and tokenizer to the multilingual BERT (mBERT) checkpoint.
Description of all the models we trained and shared in this work.

Topics

NLP (0.27)
Backend (0.12)
Machine_Learning (0.1)

Similar Articles

Google trained a trillion-parameter AI language model

By VentureBeat - 2021-01-12

Researchers at Google claim to have trained a natural language model containing over a trillion parameters.

7 models on HuggingFace you probably didn’t know existed

By Medium - 2021-02-19

HugginFace has been on top of every NLP(Natural Language Processing) practitioners mind with their transformers and datasets libraries. In 2020, we saw some major upgrades in both these libraries…

FastFormers: 233x Faster Transformers inference on CPU

By Medium - 2020-11-04

Since the birth of BERT followed by that of Transformers have dominated NLP in nearly every language-related tasks whether it is Question-Answering, Sentiment Analysis, Text classification or Text…

Key Concepts for Deploying Machine Learning Models to Mobile

By Spell - 2020-12-02

In this guest article from Fritz AI, we'll be outlining the key considerations in building a mobile-focused ML pipeline from end-to-end.

So, your stakeholders want an interpretable Machine Learning model?

By Medium - 2020-11-05

Here is what you tell them.

Interpretability, Explainability, and Machine Learning – What Data Scientists Need to Know

By KDnuggets - 2020-11-04

The terms “interpretability,” “explainability” and “black box” are tossed about a lot in the context of machine learning, but what do they really mean, and why do they matter?