Understanding the Capabilities, Limitations, and Societal Impact of Large Language Models

By Velasticity Newsletter - 2021-02-05

Description

On October 14th, 2020, researchers from OpenAI, the Stanford Institute for Human-Centered Artificial Intelligence, and other universities convened to discuss open research questions surrounding GPT-3,

Summary

By arXiv.org Understanding the Capabilities, Limitations, and Societal Impact of Large Language Models Abstract: On October 14th, 2020, researchers from OpenAI, the Stanford Institute for Human-Centered Artificial Intelligence, and other universities convened to discuss open research questions surrounding GPT-3, the largest publicly-disclosed dense language model at the time.
The meeting took place under Chatham House Rules.
1) What are the technical capabilities and limitations of large language models?

Topics

NLP (0.35)
Machine_Learning (0.06)
UX (0.02)

Similar Articles

Google trained a trillion-parameter AI language model

By VentureBeat - 2021-01-12

Researchers at Google claim to have trained a natural language model containing over a trillion parameters.

Robo-writers: the rise and risks of language-generating AI

By nature - 2021-03-03

A remarkable AI can write like humans — but with no understanding of what it’s saying.

Vokenization: Improving Language Understanding with Contextualized, Visual-Grounded Supervision

By arXiv.org - 2020-10-15

Humans learn language by listening, speaking, writing, reading, and also, via interaction with the multimodal real world. Existing language pre-training frameworks show the effectiveness of text-only ...

Introducing ABENA: BERT Natural Language Processing for Twi

By Medium - 2020-10-23

Transformer Language Modeling for Akuapem and Asante Twi

ML and NLP starter toolkit, Low-resource NLP toolkit, "Can a LM understand natural language?", The next generation of NLP benchmarks

By ruder - 2020-10-13

Hi all,It has been a while... I hope you're doing well in these crazy and strange times.COVID-19 has affected each of us in unpredictable ways 😷. I'm fortunate to be healthy but my energy has been low ...

ML and NLP Research Highlights of 2020

By Sebastian Ruder - 2021-01-19

This post summarizes progress in 10 exciting and impactful directions in ML and NLP in 2020.