huggingface/datasets

By GitHub - 2021-01-05

Description

🤗 The largest hub of ready-to-use NLP datasets for ML models with fast, easy-to-use and efficient data manipulation tools - huggingface/datasets

Summary

README.md 🤗Datasets is a lightweight library providing two main features: With a simple command like squad_dataset = load_datasets("squad"), get any of these datasets ready to use in a dataloader for training/evaluating a ML model (Numpy/Pandas/PyTorch/TensorFlow/JAX), efficient data pre-processing: This gives access to the pair of a benchmark dataset and a benchmark metric for instance for benchmarks like SQuAD or GLUE.
Dataset but a built-in framework-agnostic dataset class with methods inspired by what we like in tf.data (like a map() method).

Topics

Backend (0.31)
Database (0.18)
Frontend (0.1)

Similar Articles

asahi417/tner

By GitHub - 2021-03-03

Language model finetuning on NER with an easy interface, and cross-domain evaluation. We released NER models finetuned on various domain via huggingface model hub. - asahi417/tner

9 Best Places To Find Machine Learning Datasets

By Medium - 2021-02-08

Best Places To Find Machine Learning, Data Science and Data Visualization Datasets. We will explore all places where you can find datasets of high quality.

10 Interesting Machine Learning Dataset Projects For Beginners

By Medium - 2020-09-28

Finding machine learning datasets is tenacious indeed, but it doesn’t have to be! In this article, we’ve shared multiple datasets you can…

Datasets should behave like git repositories

By DAGsHub Blog - 2021-01-18

Create, maintain, and contribute to a long-living dataset that will update itself automatically across projects, using git and DVC as versioning systems.

What Is the Best Input Pipeline to Train Image Classification Models with tf.keras

By Medium - 2021-02-04

When we start learning how to build deep neural networks with Keras, the first method we use to input data is simply loading it into NumPy arrays. At some point, especially when working with images…

Getting Started with 5 Essential Natural Language Processing Libraries

By KDnuggets - 2021-03-13

This article is an overview of how to get started with 5 popular Python NLP libraries, from those for linguistic data visualization, to data preprocessing, to multi-task functionality, to state of the ...