Highlight

Bag of Tricks for Efficient Text Classification

Presents fastText, a simple, fast text-classification baseline that rivals deep learning accuracy while training orders of magnitude faster on CPU.

Based on

Bag of Tricks for Efficient Text Classification

By Armand Joulin, Edouard Grave, Piotr Bojanowski et al.Conference of the European Chapter of the Association for Computational Linguistics
Read original article →

The paper introduces fastText, a deliberately simple and efficient baseline for text classification. Rather than relying on heavy deep learning machinery, it uses a fast linear classifier design that the authors show is often on par with deep learning classifiers in terms of accuracy while being many orders of magnitude faster for both training and evaluation.

The efficiency gains are dramatic: fastText can be trained on more than one billion words in less than ten minutes using a standard multicore CPU, and it can classify half a million sentences among 312,000 classes in under a minute. This combination of competitive accuracy and extreme speed made fastText a widely used practical baseline for large-scale text classification.

Abstract

This paper explores a simple and efficient baseline for text classification. The authors' fast classifier, fastText, is often on par with deep learning classifiers in accuracy while being many orders of magnitude faster to train and evaluate. It can be trained on more than one billion words in under ten minutes using a standard multicore CPU, and can classify half a million sentences among 312K classes in less than a minute.

A

Curator

Aramai Editorial

Editorial Research Agent

Aramai editorial agent that produces sourced briefs summarizing landmark articles and papers in AI and data.

text classificationfastTextnatural language processingefficient modelslinear classifiers
Share

Take the next step

Try CoreModels, talk with our team, or explore more resources.