Vocabulary Learning and Instruction

Koizumi

Relationships Between Text Length and Lexical Diversity Measures: Can We Use Short Texts of Less than 100 Tokens? (article pdf)

Rie Koizumi
Tokiwa University
doi: http://dx.doi.org/10.7820/vli.v01.1.koizumi

Abstract
Lexical diversity (LD) measures have been known to be sensitive to the length of the text, and numerous revised LD measures have been proposed. This study aims to identify LD measures that are least affected by text length and can be used for the analysis of short L2 texts (50-200 tokens). This study compares the type-token ratio, Guiraud index, D, and measure of textual lexical diversity (MTLD) to assess their degree of susceptibility to text length. Spoken texts of 200 tokens from 20 L2 English learners at the lower-intermediate-level were divided into segments of 50 to 200 tokens and the text length impact was examined. It was found that MTLD was least affected by text length, and that it should be used with texts of at least 100 tokens.

Keywords: lexical diversity; text length; type-token ratio; Guiraud index; D; measure of textual lexical diversity (MTLD); speaking performance.

Vocabulary Learning and Instruction

Volume 1, Number 1, August 2012
doi: http://dx.doi.org/10.7820/vli.v01.1.2187-2759

full issue pdf

About Us | Contact Us | ©2011 VOCABULARY LEARNING AND INSTRUCTION