Validation of a web-based test of ESL pragmalinguistics

Roever, Carsten
April 2006
Language Testing;Apr2006, Vol. 23 Issue 2, p229
Academic Journal
Despite increasing interest in interlanguage pragmatics research, research on assessment of this crucial area of second language competence still lags behind assessment of other aspects of learners' developing second language (L2) competence. This study describes the development and validation of a 36-item web-based test of ESL pragmalinguistics, measuring learners' offline knowledge of implicatures and routines with multiple-choice questions, and their knowledge of speech acts with discourse completion tests. The test was delivered online to 267 ESL and EFL learners, ranging in proficiency from beginner to advanced. Evidence for construct validity was collected through correlational analyses and comparisons between groups. The effect of browser familiarity was found to be negligible, and learners generally performed as previous research would suggest: their knowledge of speech acts increased with proficiency, as did their knowledge of implicature. Their knowledge of routines, however, was strongly dependent on L2 exposure. Correlations between the sections and factor analysis confirmed that the routines, implicatures, and speech act sections are related but that each has some unique variance. The test was sufficiently reliable and practical, taking an hour to administer and little time to score. Limitations and future research directions are discussed.


Related Articles

  • Interlanguage Pragmatics Theory and Its Implications for Foreign Language. Qian Huang // Journal of Language Teaching & Research;Sep2010, Vol. 1 Issue 5, p682 

    The major purpose of college English teaching is to cultivate and develop student's pragmatic competence. Interlanguage pragmatics is a new interdisciplinary branch of study based on the theories of pragmatics and second language acquisition which has direct guide significance for foreign...

  • An Account of Sources of Errors in Language Learners' Interlanguage. Shekhzadeh, Ebrahim; Gheichi, Majid // International Proceedings of Economics Development & Research;2011, Vol. 26, p159 

    EFL learners' errors are a major area of study in the field of contrastive linguistics and SLA research. In this article, a roughly representative account of the significance and importance of errors has been provided. Various volumes by specialists in applied linguistics, language teaching, and...

  • INTERNATIONAL STUDENTS IN AMERICAN UNIVERSITIES: AN INTERLANGUAGE/INTERCULTURE ANALYSIS. Naiditch, Fernando // American Journal of Educational Studies;2010, Vol. 3 Issue 1, p13 

    This study follows a group of Brazilian English as a second language (ESL) learners pursuing a degree in American universities as they negotiate their relationships with professors and as they develop an understanding of the social, cultural and educational rules that apply in the context of...

  • Interlanguage-based Error Analysis in Higher Vocational and Technological College EFL Education in China. Xiongyong Cheng // Journal of Language Teaching & Research;May2015, Vol. 6 Issue 3, p639 

    The previous traditional second language (L2) acquisition research was lacking of systematic theoretical guidance as regards error analysis and research. Interlanguage firstly provides a reliable theoretical basis, which refers to the entirety of L2 output as a reference context to analyze...

  • The Role of Narrative Structure in the Acquisition of English Tense-Aspect Morphology by Thai Learners. Chiravate, Boonjeera // Journal of Pan-Pacific Association of Applied Linguistics;2011, Vol. 15 Issue 2, p27 

    As regards the acquisition of L2 verbal morphology, one of the universal tendencies as elucidated by the Interlanguage Discourse Hypothesis (Bardovi-Harlig, 1994, p.43) is that language learners use emerging verbal morphology to distinguish foreground and background in narratives. This present...

  • Developing pragmatic fluency in an EFL context. Barón, Júlia; Celaya, M. Luz // EUROSLA Yearbook;2010, Vol. 10, p38 

    Studies on pragmatic development, especially on the development of pragmatic fluency, are still scarce in the area of Interlanguage Pragmatics. The present study analyses whether EFL learners (N = 144), from Primary to University levels, who have not been instructed in pragmatics nevertheless...

  • An Investigation of Iranian EFL learners' Use of Politeness Strategies and Power Relations in Disagreement across Different Proficiency Levels. Behnam, Biook; Niroomand, Masoumeh // English Language Teaching;Dec2011, Vol. 4 Issue 4, p204 

    The speech act of disagreement has been one of the speech acts that receives the least attention in the field of pragmatics. This study investigates the ways power relations influence politeness strategies in disagreement. In order to determine whether and to what extent the realization of the...

  • The Nature of Pragmatic and Discourse Transfer in Compliment Responses in Cross-Cultural Interaction. Tran, Giao Quynh // Linguistics Journal;Dec2007, Vol. 2 Issue 3, p167 

    For decades, the first linguistic and cultural influence on second language performance (technically known as pragmatic and discourse transfer) in cross-cultural interaction has fascinated researchers. The originality of this study rests upon the facts that it is based on an innovative...

  • When the Research Design Matters in EFL Context: A Case of Different Responses to Open-response and Closed-response Questions on Motivational Orientation. Naeini, Ma'ssoumeh Bemani // International Journal of Applied Linguistics & English Literatur;Nov2012, Vol. 1 Issue 6, p264 

    This study aimed at investigating and exploring the degree of motivational orientation (i.e. instrumental and integrative motivation) among sixty Iranian TEFL students. A survey research design was used to collect both quantitative and qualitative data, using a Likert-scale questionnaire...


Read the Article


Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics