Higuchi Yuki

Abstract This report presents regression discontinuity design (RDD) as a powerful analytical tool for use in applied linguistics showcased through our study of the impact of Japanese government study-abroad (SA) scholarships. RDD enables the estimation of causal effects in scenarios where a true experiment is not feasible by exploiting a naturally occurring cutoff point for treatment assignment. Because RDD may be novel to most readers in applied linguistics, this report provides a detailed step-by-step explanation of the standard RDD procedures our study exemplifies. The results section is crafted to reflect the conventional presentation style of RDD findings. Furthermore, the report’s concluding segment suggests scenarios within SA-related language learning research that could benefit from RDD application by enhancing the nuanced and precise interpretation of data in applied linguistics contexts.

Abstract There has long been interest in the effect of stay abroad on pragmatic development in second language (L2) pragmatics research. However, few testing instruments exist to assess pragmatics learning in stay abroad and provide information about learners’ development to help institutions evaluate the success of stay abroad programs. In this study, we describe the adaptation and validation of Roever’s (2005) test of second language routine formulae to be used large-scale with Japanese stay-abroad learners. We follow Kane’s (2006) argument-based approach to validation, evaluating the first four inferences: Domain description, Evaluation, Generalization, and Explanation. We also investigate the test’s practicality within the institutional setting of intended use. We find evidence supporting the use of the test for providing information on pragmatics learning during stay abroad. The test can differentiate between low- and high-ability learners, shows adequate reliability, and reflects the roles of proficiency and exposure in pragmatics learning in stay abroad contexts. The test is also practical and requires few resources. Further steps, such as the investigation of the Extrapolation and Decision inference, are discussed.

We conducted a randomized experiment targeting 322 Japanese high school students to examine the impacts of a newly developed English-language learning program. The treated students were offered an opportunity to communicate for 25 minutes with English-speaking Filipino teachers via Skype several times a week over a 5-month period as an extracurricular activity. The results show that the Skype program increased the interest of the treated students in an international vocation and in foreign affairs. However, the students did not improve their English communication abilities, as measured by standardized tests, probably because of the program's low utilization rate. Further investigation showed that the utilization rate was particularly low among students demonstrating a tendency to procrastinate. These results suggest the importance of maintaining students’ motivation to keep using such information and communication technology-assisted learning programs if they are not already incorporated into the existing curriculum. Having procrastinators self-regulate may be especially crucial.