English Receptive-Skills Assessment in Vocational High Schools: Developing a Test Item Bank
Kata Kunci:
Assessment Validity, English Receptive Skills, Item Bank Development, Vocational High SchoolAbstrak
Assessment of English receptive skills plays a crucial role in vocational high schools, as reading and listening competence underpins students’ ability to comprehend functional texts relevant to academic and workplace contexts. However, preliminary analysis revealed that existing assessment instruments did not adequately represent syllabus content, lacked listening components, and had not undergone empirical validation. This study aimed to develop a valid and reliable English receptive-skills test item bank aligned with curriculum demands. Employing a Research and Development design, the study integrated the Define–Design–Develop model with systematic procedures of syllabus analysis, item construction, expert validation, revision, and field trials. Data were collected through document analysis, expert judgment, and students’ test results, and analyzed using content validity evaluation, KR-21 reliability estimation, and item difficulty indices. The findings indicate that the developed item bank comprehensively covers syllabus indicators, integrates reading and listening skills, and demonstrates acceptable to high reliability, with most items falling within the medium difficulty range. These results confirm that systematic development and empirical testing significantly enhance assessment quality. In conclusion, the test item bank is suitable for use in semester examinations to ensure fair, accurate, and curriculum-based evaluation. It is recommended that schools institutionalize item banking practices and conduct regular item analysis, while future studies may expand assessment development to productive language skills.Referensi
Arikunto, S. (2021). Dasar-dasar evaluasi pendidikan edisi 3. Bumi Aksara.
Bennett, M. J. (2017). Developmental Model of Intercultural Sensitivity. In The International Encyclopedia of Intercultural Communication (pp. 1–10). https://doi.org/https://doi.org/10.1002/9781118783665.ieicc0182
Bhoki, M. I. (2025). Peran Kepala Sekolah dalam Mengoptimalkan Kemampuan Guru untuk Mengembangkan Tujuan Pembelajaran Berdasarkan Kebutuhan Siswa di SMPN 2 Golewa kolektif melalui strategi kepemimpinan yang efektif . Kepala sekolah di SMPN 2 Golewa ,. Jurnal Sadewa: Publikasi Ilmu Pendidikan, Pembelajaran Dan Ilmu Sosial, 3(1), 211–240. https://doi.org/10.61132/sadewa.v3i1.1511
Byram, M., Holmes, P., & Savvides, N. (2013). Intercultural Communicative Competence in Foreign Language Education: Questions of Theory, Practice and Research. Language Learning Journal, 41(3), 251–253. https://doi.org/10.1080/09571736.2013.836343
Cheong, H., Lyons, A., Houghton, R., & Majumdar, A. (2023). Secondary Qualitative Research Methodology Using Online Data within the Context of Social Sciences. International Journal of Qualitative Methods, 22, 16094069231180160. https://doi.org/10.1177/16094069231180160
Chung, E., & Wan, A. (2025). Examining the use of academic vocabulary in first-year ESL undergraduates’ writing: A corpus-driven study in Hong Kong. Assessing Writing, 63, 100913. https://doi.org/https://doi.org/10.1016/j.asw.2024.100913
Cummins, James. (1979). Linguistic Interdependence and the Educational Development of Bilingual Children. Review of Educational Research, 49(2), 222–251. https://doi.org/10.3102/00346543049002222
Gall, M. D., Gall, J. P., & Borg, W. R. (2007). Educational Research: An Introduction. Pearson/Allyn & Bacon. https://books.google.co.id/books?id=l9JfQgAACAAJ
Golzar, J., Yacoub, O., & McKinley, J. (2024). E-learning successes with English language teachers in under-resourced non-WEIRD contexts. International Journal of Applied Linguistics, 34(3), 1159–1182. https://doi.org/https://doi.org/10.1111/ijal.12557
Hartell, E., & Buckley, J. (2021). Comparative Judgment: An Overview BT - Handbook for Online Learning Contexts: Digital, Mobile and Open: Policy and Practice (A. Marcus-Quinn & T. Hourigan (eds.); pp. 289–307). Springer International Publishing. https://doi.org/10.1007/978-3-030-67349-9_20
Herwin, & Nurhayati, R. (2021). Measuring students’ curiosity character using confirmatory factor analysis. European Journal of Educational Research, 10(2), 773–783. https://doi.org/10.12973/EU-JER.10.2.773
Hollister, B., Nair, P., Hill-Lindsay, S., & Chukoskie, L. (2022). Engagement in Online Learning: Student Attitudes and Behavior During COVID-19. Frontiers in Education, 7(May). https://doi.org/10.3389/feduc.2022.851019
Hutchins, T. L., Knox, S. E., & Fletcher, E. C. (2024). Natural language acquisition and gestalt language processing: A critical analysis of their application to autism and speech language therapy(). Autism & Developmental Language Impairments, 9, 23969415241249944. https://doi.org/10.1177/23969415241249944
Leung, C. H., & Cheng, S. C. L. (2019). An Empirical Study on Integration of Experiential Learning and Mobile Learning. Asian Journal of Empirical Research, 9(4), 88–98. https://doi.org/10.18488/journal.1007/2019.9.4/1007.4.88.98
Liu, C., & Chen, M. (2022). A genre-based approach in the secondary school English writing class: Voices from student-teachers in the teaching practicum. Frontiers in Psychology, Volume 13-2022. https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2022.992360
Mustaqim, M. A., Almarzuqi, M. F., & Sibilana, A. R. (2021). Education in Psychomotoric Aspect and Creative Development BT - Proceedings of the International Conference on Engineering, Technology and Social Science (ICONETOS 2020). 636–645. https://doi.org/10.2991/assehr.k.210421.093
Rodríguez-Fuentes, R. A., & Swatek, A. M. (2022). Exploring the effect of corpus-informed and conventional homework materials on fostering EFL students’ grammatical construction learning. System, 104, 102676. https://doi.org/https://doi.org/10.1016/j.system.2021.102676
Roebianto, A., Savitri, I., Sriyanto, A., Syaiful, I., & Mubarokah, L. (2023). Content Validity: Definition and Procedure of Content Validation in Psychological Research. TPM - Testing, 30, 5–18. https://doi.org/10.4473/TPM30.1.1
Romadin, A., Nuhadi, D., & Yoto, Y. (2022). Implementation of Work Based Learning on Welding Engineering Expertise Competency in The Manufacturing Industry. Journal of Vocational Education Studies, 5(1), 16–31. https://doi.org/10.12928/joves.v5i1.5674
Sangsawang, T. (2015). Instructional Design Framework for Educational Media. Procedia - Social and Behavioral Sciences, 176, 65–80. https://doi.org/https://doi.org/10.1016/j.sbspro.2015.01.445
Sato, T. (2022). Assessing Critical Thinking through L2 Argumentative Essays: An Investigation of Relevant and Salient Criteria from Raters’ Perspectives. Language Testing in Asia, 12(1), 9. https://doi.org/10.1186/s40468-022-00159-4
Schulze, R. (2004). Meta-analysis: A comparison of approaches. In Meta-analysis: A comparison of approaches. Hogrefe & Huber Publishers.
Shoda, V. P., & Yamanaka, T. (2022). A Study on Instructional Humor: How Much Humor Is Used in Presentations? In Behavioral Sciences (Vol. 12, Issue 1). https://doi.org/10.3390/bs12010007
Siregar, L. K., Mayuni, I., & Rahmawati, Y. (2023). Culturally responsive English teaching: Developing a model for primary school EFL teachers in Indonesia. Issues in Educational Research, 33(4), 1582–1600.
Sugiyono, S. (2017). Metode Penelitian Kuantitatif, Kualitatif, dan R&D. Alfabeta.
Sun, W., & Park, E. (2023). EFL Learners’ Collocation Acquisition and Learning in Corpus-Based Instruction: A Systematic Review. In Sustainability (Vol. 15, Issue 17). https://doi.org/10.3390/su151713242
Taye, T., & Mengesha, M. (2024). Identifying and Analyzing Common English Writing Challenges among Regular Undergraduate Students. Heliyon, 10(17). https://doi.org/https://doi.org/10.1016/j.heliyon.2024.e36876
Toba, R., Noor, W. N., & Sanu, L. O. (2019). The Current Issues of Indonesian EFL Students’ Writing Skills: Ability, Problem, and Reason in Writing Comparison and Contrast Essay. Dinamika Ilmu, 19(1), 57–73. https://doi.org/10.21093/di.v19i1.1506
Wardhana, Y. Y., & Muhammad, R. N. (2021). An Investigation of Video and Audio to Improve Students’ Motivation in Learning Listening during Online Learning at Ban Pongneeb School, Thailand. Journal of English Teaching, Literature, and Applied Linguistics, 5(1), 20–27.
Widiyanti, R. (2024). Evaluation of the Implementation of Field Work Practices Using the CIPP Model. Sinergi International Journal of Education, 2(1), 1–11. https://doi.org/10.61194/education.v2i1.122
Widyastuti, R., & Utami, I. S. (2018). Development of Product-Based Job Sheet as Instructional Media in Vocational Education. Journal of Educational Science and Technology (EST); Volume 4 Number 2 August 2018DO - 10.26858/Est.V4i2.6064 . https://ojs.unm.ac.id/JEST/article/view/6064
Zhang, T., & Zhang, L. J. (2021). Taking Stock of a Genre-Based Pedagogy: Sustaining the Development of EFL Students’ Knowledge of the Elements in Argumentation and Writing Improvement. In Sustainability (Vol. 13, Issue 21, p. 11616). https://doi.org/10.3390/su132111616
