Performance analysis of GAME: A generic automated marking environment

Blumenstein, Michael, Green, Steve, Fogelman, Shoshana, Nguyen, Ann and Muthukkumarasamy, Vallipuram (2008) Performance analysis of GAME: A generic automated marking environment. Computers & Education, 50 4: 1203-1216. doi:10.1016/j.compedu.2006.11.006


Author Blumenstein, Michael
Green, Steve
Fogelman, Shoshana
Nguyen, Ann
Muthukkumarasamy, Vallipuram
Title Performance analysis of GAME: A generic automated marking environment
Journal name Computers & Education   Check publisher's open access policy
ISSN 0360-1315
Publication date 2008-01-01
Sub-type Article (original research)
DOI 10.1016/j.compedu.2006.11.006
Open Access Status DOI
Volume 50
Issue 4
Start page 1203
End page 1216
Total pages 14
Place of publication Oxford; New York
Publisher Pergamon
Language eng
Subject 13 Education
1399 Other Education
Abstract This paper describes the Generic Automated Marking Environment (GAME) and provides a detailed analysis of its performance in assessing student programming projects and exercises. GAME has been designed to automatically assess programming assignments written in a variety of languages based on the “structure” of the source code and the correctness of the program’s output. Currently, the system is able to mark programs written in Java, C++ and the C language. To use the system, instructors are required to provide a simple “marking schema” for each given assessment item, which includes pertinent information such as the location of files and the model solution. In this research, GAME has been tested on a number of student programming exercises and assignments and its performance has been compared against that of a human marker. An in-depth statistical analysis of the comparison is presented, providing encouraging results and directions for employing GAME as a tool for teaching and learning.
Keyword Architectures for educational technology system
Post-secondary education
Programming and programming languages
Teaching/learning strategies
Q-Index Code C1
Q-Index Status Provisional Code

Document type: Journal Article
Sub-type: Article (original research)
Collections: Excellence in Research Australia (ERA) - Collection
Advanced Water Management Centre Publications
 
Versions
Version Filter Type
Citation counts: TR Web of Science Citation Count  Cited 4 times in Thomson Reuters Web of Science Article | Citations
Scopus Citation Count Cited 6 times in Scopus Article | Citations
Google Scholar Search Google Scholar
Created: Thu, 04 Feb 2010, 18:59:41 EST by Ms May Balasaize on behalf of Faculty Of Engineering, Architecture & Info Tech