A New Metric to Quantify Repeated Compiler Errors for Novice Programmers

Files in This Item:
File Description SizeFormat 
ITiCSE-Becker-Preprint.pdf257.72 kBAdobe PDFDownload
Title: A New Metric to Quantify Repeated Compiler Errors for Novice Programmers
Authors: Becker, Brett A.
Permanent link: http://hdl.handle.net/10197/7888
Date: 13-Jul-2016
Abstract: Encountering the same compiler error repeatedly, particularly several times consecutively, has been cited as a strong indicator that a student is struggling with important programming concepts. Despite this, there are relatively few studies which investigate repeated errors in isolation or in much depth. There are also few data-driven metrics for measuring programming performance, and fewer for measuring repeated errors. This paper makes two contributions. First we introduce a new metric to quantify repeated errors, the repeated error density (RED). We compare this to Jadud's Error Quotient (EQ), the most studied metric, and show that RED has advantages over EQ including being less context dependent, and being useful for short sessions. This allows us to answer two questions posited by Jadud in 2006 that have until now been unanswered. Second, we compare the EQ and RED scores using data from an empirical control/intervention group study involving an editor which enhances compiler error messages. This intervention group has been previously shown to have a reduced overall number of student errors, number of errors per student, and number of repeated student errors per compiler error message. In this research we find a reduction in EQ, providing further evidence that error message enhancement has positive effects. In addition we find a significant reduction in RED providing evidence that this metric is valid.
Type of material: Conference Publication
Publisher: ACM
Copyright (published version): 2016 ACM
Keywords: Java;EQ;CS1;Debugging;Errors;Syntax errors;Error messages;Compiler errors;Repeated errors;Consecutive errors;Error quotient;Feedback;Novice;Programming
DOI: 10.1145/2899415.2899463
Language: en
Status of Item: Peer reviewed
Is part of: ITiCSE Proceedings of the 2016 ACM Conference on Innovation and Technology in Computer Science Education, Arequipa, Peru, 11-13 July 2016
Conference Details: 21st Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE), Arequipa, Peru, 11-13 July 2016
Appears in Collections:Computer Science Research Collection

Show full item record

SCOPUSTM   
Citations 50

8
Last Week
0
Last month
checked on Jun 22, 2018

Google ScholarTM

Check

Altmetric


This item is available under the Attribution-NonCommercial-NoDerivs 3.0 Ireland. No item may be reproduced for commercial purposes. For other possible restrictions on use please refer to the publisher's URL where this is made available, or to notes contained in the item itself. Other terms may apply.