Repository logo
  • Log In
    New user? Click here to register.Have you forgotten your password?
University College Dublin
    Colleges & Schools
    Statistics
    All of DSpace
  • Log In
    New user? Click here to register.Have you forgotten your password?
  1. Home
  2. College of Science
  3. School of Computer Science
  4. Computer Science Research Collection
  5. A New Metric to Quantify Repeated Compiler Errors for Novice Programmers
 
  • Details
Options

A New Metric to Quantify Repeated Compiler Errors for Novice Programmers

Author(s)
Becker, Brett A.  
Uri
http://hdl.handle.net/10197/7888
Date Issued
2016-07-13
Date Available
2016-09-07T14:36:08Z
Abstract
Encountering the same compiler error repeatedly, particularly several times consecutively, has been cited as a strong indicator that a student is struggling with important programming concepts. Despite this, there are relatively few studies which investigate repeated errors in isolation or in much depth. There are also few data-driven metrics for measuring programming performance, and fewer for measuring repeated errors. This paper makes two contributions. First we introduce a new metric to quantify repeated errors, the repeated error density (RED). We compare this to Jadud's Error Quotient (EQ), the most studied metric, and show that RED has advantages over EQ including being less context dependent, and being useful for short sessions. This allows us to answer two questions posited by Jadud in 2006 that have until now been unanswered. Second, we compare the EQ and RED scores using data from an empirical control/intervention group study involving an editor which enhances compiler error messages. This intervention group has been previously shown to have a reduced overall number of student errors, number of errors per student, and number of repeated student errors per compiler error message. In this research we find a reduction in EQ, providing further evidence that error message enhancement has positive effects. In addition we find a significant reduction in RED providing evidence that this metric is valid.
Type of Material
Conference Publication
Publisher
ACM
Start Page
296
End Page
301
Copyright (Published Version)
2016 ACM
Subjects

Java

EQ

CS1

Debugging

Errors

Syntax errors

Error messages

Compiler errors

Repeated errors

Consecutive errors

Error quotient

Feedback

Novice

Programming

DOI
10.1145/2899415.2899463
Language
English
Status of Item
Peer reviewed
Journal
ITiCSE Proceedings of the 2016 ACM Conference on Innovation and Technology in Computer Science Education, Arequipa, Peru, 11-13 July 2016
Conference Details
21st Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE), Arequipa, Peru, 11-13 July 2016
This item is made available under a Creative Commons License
https://creativecommons.org/licenses/by-nc-nd/3.0/ie/
File(s)
Loading...
Thumbnail Image
Name

ITiCSE-Becker-Preprint.pdf

Size

257.72 KB

Format

Adobe PDF

Checksum (MD5)

39bc9afd2ef8b1f57d72ece5c3333915

Owning collection
Computer Science Research Collection

Item descriptive metadata is released under a CC-0 (public domain) license: https://creativecommons.org/public-domain/cc0/.
All other content is subject to copyright.

For all queries please contact research.repository@ucd.ie.

Built with DSpace-CRIS software - Extension maintained and optimized by 4Science

  • Cookie settings
  • Privacy policy
  • End User Agreement