Brunel University Research Archive (BURA) >
Schools >
School of Information Systems, Computing and Mathematics >
Brunel Software Engineering ResearCh Group (B-SERC) >
B-SERC Research Papers >

Please use this identifier to cite or link to this item: http://bura.brunel.ac.uk/handle/2438/2441

Title: The problem of labels in e-assessment of diagrams
Authors: Jayal, A
Shepperd, M J
Keywords: e-Learning
e-Assessment
empirical research
diagrams
UML
text processing
Publication Date: 2008
Citation: ACM Journal on Educational Resources in Computing (JERIC), 8(4).
Abstract: In this short paper we explore a problematic aspect of automated assessment of diagrams. Diagrams have partial and sometimes inconsistent semantics. Typically much of the meaning of diagram resides in the labels, however, the choice of labeling is largely unrestricted. This means a correct solution may utilise differing yet semantically equivalent labels to the specimen solution. With human marking this problem can be easily overcome. Unfortunately with e-assessment this is challenging. We empirically explore the scale of the problem of synonyms by analysing 160 student solutions to a UML task. From this we find that cumulative growth of synonyms only shows a limited tendency to reduce at the margin. This finding has significant implications for the ease in which we may develop future e-assessment systems of diagrams, in that the need for better algorithms for assessing label semantic similarity becomes inescapable.
URI: http://bura.brunel.ac.uk/handle/2438/2441
Appears in Collections:B-SERC Research Papers
School of Information Systems, Computing and Mathematics Research Papers
Computer Science

Files in This Item:

File Description SizeFormat
JERIC_v20.pdf257.85 kBAdobe PDFView/Open

Items in BURA are protected by copyright, with all rights reserved, unless otherwise indicated.

 


Library (c) Brunel University.    Powered By: DSpace
Send us your
Feedback. Last Updated: September 14, 2010.
Managed by:
Hassan Bhuiyan