Serving Mathematics : Serving Mathematics Web services for
online assessment
in mathematics http://maths.york.ac.uk/serving_maths/
Mathematics assessment systems: : Mathematics assessment systems: Question can contain randomized mathematical expressions
Student’s answer is marked using a computer algebra system
Can mark questions that have no unique answer
Can render mathematical expressions
Separate Assessment Systems : Separate Assessment Systems AiM CABLE METRIC WaLLiS Student or Lecturer User has to deal with a different user interface and a different question syntax for each system
Systems have to duplicate assessment system functionality TOIA
Single assessment system with remote question engines : Single assessment system with remote question engines AiM CABLE METRIC AiM Assessment
System
Splitting up the tasks: : Splitting up the tasks: Question engine (Item engine)
Template processing (randomization)
Item rendering (optional)
Response processing (may use CAS)
Assessment system
Assemble questions into quizzes (items into tests)
Delivery of quizzes
Scoring and reporting
Keeping database of questions and responses
Components: : Components: Assessment
System
(Moodle) Question
Authoring
Tool
(from scratch) Question engines
(AiM, CABLE,
METRIC SMITE Mathematics
Translation Engine
(e.g. TeX -> MathML) MathQTI RQP RQP SMITE
protocol
Slide7 : The assessment domain
Assesment
Creation:
items;
assessments;
metadata.
Banking:
metadata;
storage;
management.
Results reporting:
grading;
notification;
transcripts.
Response processing:
web services;
item statistics.
Delivery:
purpose;
security;
exposure;
context;
timetabling.
Exchange:
packaging;
conversion.
Slide8 :
Interoperability : Interoperability MathQTI Mathematics extension of QTI allowing presentation MathML and OpenMath expressions in template and response processing
RQP Remote Question Protocol Web service protocol to allow communication between assessment systems and question engines.
SMITE (Translation Engine) Protocol allows clients to request translation between different mathematical formats (e.g., MathML, OpenMath, TeX, CAS syntax, HTML)