What is caa in education?

The role and scope of ICT (information and computing technology) expanded mainly in 1990s and became a hot topic of research in education. The rationale given for using assessment through computers is that due to global development of online learning, online assessment should be used to complement it.

Computer-assisted assessment (CAA) is a broad term which describes the application of computer technologies to the assessment process. This may include a variety of activities which assess knowledge, understanding and skills using one or more technologies such as the Internet, intranets, CD-ROM and optical data capture systems.

Approaches to Computer Aided Assessment (CAA) can be divided in 2 systems:

1.  Automated marking of paper forms, using optical mark reader (OMR) e.g., CAT test for management courses, and

2.  Computerized marking in which questions are presented and responses assessed entirely by the computer software, with no paper involved e.g., the online test and Quizzies.

CAA software can provide immediate supportive feedback for each question, tailor the answer given, making this particularly suitable for informal self- assessment and Formative Feedback by tutor. It is fundamentally useful in testing basic knowledge required in any subject like Terminology, and fundamental conceptual knowledge. There are a plethora of Assessment tools that can be used for assessing student’s learning capacity and knowledge gained.

This blog is sharing the experience of designing and running of online quizz that I had made using the Question-Mark Perception software in collaboration with Nottingham Trend University UK.

I had applied it for Fashion UG students in Level 2 of studies where subject of Pattern Making was tested. MCQs were reinforcing their learning in conceptual way, as students tend to ignore it in a skill based subject. It was a five minutes short quizz with ten questions (pictures and visuals were also part of questions) though some students finished it in 3 minutes. The quiz gave me an option to save the questions online that could be used for future batches as well. Gradually a teacher can start making a “question pool” ready to be implemented as when needed in a very organized and quick way. It took me a few days to design, re-think, pilot run, and saving a final copy. Students could run it anytime and at their own place.

Students’s feedback was quite positive as the reult was immediatly sent to them as soon as they completed the test. The best part, as per student’s perception, was that it was quick and took only few minutes. One of the important piont that was noted in  students’ feedback was that they felt “Marking was fair”.

My perception of its pedagogical advantage as a Formative Assessment is explained below with the help of following points, though some of them came as realizations only after the execution:  a. Testing the knowledge gained by setting significant milestones; and the associated loopholes/gaps in the same before the summative assessment. One of the learning outcomes of this module is to acquire and apply basic knowledge of the subject.  b. Informal, timely, appropriate and correct feedback for the test taken.  c. Easier method of record generation when used as a means of assessment  d. A means of supporting the administration part and tracking of learning  e. And, last but not the least, as a tool for learning information management skills – how do you manage answering questions in the limited period?

The use of CAA in universities of UK and US is growing (McKenna, 2001) and there are at least 3 reasons why we might want to introduce ICT- based assessment:

In the light of what is written by an author (Fellenz, 2006), and felt by many others, assessment is not an end in itself but a vehicle for educational improvement. We should be taking account of our learners’ needs and design the assessments accordingly. Also, we should be continuously recreating ourselves and looking for new, innovative and challenging approaches for evaluation. Hence, e-learning and CAA has an important role to play as an integral part in today’s educational scenario.

“E-Learning is fundamentally about learning and not about technology. Strategic development of e-learning should be based on the needs and demands of learners and the quality of their educational experience.” (Joint SFEFC/SHEFC e-Learning Group: Final Report 2003, p. 52).

In conclusion, I am of the view that technology, if used and understood from pedagogical point of view, has a lot of potential and flexibility to offer in current scenario.

References:

1. GIPPS, C.V., 2005. “What is the role for ICT-based assessment in universities?” Studies in Higher Education (Routledge, Taylor & Francis Group) . 30 (2), pp.171-180.

2. McKENNA, C., 2001. Introducing computers into the assessment process: what is the impact upon academic practice? Paper presented at the Higher Education Close Up Conference 2, Lancaster University, 16-18 July 2001. Available from: http://www.leeds.ac.uk/educol/documents/00001805.htm

Website:

http://www.oecd.org/innovation/research/34899903.pdf

Computer-aided (or computer-assisted) assessment (CAA) includes all forms of assessments students' progress, whether summative (i.e. tests that will contribute to formal qualifications) or formative (i.e. tests that promote learning but are not part of a course's marking), delivered with the help of computers.