Rene’s Assessment

I attended a presentation by Daden, who are doing a lot of very impressive and interesting things in Second Life (and other virtual worlds). I thoroughly recommend having a look at their space in Second Life, where they have some great mash-ups with Google Earth. I would post some links here, but the ones I could find on their site aren’t working, which is a bit rubbish.

Aside from the things appealing to my inner geek, there were also some ver interesting applications in learning. One project I found particularly interesting was the JISC funded ‘Problem based learning in Second Life‘. We were shown a simulation of a road traffic accident used for assessment. The detail was quite incredible (including the ability to listen to the patients breathing, which adjusted over time based on the actions of the attending paramedic). The medical sciences as usual are front runners in the use of new technologies, but I could see many applications in other domains.

The question that does still bug me is whether we should be doing this in open worlds, like Second Life, or if we should be using more private spaces. Perhaps a happy medium will be found in the Second Life Grid, which seems to be looking to offer the best of both worlds… so to speak.

Tweet This Post

A group of 34 prominent academics has taken a laudible stance against our current assessment culture (see also this THE article). You can find the manifesto and it’s supporters at the bottom of this post. Point 3 especially I think is very poignant within the context of e-Assessment, where our obsession with the measurable (I’m thinking Item Response Theory here) has gotten way out of hand at the expense of validity.

The Weston Manor Group

Assessment standards: a manifesto for change

1. The debate on standards needs to focus on how high standards of learning can be achieved through assessment. This requires a greater emphasis on assessment for learning rather than assessment of learning.

1. When it comes to the assessment of learning, we need to move beyond systems focused on marks and grades towards the valid assessment of the achievement of intended programme outcomes.

1. Limits to the extent that standards can be articulated explicitly must be recognised since ever more detailed specificity and striving for reliability, all too frequently, diminish the learning experience and threaten its validity. There are important benefits of higher education which are not amenable either to the precise specification of standards or to objective assessment.

1. Assessment standards are socially constructed so there must be a greater emphasis on assessment and feedback processes that actively engage both staff and students in dialogue about standards. It is when learners share an understanding of academic and professional standards in an atmosphere of mutual trust that learning works best.

1. Active engagement with assessment standards needs to be an integral and seamless part of course design and the learning process in order to allow students to develop their own, internalised, conceptions of standards, and monitor and supervise their own learning.

1. Assessment is largely dependent upon professional judgement, and confidence in such judgement requires the establishment of appropriate forums for the development and sharing of standards within and between disciplinary and professional communities.

Supporters:

Professor Trudy Banta

Dr Simon Barrie

Professor Sally Brown

Ms Cordelia Bryan

Dr Colin Bryson

Ms Jude Carroll

Professor Sue Clegg

Professor Linda Drew

Professor Graham Gibbs

Professor Anton Havnes

Dr Mary Lea

Dr Janet Macdonald

Professor Ranald Macdonald

Dr Debra Macfarlane

Dr Susan Martin

Professor Marcia Mentkowski

Dr Stephen Merry

Professor David Nicol

Professor Andy Northedge

Professor Lin Norton

Ms Berry O’Donovan

Dr Thomas Olsson

Dr Susan Orr

Dr Paul Orsmond

Professor Margaret Price

Professor Phil Race

Mr Clive Robertson

Dr Mark Russell

Dr Chris Rust

Professor Gilly Salmon

Professor Kay Sambell

Professor Brenda Smith

Professor Stephen Swithenby

Professor Mantz Yorke

Tweet This Post

An article in the Wired Campus made me aware of a new service for test preparation called Socrato. It’s seems to be a sort of massive online study group where people can submit, view and practice all sorts of tests (although at the moment mainly MCAS). The downside could be that this is a beta for which the final business model has not yet been chosen, so I’d be careful of the stuff you submit.

Tweet This Post

The latest entry in JISC Inform 21 links to “Resources to support the assessment of learning“. I must say that the collection is far from comprehensive, and ery JISC/CETIS focussed. Still it’s worth a look.

Tweet This Post

The BBC reports that our government will be reviewing the efficiency of our exam system. I’m developing a rather serious aversion to efficiency, as it usually translates rather neatly into degradation.

It would be nice if the government would review the effectiveness of our exam system. Effectiveness is about reaching intended outcomes, not just about saving pennies. As the general secretary of the Association of School and College Leaders, John Dunford, said in the article: “It is vitally important that the government not only conducts a cost-benefit analysis of the current exam system but evaluates its effect on teaching and learning.” Perhaps (god forbid) we could also review the effects of all the links to targets, KPIs and league tables on the quality of learning, as they certainly compromise the validity of the whole system. I will again point to the efforts of colleagues in Denmark, who seem to have understood this a whole lot better.

Tweet This Post