Tag Archives: arr

Visual Assessment Guide

What started last year as a Self Assessment Guide, has been reworked into a more general tool for assessment. This new guide is suitable for teacher, peer or self assessment and also offers a visual map of what we want students to learn (with highlighting of which concepts are most important). Although still ICT specific, this guide could be adapted to any subject by changing the attributes and keywords.

Visual Assessment Guide - ICT & Media_web

Printable Version (PDF)

So, what’s changed? Well, after a year of experience with student self assessment using the original guide, I have come to the following conclusions.

  1. Self assessment is great, and students really learn a lot by revisiting concepts learned, and writing about them. However, students get bored of self assessment, so using it more than 3 times a year with one group is not so great. The assessment tool should thus by more general, useful for teachers and peers to use.
  2. The old guide was based around “strands”, which were essentially high level learning outcomes. The new guide focuses on “attributes”, as I really want to be centered around the kind of students I want leaving my course after three years. The two schools I am involved in (ICHK Secondary and ICHK HLY) include formal ICT learning from Years 1 to 9, and we have tentatively decided to use these attributes across the entire age range. Hopefully this will lend consistency to what we are doing, allowing us to be more effective.
  3. In the original guide there was mapping from the ways of learning (a Bloomsian set from knowing through creating), allowing these to be turned into numeric scores. This was never ideal, as it is too reductionist and focuses attention on the grade, not what has been learned. The new version dispenses with the levels, and just focuses on the ways of learning. It has been tentatively agreed that next year I can experiment with reporting the top way of learning achieved in a particular piece of work. Hopefully this will help
  4. The old category of “becoming” connotes a moral element to what is being taught, and means assigning levels based on my own world view. Whilst I might find this appropriate, others may not. This point was raised by Toby Newton, and whilst I was initially hesitant, I can see the value of his point that we need students to be more critical of what we say, not just accepting and applying everything automatically.

I am really keen to get feedback on this style of assessment, and on the ICT content included and omitted from the guide. I don’t doubt that collaboration will make this idea more useful and usable.

Self Assessment Guide

Note: after a year of use, the Self Assessment Guide has now been superseded by the Visual Assessment Guide.

Last year I completed my Unified ICT Rubric for KS3, and even before it was finished I hated it. It was too big, too complex and too restrictive. I have spent the last year slowly thinking of a better way, looking around at what others are doing, and trying to roll disparate ideas into something simple, cohesive and, gasp, even fun. The result is the document and process you see below. It is a system of student self assessment, where the teacher is there to verifying and adjudicate student’s own assessments of themselves. But, it is more than simply an assessment guide, it is also a way for students to understand a whole course, and to map their progress.

ICT & Media Assessment Guide_web

Large version (PNG) | A3 printable version (PDF) | Editable student version w/ log (Pages)

The Teaching & Assessment Process

This document can be used in numerous ways to support teaching and learning. The description below is the way I am currently planning to use it:

  • The first step has been to reduce the number of units in each year, to free up 5 lessons for students to work on self assessment. You can see my draft KS3 ICT & Media Plan, to look at what exactly is covered.
  • Students will be introduced to the guide during the first lesson of the year, and we will work through the instructions (top right of the guide) together.
  • For each unit of study, students will reflect on roughly 5 strand+keyword pairs (e.g. Intellectual Property+Creative Commons). At first, I will select these for them, after some practice they should be able to select them themselves.
  • Students will study as per usual, creating an artifact which they will submit for assessment.
  • Students will then write their reflection, showing clearly how they have achieved each level, going as high as they can. They will assign themselves a grade using the average of their layers. This reflection, plus grade, will be submitted as well.
  • Using both the submitted work, as well as the reflection, I will vet their self assessment, and determine whether it is accurate. Any adjustments (up or down), will be made before the final grade is recorded.
  • Finally, students will highlight the keywords they have reflected on, using the header colour from the highest level they have achieved. As students progress through the course, they should end up with an ongoing map of their achievement:

ICT & Media Assessment Guide_highlights

I would love to get some input on this idea. How does it compare with your own assessments? Do you think it will work? Is it suitable to subjects other than ICT & Media?

Acknowledgements: this work has not been created in isolation, but rather has been influenced by many other teachers and their approaches to assessment and education in general. I would like to acknowledge Jennifer Goldthorpe’s work on self assessment, Mark Roper & Kevin Lester’s IEA work on a clear lexis for assessment and Chris Leach for tipping me over the edge.

Mass Assessment

Peer-assessment seems to be a persistent buzz word in education, and it is something I have used in the past with my students. However, until recently, I have never found it to be as useful as others suggest it might be.  Recently, though, I supplemented verbal peer feedback with with a Google Docs form, containing a number of questions on a numeric scale as well as a field for comments. We video recorded each student performing their assessment piece (a rapid presentation on human-computer interaction, 60 seconds at most), and then reviewed the videos as a class. Whilst students did not necessarily enjoy the process of watching themselves on screen, it certainly made them think about how they present themselves. For each video reviewed, every student in the class (including the presenter) and the teacher, submitted feedback via the Google form. In addition, students were asked to comment on each others’ work verbally, which they were at times reluctant to do. This was supplemented by verbal feedback from the teacher for each student.

The result was immediate feedback, backed by a giant spreadsheet containing around 400 rows for each group of 20 students. This spreadsheet contained self, peer and teacher generated data, each of which was weighted equally (no teacher bias here). The spreadsheet was sorted by the name of the presenting student, and then averages were calculated for each of the questions asked. These were then averaged into an overall grade for the student. Comments were aggregated into a single field. This anonymised data was then delivered back to students using our school platform, Gibbon.

Interestingly, whilst the students were a little more generous than I had been, the overall distribution of grades was pretty much in line with previous, teacher-generated grades, with most students retaining their normal position within the class in terms of academic performance.

In total the assessment took two 70-minute classes (one to present and record, one to watch and grade), and all data processing and entry was completed within 90 minutes. This represents a significant decrease in my marking time, but more importantly, the whole exercise gave students ownership of their grades, and demoted the teacher from the position of god-like arbiter of success.

I am calling this approach mass assessment, and am very interested to hear of other teachers doing similar things, or willing to give this a go.

Unified ICT Rubric

Over the past few weeks I have been working on putting together a unified ICT rubric for my Key Stage 3 students (ages 11-14). Hopefully this will allow both students and myself to understand progress across all units and over three years. Although I do not teach the UK National Curriculum, and I used their level descriptors as a starting point. The content goes much further and deeper than the National Curriculum, but the levels for attainment should align fairly well. You are welcome to download the draft version, have a look, and let me know what you think. The writing may be a little dense, and will need careful deconstruction for students to really utilise it.