Seeing is believing

Part of my job involves being an observer in other teachers’ classrooms. At Evaluation Associates Ltd, we have clear beliefs (underpinned by relevant evidence, of course) that ongoing feedback, evaluation and support of teachers in the classroom supports them to grow and improve. Cycles of inquiry are used to build teacher and student capacity where purposeful classroom based observations are key evidence to see shifts.

Sounds great, right? And it is. Having someone else in the room, noticing what a teacher is doing, how they are interacting with the students and how the students work with each other is a great thing.

During or just after the observation, we interview the students to get their perspective on whatever the teacher is working on in their practice, and the impact of this for them as learners. Still great. Student voice and facilitator notes are used to inform a professional discussion. Still great, right?

On reflection, I felt as if I didn’t fully commit to the power of observations. Ideally, teachers would also make a video recording of their practice that they could analyse prior to meeting with the observer. When some of the teachers I was working with last year expressed reluctance, I pulled back and allowed them to opt out. But I’m not happy with that and want to change this practice within my own facilitation this year.

Why? Without the recording acting as another set of eyes that the teacher can use to monitor and reflect on their practice. Without the impartial eyes of the video, the facilitators’ observation notes could become the perspective on the teaching and learning – which is too limited.

Assessment for Learning (which I avidly believe in) has the ultimate aim of enabling learners to become self-regulating. Part of this is generating their own feedback and connecting this cognitively, conatively and affectively. My concern is that if teachers are not filming their own practice, and using this recording as an artefact for reflection, then they could be relying on the observer as “outsider” to bring in some points about quality or how closely they have  met their goals. In short, they are not really self-regulating as learners. The role of the observer and the observation is still essential but could be improved if coupled with the video as another point of evidence to use for triangulation.

Seeing how you go about things, or things that you may not have noticed about how the students are learning, or moments where you’ve shown progress as you shift your practice are all positive outcomes of filming. Getting over the surface features- the sound of your voice, the wee foibles and eccentricities we all possess, how ugly that jumper really is (it was always borderline in your head anyway) –  and using the video as an extra set of objective eyes in the room means that it can be really powerful.

So, where to from here? For me, I need to be more upfront with the teachers and leaders I work with about the power of observation and the usefulness of the video for active reflection. I raised filming at a staff meeting last night (nervously) and the overwhelming response was positive. The teachers were keen. If I come across objections to filming in my work, I need to use my OTL skills to unpack the beliefs which have led to this reaction and build on it from there. I don’t want to push anyone into the learning pit but understanding the “why” rather than just doing the “what” is key.

When thinking about my own practice, as well as the shifting practice of the marvelous teachers, leaders and learners that I am privileged to work with, I think I need to keep the mantra up – whatever we do, it has to be better than before.

 

Video_Camera

This post broke my blogging drought!

Moving toward Assessment for Learning

I was recently contacted by an educator in Hong Kong wanting some advice around how he could make his tests more AfL appropriate. This is a great question (and a million more questions popped into my head – why a test? What is it measuring? etc.) and I promised myself to answer him fully.

Here is my response: 

There are heaps of ways to make tests more AfL appropriate for students. 

Ideally, working with the students to identify what the key learning needs to be and what is the best way to test this would be a start. 

If this isn’t possible (I.e. there is a set, common test for all students), try thinking about the lead up to the test. Are the students familiar with the success criteria? Have they had enough exposure to examples of what a quality response in the test may look like? Are they able to talk confidently about the learning and what is expected of them? Are they able to look at previous questions / test papers and go through how they may apply their learning to these?

After they’ve sat the test, don’t mark it and hand it back straight away. AfL is primarily about empowering the students as learners. I would give them a blank copy of the same test and ask them to identity questions that were easy, hard, or manageable (I use different coloured highlighters / pens for this). Then talk through in pairs where they have similar responses. This gives you really good info as a teacher where gaps may be occurring for your students. 

Then I would get them to peer mark the test. As a teacher, you could guide this process, provide model answers, act as a third pair of eyes for a student marker etc. Giving ownership to students of the learning and making them active participants in the classroom is key. I would probably get the person who the student had discussed where the student had struggled or found things easy to mark the test.

After this, I would suggest working towards some peer assessment. This is different from marking as the students need to evaluate the test information (which concepts or skills the students were able to deal with, where there are gaps etc.,) and then provide some feedback to each other. I would recommend using Hattie and Timperley’s questions: where am I going (how closely did I meet the learning goal), how am I going (feedback on strategies used, concepts or skills which are working) and where to next (new direction for learning, where the gaps need to be closed). 

Providing quality feedback to peers can be challenging for learners so some teachers guidance is key at this point. Using some sentence starters for peer feedback can be useful at this point.

Get the students to look at their peer marked and assessed work and reflect on their test. Was there correlation between things they found easy and what was correct? Or not? What does this tell them (and you) about how they are feeling about their competency at the moment?

Record the data from this test in your teacher markbook. I wouldn’t just record the final grade / percentage though. Find a way to record the student perception of their competence (at that point in time), the individual grades, groups of students who have gaps in the same areas, students who seem to be covering the key learning and finding it all easy. All of this information gives you some indication of where to go next as a teacher.

This is a suggested approach and makes some assumptions. I’ve assumed that the test is paper based, not online. If it is an online, computer-marked test another approach may be needed. The principles of AfL remain the same though, getting students actively involved in their learning so they can become self-regulated learners.

I hope that this helps in some way, please let me know how you are going with AfL.

I tried to touch on the principles of AfL and still keep things grounded at a practical level. And this is really important to me, knowing a theory and knowing what it may look like in practice are often different things. I have a clear theory for improvement coming through in my suggestion – share the locus of control with students, give them a chance to evaluate their own or someone else’s understandings of the concepts or mastery of the skills, and in doing so, students are more likely to be engaged as learners (which should lead to better outcomes for them). 

  
When I first moved toward an AfL pedagogy I felt a little hamstrung by the rigour of high-stakes assessment in senior secondary. By focusing on the principles of AfL, I found ways (and continue to find ways) to empower learners even when I couldn’t set the the assessment task myself (such as in NCEA exams). Assessment for Learning requires a shift of thinking for both students and teachers.

Support students to develop processes to work towards their goals.

I’ve been working on making our learning goals more visible with my learners at HPSS. This is a document that I found on pinterest that we used to make our goals, steps towards our goals more visible. We completed these individually, then sought peer feedback from the learning hub around the quality of these, and have now pinned them on the wall of the hub so that we can be accountable for our goals.

Here are some of the students’ documents:

11948169_10153612437824686_2133277314_n

11922942_10153612436904686_675678532_n

And peer feedback from another student:

11920369_10153612437749686_1665876147_n

A huge focus at HPSS is the concept of ‘ako‘ where teachers and students learn from each other, I always participate in the learning. I shared my professional goals with my learning hub, sought feedback, and refined my processes based on the feedback. Here is mine…

My goals

Guy Claxton – Teaching for intelligent mindsets

Teaching for intelligent mindsets: Auckland 15th March 2015

Teaching intelligence

Guy Claxton, King’s College London

 

  • Fixed mindset one of the most powerful brakes on intelligence.
  • We are trying to teach with the breaks on, no wonder it is a grind!
  • Intelligence is the word we give to our understanding of when the mind is working at full strength – as is creativity and wisdom
  • Intelligence characterised by times when we bring all of our resources together, we are firing on all cylinders, and we cope with situations that are complicated.
  • What is the mind like when it is at its best? Same for boys and girls?
  • Intelligence – understood in 19th – 20th cent by phrenology
  • What evidence do we use to justify judgements made by teachers about intelligence – gifted, struggling
  • Hierarchy of subjects – rational (maths etc.) at the top of the hierarchy and those involving the body (music, dance, drama, design) lower down the food chain
  • This preconception has been blown apart and is shattered by contemporary research (including Dweck).

New Kinds of Smart (Lucas and Claxton)

  • Intelligence is made up of a constellation of aspects of our minds
  • Composite, attitudinal, physical, distributed, social, expandable
  • Intelligence is distributed – not just a single person on their own, esp. if deprived from social tools. Yet we treat students as if their intelligence is their own possession.
  • Intelligence is the sum total of your habits of mind” prof Lauren Resnick
  • Intelligence as a jazz combo: plays off each other, plays sweetly, knows how to orchestrate itself.
  • Links to mindfulness, so important in a world that seems to inspire students to be distractible

Cognitive combo

  • Attention
  • Investigation
  • Imitation
  • Imagination
  • Experimentation
  • Reasoning
  • Reviewing

Attitudinal

Intelligence is powerfully expanded – and contracted – by mindsets, beliefs, attitudes and vulnerabilities”

Fixed mindsets like a computer virus – perverts functionality

Accelerators:

  • Growth mindset
  • Tolerance for uncertainty
  • Fair-mindedness
  • Empathy (perspectives)
  • Craftsmanship

Brakes:

  • Fixed mindset
  • Intolerance for uncertainty
  • My-side bias
  • Egocentricity
  • Approval

Are senior secondary teachers keen to preserve students’ ability to think on their feet – flounder intelligently.

  • Fair mindedness vs. my-side bias
  • Keith Stanovic (sp?) – Canadian researcher – found that high IQ may result in people developing more sophisticated versions of “my-side bias” (focusing on how to prove my perspective)
  • Roger Berger (Austin’s butterfly guy) Creativity emerges from having a go, reflection, having another go, reviewing, having another go etc.
  • Ability to accept suggestions from peers and see how he is bursting with pride when he creates a scientific rendition of a butterfly. Flies in the face (no pun intended) of usual process – product aspect of learning – true creativity comes from having goes at getting it right.

Physical

  • Importance of the body in intelligence – connecting body and mind
  • “The hand is the cutting edge of the mind” Jacob Bronowski
  • True creativity often stems from gesture, if ignored it can hamstring
  • Connections between cognitive performance and physical expression
  • Discusses how we feel and think through our heart, gut, skin, lungs, brain – the body as a connected being where intelligence/ thought happens

Distributed

“We make the world smart so we don’t have to be” – Andy Clark

  • it is person-plus-tools
  • deep in our genetic make up to be designers of tools to extend and develop our intelligence

Yes, we do group work but when stakes are high we expect students to work independently. This is so important regarding how we, as a whole, approach assessment.

Social

Intelligence is a social triumph – Phil Brown and Hugh Lauder

  • Two heads are better than one (sometimes)
  • Communities of practice
  • Social and digital learning
    • Personal learning networks

Sugatra Mitra’s hole in the wall – perfect e.g. of social aspect of intelligence

Expandable

All the instruments of the orchestra of intelligence improve with practice..

We can teach in a way that builds and broadens habits of mind

  • Resilience, imagination, empathy, resourcefulness, reasoning, craftsmanship, reflection, collaboration
  • Links to HPSS Habits and Values
  • The joy of the struggle – Ricky Gervais and Stephen Merchant when working on ‘The Office scripts’.

Build imagination by using language that encourages imaginative thinking. Move away from “is” language – fixed idea – i.e. the rainbow is red, yellow etc. – Is there actually red? Or is it “man-salmon” (a quote from Steve)

Instead but on “could be” language rather than “is” language…

Love the “empathy specs” to build and stretch empathetic thinking

Building reflection

  • Teachers should coach students to think like a reflective practitioner of learning – essential skill
  • Landau Forte College school in Darby – learning powered school (video clip, see if it is online…)
  • Learning how to learn
  • http://www.landau-forte.org.uk/

Intelligence is NOT Fixed

  • Children can become smarter – and so can we
  • Schools can aim to build learning agility /power / growth mindsets
  • Learning powered students do better academically
  • Why train children to be diligent clerks when we can help them become intelligent explorers?

It is our moral, ethical responsibility as teachers to build students’ intelligence – aims for a more advanced NZ – aspects of citizenship

Question from floor re assessment limiting intelligence

Response – it is up to us to build learning power in students. Not a matter of choosing assessment success or life long learning.

These questions about NCEA and summative, high-stakes assessment are frustrating me! This is another example of how teachers’ fixed mindsets about NCEA and assessment are creating barriers for our students…

 

Streaming

Currently similar in levels of achievement and performance (CLAPS!) – evident in athletics, sports etc.

Problem only comes when you insert the virus of labelling this as predicitive of performance expectations – interesting in terms of how we are using our e-AsTTle / OTJs

Carol Dweck – teaching for intelligent mindsets

I am very lucky today to be attending this amazing PL opportunity. Here are my unstructured notes. Photos to come…

Teaching for intelligent mindsets

Auckland 15th March 2015

Dr. Carol Dweck

  • Motivation – you never see an unmotivated baby! Babies are infinitely curious, yet many of the things we do turn kids into non-learners.
  • Too much emphasis on “gifted” and “talented”
  • When we foster “natural talent” we make kids feel infallible
  • Where are the kids who can take fb and coaching without it being a blow to their self-esteem?

Fixed and growth mindset

Fixed – search for perfection

Growth – intelligence can be developed.

Which mindset is correct?

  • Neoscience reinforces growth mindset through brain plasticity
  • Cogntive psychologists are isolating aspects of the brain and focusing on how to develop these.
  • Alfred Binet (IQ test designer) actually had an impressive growth mindset. Yet test is used to measure “talent” but his initiaul idea was as an assess tool to identify the students for whom public schools were failing them. Unfortunately, test design does not reflect its use.
  • Are mindsets all or nothing – not necessary, can have a mixed of fixed and growth in different areas (i.e sports, academics, within academic disciplines etc.)
  • When we feel that we are failing, we can fall into a fixed mindset!
  • Mindsets can be changed

Mindsets matter

Studies in students who are trying to enter med schools

Foxed just hope for best, growth actively involved in their learning (sorting out study groups, actively seeking feedback etc.)

All 10th graders Chile – the poorer students in Chile with growth mindsets were outperforming those who from wealthier homes with fixed mindsets. Growth mindset is powerful indicator for academic outcomes.

How do mindsets work?

Whole pscychological world for students which has different meaning.

  • Rule 1:
    • Fixed – look smart at all costs (but above all, NEVER LOOK DUMB)
    • Growth – learn at all costs ( why bother looking smart when you could be getting smarter)
  • Rule 2:
    • Fixed: effort is a bad thing, if you are smart, you shouldn’t need to try (i.e Homer Simpson – trying is the first step towards failure)
    • Growth – work hard, effort is the key. No-one accomplished anything great without great strategies and help from others.
  • WORST IDEA THAT ANYONE CAN HAVE IS THAT EFFORT DOES NOT LEAD TO
  • Rule 3:
  • Fixed – hide mistakes and deficiencies
  • Growth – confront mistakes and learn from them

Where does Mindsets come from?

Praise

Intelligence praise vs. Process praise

Studies on how mother’s talk to babies over time (babies, five years, seven years) thos who were praised with growth mindset (learning) outperformed those with fixed (are secondary schools trying to buck trend)

What to praise:

  • Struggle (only praising kids when they work hard is called nagging)
  • Strategies, choices
  • Choosing different tasks, making mistakes
  • Learning , improving

Growth is about appreciating strategies and choices that students are using –what strategies are working, which aren’t,

How we talk:

  • “Oh, you got an A without really working” – subtext for child effort not important
  • You did that so quickly – subtext rewards for speed

Challenge is interesting and worthwhile

  • Without working – A is nice but you must not be learning much
  • Quickly and easily – it must be boring for you, I’m sorry you’ve wasted your time. Lets do something you can learn from.

Importance of “Yet”

Not ok to say “I’m no good at…” need to retrain our language and semantics to use “I’m no good at … yet” (growth)

Students at school in Chicago use “not yet” as part of their assessment language – culture now of collecting and comparing “not yets” for growth – awesome, AfL in practice! Does B, P, A do this? Probably not, SOLO taxonomy may do? Not Achieved? Not yet achieved would allow for growth – help shift kids from performative to learning focused.

When is it too late for growth mindset training? Answer – NEVER!

Brain plasticity can be an avenue to shift mindsets about mindsets (very meta) – Herrmann’s Brain whole brain dominance at #HPSS developing this in our learners

Maybe an aspect of growth mindset is realising that you never really “have” it – not binary fixed or growth but recognising that situations alter the degree to which we have it.

Consider rock star new teachers – give up when times are tough. Need networks of support for new teachers (and all teachers) to develop their growth mindsets. Story of struggling teacher who persevered with growth mindset by filming and watching self daily to improve. Saw her struggle as “the worst she was ever going to be”. She got there in the end.

Can an organisation have a mindset?

In short, yes! People within the org agree with each other, values either fixed or growth mindset. This applies to schools as well. Are you in a school that worships fixed talent in students and teachers? Or fosters growth? Sense of ako for all akonga.

Fixed – teachers in competition with each other. Growth – teachers collaborate and share.

Growth orgs have more creativity and innovation going on.

Growth mindset and assessment

Formal assessments came about for a reason but their prevalence is killing the joy of teaching and learning. Oh dear…

Culture that celebrates failure – i.e. failure videos, fail blog – detrimental to growth mindsets as an aspect of citizenship?

Making the relevance clear

On Friday morning we (the HPSS assessment team) supported our staff to develop their curriculum rubrics. The idea here is that there is clarity from the learning goals of the module through to the individual aspects of our learning design model which formulate the learning objectives to be assessed.

We are using SOLO taxonomy as the qualifiers to unpack the curriculum levels. I am so very grateful to the wonderful Pam Hook for her support in developing this approach. Friday’s professional learning was really positive and most teachers were feeling empowered around making the learning clear for their students.

Clarity and relevance are essential components of effective pedagogy. If the students (or teachers) are not explicit in what the learning is or why it is relevant, there is the risk of engaging in busy work. Likewise even if the teachers are clear, students who do not understand would simply comply rather than engage in the learning actively.

Saturdays are my day off. I often work on Sundays – prep, blogging, marking, providing feedback for learners etc. – but Saturdays are for me. So when I was laxing on the sofa, watching rubbish TV on Sky’s Vibe channel – I stumbled across Mary Portas’ “Queen of the Charity Shops”. In this show, Mary is overhauling a charity shop (in a similar manner to other challenges she has tackled in the retail sector). I was hooked, partly because the volunteers were resistant and partly because Mary’s point about selling were so profound.

6505179327_3b7f0449dc_b

She talked about the two key things in retail – features and benefits. Features are what makes up an item – be it an exposed zip, 5 inch heels, pleather jacket – whereas benefits are why the shopper wants/needs said item. So as I was sitting there, on my day off, I realised that this could be a useful analogy which we could apply to learning. This is the hook for relevance.

So often, especially in secondary schools, students are often learning something for the sake of learning it. Or they don’t know why they are learning it. Or they can’t see the point of what they are learning.

What if we, as teachers, were to commit to “selling” the features and benefits of a concept, context or skill in our teaching practice. Heaven forbid anyone read this as “because it is on the test” but instead what if we were to make the relevance clear for our learners so they can make sense of what they are doing and why.

So what does that look like then? I’m teaching two distinct things tomorrow. In my learning hub we are focusing on “my learning” or understanding themselves as learners; tomorrow’s lesson is going to be around goal setting.

  • WALT: To set relevant, effective goals as learners
  • Features –  relevance, informed by evidence, timely, measurable, knowing how to measure them
  • Benefits – by setting your own goals, based on your needs, you put yourself in the drivers seat of your learning

Whereas in my Year 9 module (with a social science focus) which I teach with Tracey, we have a different learning objective altogether.

  • We are learning to “evaluate the impact of Irish migration on American society”.
  • Features of this will be the specific aspects of migration
  • benefits to consider negative and positive perspectives of migration, to challenge our own assumptions about migration

I’m keen to explore with the students the benefits that they see. We could co-construct these as a class or in smaller groups.

Both of these benefits will link to the wider educational impact of learning for the individual. It is not about the stuff we are learning; it is about why what is happening in the classroom is relevant for each individual.  Sometimes inspiration come from the strangest of places.

 

Goals – is there more to them than meets the eye?

I’ve been doing a lot of thinking and reading lately around goals, clarity, progressions and all things education. In my new role(s) as part-time PLD facilitator focusing on Leadership and Assessment part-time HPSS teacher + leader of assessment + leader of the performing arts area (this role is not new but the part-time part is), and part-time – who knows when I’m going to find the time – Sheilah Winn Shakespeare festival organiser, director, Stage Challenge co-ordinator, Classical Studies trip co-organiser… But I digress.

Goals

Goals are one of those things that we think that we need to do but I’m not sure how well-used they are in classrooms. Schools set goals, teachers set goals, teachers get students to set goals / co-construct goals, students set goals for themselves that they don’t share with us.

Personally I’ve been really unsatisfied with SMART goals for a long time. It took me a while to really put my finger on it. Locke and Latham’s seminal 2006 article on goals clearly define the differences between performance and learning goals. When reading this article I had an ‘aha!’ moment reading “a learning goal facilitates or enhances metacognition—namely, planning, monitoring, and evaluating progress toward goal attainment” – learning goals focus on the strategies needed for success whereas performance goals focus on the outcomes. SMART goals could be used to support learning goals but the lack of focus on the how (strategies, dispositions, skills) means than they may limit attainment of the goal.

I was re-reading Viviane Robinson’s Student-Centred Leadership on the plane yesterday and her comments about when to use SMART goals and when to use learning goals. More and more the puzzle pieces are falling into place.

“At one level, setting SMART goals makes sense because people cannot regulate their performance if they are unclear about how to assess their progress… At another level, there are occasions when the call to set SMART goals is inappropriate. In order to set a SMART goal, you have to know quite a lot about how to achieve it. When goals involve new challenges, how can you possibly know if it is achievable, if it is realistic, and how long it will take you to achieve it (Seddon, 2008)? In the absence of such knowledge, it may be better to set a learning goal or a broader performance goal that expresses your shared commitments and helps keep you focused”

Student-Centred Leadership, Kindle version, Location 1100

Surely, we are wanting to get our students to be considering new challenges – why are we encouraging them to put constraints around their goals because we think that performative goals are better / easier / they way, truth and the light? I believe that the needs must be addressed before there is goal setting. If the situation requires something that needs to be achieved (an outcome), sure go ahead, be SMART. However, if there is more at stake (and I would like to imagine that there is) a learning goal is a much better fit.

So timing is important. In preparation for playing the role of the “devil’s advocate” (yes that is an actual role one gets to play, it has a cool badge / picture thing and everything) on tonight’s #edchatNZ chat hosted by my lovely colleague and friend Danielle Myburgh (@missDtheTeacher), I was thinking about some provocative questions / statements which I could challenge teachers with. Here are some (n.b. I only used one or two as I was trying to respond to people’s statements):

  • What is the point of deciding on “measurable” goals when dealing with innovation and change? Multiple measurements should evolve, shouldn’t they?
  • Goal setting, with goal follow through, clear strategies and accountability, is meaningless. How much time do you dedicate to work with your students on follow through? What about your own goals? Your colleagues?
  • how do your students’ individual goals impact their day to day experiences in your classroom?
  • How much alignment is there between your students’, staff and school’s strategic goals?
  • What checks and balances do you have to robust critique of goals? Yours, your students, or your colleagues goals?
  • What is the point of goal setting if the goals are not enacted? Need to be coupled with frequent checking in and feedback/feedforward, what does this look like in your practice?
  • Have your students been setting goals this year? Why? What evidence or research is underpinning your practice?

 

I guess from the feedback, aspects of my devil’s advocate role resonated with some. Personally, I felt that I was a bit slow and (as always) struggled with 140 characters.

Twitter chat extract

I do believe in making the learning visible – using learning intentions which clearly show what we are learning, why we are learning and how we are learning is the key. The harder part of me is to relate this to each individual I’m teaching, be it in hubs, modules, my times or big projects.

On Monday, I will be starting working with my HPSS learning hub around their goals. I’ve got a couple of approaches to consider. I could just bowl in “Goal Setting” and support the students to make some learning goals through co-construction with me and each other, rather than performance ones, with clear check points for progress and keen understanding of what success of the goals may look like. This is what we did last year, however I felt that some students were occasionally complying with me because they are all decent people who trusted me enough that this was a good idea. We made the goals visible in our hub, we reflected on progress but I’m not convinced that there were enough deliberate acts to improve their learning goals. Not trying to make excuses but some things did get lost in the busyness of starting a new school last year.

However, the questions I was challenging myself to come up with to challenge others are now challenging me. What evidence will students be using to inform their goals? Is now the right time? How can I align my own goals for this year (which I have yet to formulate) to those of my hub? How can I best support my students in this highly personalised environment without resorting to following the “letter” of goal setting, rather than the “spirit”?

Over the weekend I’m going to keep pondering this and if I come up with something better, I’ll blog about it (promise).