Monday, June 25, 2012

Thinking on assessing learning--

Out of sync
Always wanting better
Not in agreement
Time and time again

More than 45 years ago, GRE exams
My answers and scores significantly impacted by the recent death of my mom
Not a reflection of my learning at all

More than 30 years ago, a Master's thesis and comprehensive exams
Real opportunities to demonstrate what I had learned

More than a decade ago, applying for a new position and answering a question on assessment
Replying that the process and the projects themselves illustrated what students had learned

In that new position, creating rubrics for projects for high schoolers aspiring to become teachers
Knowing that the state used the same type of rubrics to assess new teachers
Crying in the car after being told to change the rubrics to written tests by an old school CTE administrator

Almost 10 years ago, with a terrible cold, an appointment to take the assessment component as a NBPTS candidate
Timed testing, no kleenex allowed in the testing room, cranking out as fast as I could responses to 6 questions
No time to think

High stakes testing even for our beloved Harley as his obedience training classes came to completion
In the dark in a strange park, he would not stay as I walked away passing 9 of 10 tasks and failing
He curled up in the corner of the back seat with his head down on the way home

Some 6 years ago, designing and creating online professional development courses for Ohio teachers
Always pushing back against suggestions of quizzes, of tests
Pulling for learner created content and powerful questions that enabled deeper learning

Assessment--
Grades, points, projects, quizzes, standardized tests, rubrics--

And then MOOC 2008 with vast learning landscapes, autonomy, openness and distributed learning
I assessed my learning in the open here on this blog (in the blog search box, enter CCK08 for 6 pages of posts)
That learning experience was empowering and scary and full of wonder
And my thoughts on assessment are shifting --again

WHO/WHAT CONTRIBUTED TO THE SHIFT

Very honestly, I've never been a real quiz, test person. In the classroom, I had conversations, I observed, I watched process and explored projects. With proficiencies and standardized testing, I was pushed to change. Conflicted, some testing entered the learning experiences of my students-- not without tension.

Now I'm old, less disposed to "push"-- more likely to follow my instincts---  especially when I've had an experience such as MOOC 2008 and I'm finding other educators seeking a shift/making a shift too.

Sheryl Nussbaum-Beach undoubtably has provided the most fodder for my thinking. She has articulated in so many places a vision of what could that truly resonates with me. That wayfinding, co constructing meaning and self directed processes play a huge role in shifting is an understatement.
Let the co-learners in the room decide context- the how of what we will share, the teaching and learning processes and the why of how we learn it this way.

Let us do our own wayfinding. Let us construct our own meaning and design, our own sense making activities. Let us show mastery of what we learned in ways that align not only with the standards but also with the self-directed processes and creative ways in which each learner chooses.

maybe we need to standardize (make it business as usual) that learning should be self-directed and knowledge co-constructed.
http://plpnetwork.com/2011/03/12/disconnect-content-context-common-core/
Anne Fox joined the group of PLP Connected Coaches last fall and in a conversation shared this resource on Heutagogy. Totally new to me, very exciting as learning moves from self directed to self determined. Maybe it's because so much of my professional learning was self determined (I rarely felt that the organized PD that was a staple in my career was of much value) that this notion speaks to me so clearly as does the accompanying concept of developing capabilities. This resource has had a critical impact on my thinking.
Heutagogy (based on the Greek for “self”) was defined by Hase and Kenyon in 2000 as the study of self-determined learning. Heutagogy applies a holistic approach to developing learner capabilities, with learning as an active and proactive process, and learners serving as “the major agent in their own learning, which occurs as a result of personal experiences” (Hase & Kenyon, 2007, p. 112). As in an andragogical approach, in heutagogy the instructor also facilitates the learning process by providing guidance and resources, but fully relinquishes ownership of the learning path and process to the learner, who negotiates learning and determines what will be learned and how it will be learned (Hase & Kenyon, 2000; Eberle, 2009).

When designing a self-determined learner experience, certain considerations should be made. A heutagogical approach to learning and teaching is characterized first and foremost by learner-centeredness in terms of both learner-generated contexts and content. Course design elements that support learner-centeredness in a heutagogical approach are presented below.

    Learner-defined learning contracts:
Learning contracts support students in defining and determining their individual learning paths. These individualized contracts, such as those used at distance education institution Empire State College (see www.esc.edu), define what will be learned (e.g., scope), how it will be learned (e.g., teaching and learning approaches, learning activities), and what will be assessed and how it will be assessed (Kenyon & Hase, 2010; Gilbert, 1975; Cristiano, 1993).
    Flexible curriculum: In a self-determined learning environment, the learner is the driver in creating flexible curriculum, which is defined by the student: learners create the learning map, and instructors serve as the compass (Hase & Kenyon, 2007; Hase, 2009). Flexible curriculum in this sense is negotiated action learning, which adapts and evolves according to learner needs (Hase, 2009; Hase & Kenyon, 2007). Learners negotiate “how, when, where and to what upper (rather than minimal) level they want to take their learning” (Hase, 2009, p. 47).
    Learner-directed questions: Learner-directed questions and the discussion that results from these questions are what guide learners and serve as mechanisms for helping learners make sense of course content, bring clarity to ideas, and promote individual and group reflection (Kenyon & Hase, 2001; Eberle, 2009). Guiding learners to define self-directed questions is one of the biggest challenges facing developers of heutagogical courses, as designers must be “creative enough to have learners ask questions about the universe they inhabit” (Kenyon & Hase, 2001, para. 29).
    Flexible and negotiated assessment: In heutagogy, the learner is involved in designing his or her assessment. Negotiated and learner-defined assessment has been shown to improve the motivation of learners and their involvement in the learning process, as well as make learners feel less threatened by instructor control of their learning process (Hase & Kenyon, 2007, p. 115; Hase, 2009; Ashton & Elliott, 2007; Canning, 2010). One way of incorporating negotiation into the assessment process is through the use of learning contracts (Hase, 2009). The assessment should include measurable forms of assessing understanding of content, including whether the learner has achieved the competencies desired. Rubrics can also be used effectively in guiding learners in their self-assessment process, for example by assessing “discussion skills, quality of work, outcomes, collaboration, academic soundness and knowledge of material” (Eberle, 2008, p. 186).

Another dually important characteristic of heutagogy is that of reflective practice, “a critical learning skill associated with knowing how to learn” (Hase, 2009, p. 49).
http://www.irrodl.org/index.php/irrodl/article/view/1076/2087

Dean Shareski  has recently reflected on assessment as he teaches again his pre service online course at the U. of Regina. When I read his post, I reread the the sentence "The biggest change this term was to have my student's assessment themselves for the entire course." and I read it again. I like that and his "I really don't care much about the grade at all." as I don't either. It took me back to my learning in the 2008 MOOC-- of how much I learned, of how excited I was.

The biggest change this term was to have my student's assessment themselves for the entire course. In the past, it was required for a few assignments but not all. This term I was clear that they were going to tell me their grade and justify it. As long as their documentation was clear and from my perspective truthful, that's the grade they would receive. I suppose in some respects, I'm still assessing, assessing their assessments but my goal was to do two things. First to empower them to think deeply about their learning. While I've always advocated for reflection, I tried to emphasize more documentation. I still need to structure this better but that was my intent. Secondly I wanted the pressure of grading to be removed from learning.

I really don't care much about the grade at all. I'm interested in their documentation of learning and how I might support them and indeed provide new and better opportunities for them in the future and for my future students as well.
http://ideasandthoughts.org/2012/04/18/adventures-in-assessment/

Dave Cormier  has been talking assessment around the course he began teaching this spring. Over the years I've been learning with Powerful Learning Practice, I've become convinced as is he that "making meaning, creating knowledge, is something that happens in public". And so his students are negotiating grading contracts with him.

I’ve been lacking a way to bring a method of assessment to the course that reflects the philosophy of education I’ve been working with. The idea of saying that you understood 92% of the ‘right’ way of seeing something is the exact opposite of the way that I see this course. From a traditional perspective… I want you to cheat. I want you to ‘get the answer’ from your neighbour. I want you to tell me that you did that… but more importantly, I’m hoping that you’ll tell each other that. So the contract measures how much work you’re doing… How much you are contributing. And, if you take anything from this course, is that making meaning, creating knowledge, is something that happens in public.
http://davecormier.com/edblog/2012/05/16/why-we-work-together-cheating-as-learning/

Student work in this course is evaluated by ‘contract’ – meaning that each of you decide how much work you would like to do for what grade.
http://davecormier.com/edblog/2012/05/09/ed366-learning-contract-prior-to-student-input/

The contract grading approach, loosely speaking, is one where the student and the instructor negotiate a ‘contract’ for how that course is supposed to go.

Here is an excellent example from Cathy N. Davidson that I’ve been borrowing from. (or, as she suggests, pilfering from)
http://davecormier.com/edblog/2012/05/07/grading_contract/

I'd rather contract grading become contract learning or rather a learning contract. I'm starting to put pieces together. Learning in public, self assessment, learning contract, no talk of failure--

Cathy N. Davidson  was one of the resources to which Dave Cormier provided a link. With her contract grading the learner decides on what she/he wants or needs from the course (yes I remixed that too from "what grade"); the learner empowered to follow personal passions and needs truly resonated with me. If you follow the link below the quote, Cathy did not create her grading contracts with that in mind; yet her words "what you need or want" are important in my thinking.
The advantage of contract grading is that you, the student, decide how much work you wish to do this semester; if you complete that work on time and satisfactorily, you will receive the grade for which you contracted.  This means planning ahead, thinking about all of your obligations and responsibilities this semester and also determining what grade you want or need in this course
http://hastac.org/blogs/cathy-davidson/contract-grading-peer-review-heres-how-it-works
WHY THIS MATTERS NOW
As the facilitator for the PLP Connected Coaching eCourse  I had to submit a syllabus to NDSU; we wanted to provide an opportunity for learners to earn graduate credit if they so wished.  Required by the credentialing institution, I laid out assignments and their influence on a total grade to be earned (no points, percentages).  Not entirely comfortable with that, I've been thinking hard on ways to incorporate all that resonates with me best for learning and assure that learners in the course who seek to earn graduate credit have that option.

In addition, I wanted the course to be of value to the diverse range of educators who were interested for varying reasons. Some wanted to become PLP Connected Coaches, some were face to face coaches and wanted to learn about strategies for coaching in online spaces, some were classroom teachers who wanted to move to a more inquiry based classroom and sought insight on facilitating communication. Some were in it to go deep; others more on the surface. My quandary, a way to facilitate deep learning that met the needs of everyone, remained true to the inquiry based model of the course, and promoted self governed learning.

HERE'S MY REMIX
Adapted, adopted from those who have gone before me, with a lot of Lani sprinkled throughout, I requested that all learners create a learning contract. Really anxious, very much believing in it's potential, yet still nervous I posted this and asked each learner to post theirs in our asynchronous virtual space.
Here it is: https://docs.google.com/document/d/1qWQgDmtsJflNfLbS3OaJHHg2h-YtjRCBWHtauQSVSZY/edit

It's not perfect. I haven't figured out how to give those taking the course for credit more options although I have personally encouraged them to add their own personal learning goals, to negotiate percentages for the graduate assignments, to create a timeline for demonstrating their learning that best meets their own personal schedule within the time limits of the course. I've asked them to determine how they will show evidence of their learning and to assess themselves using strategies of their own choosing. In the end, the reality is, I have to submit a grade; we'll Skype or phone; and if there is a need, we'll negotiate--  I am feeling at this point, this is a step in the right direction. If it proves to be of value in the learners' eyes, I will attempt to modify the syllabus for the university to more closely reflect this philosophy of learning.

AND THEIR INITIAL REACTION

2 weeks of learning in, I asked for initial reactions (yes I remain anxious and nervous, very much wanting this to be of value) in a recent webinar. Participants placed red stars on the value line on the whiteboard to indicate their feelings. This coupled with comments -- "scary but valued, learning about me,respecting the learner" --encourage me.




Stay tuned-- In late August when the formal course time for learning has come, I'll be back here sharing what I learned, what we learned --

 Image: 'Thinking & Playing'
http://www.flickr.com/photos/43433634@N05/6919665797

No comments: