Thursday, November 23, 2017

PBE part two - The Gist of the Problem

For those whose states haven't yet been jumping on this bandwagon, what is PBE?  PBE is short for Proficiency-Based Education, sometimes called Standards-Based Education (SBE).

The gist of PBE is that education should be structured around knowing and understanding the Big Ideas, being able to do and perform those Important Skills, becoming students who learn and retain because they understand what the school was teaching.

There are several things that have pushed this initiative; most of the concerns are with the fact that so many kids seem to drift through high school (and especially HS math) without actually retaining anything. Of course, many students passed because they deserved to, because they understood the material and were ready for the next level. On the other hand, students have also "passed" by:
  1. being good at only a few topics but their average was above a 60.
  2. sitting like a lump and getting passed on. "It's all about Seat Time."
  3. bringing a pencil everyday, always handing in homework (even if they didn't actually learn anything from it) and having good attendance. "She's a GOOD kid."
  4. expending "Great Effort". "He really tries HARD."
What other problems were there with "traditional methods"?
  1. Courses are comprised of a few Big Ideas and a lot of filler that has gathered in the margins over the years. Reformers argue that we should focus on those Big Ideas instead of on the filler.
  2. What's so special about 120 hours of class-time? What if a kid needs 135 or only 80 to master the material? Reformers ask why every class goes for 180 days, 45 minutes a day.
  3. Teachers giving some kids a passing grade allowing them to move on to Algebra Two, just to get rid of him or to allow him to graduate.
  4. You don't measure understanding of a concept by simple repetition of a question. 
  5. Percentages are more precise than accurate. 
  6. Fine-grained reporting leads to a "Horse-Race" mentality in students and parents. "I'm better than you by a point." 
  7. Marking a question as 4 points out of 5 is less informative than a comment or some type of written feedback.
  8. Learning is a process that shouldn't be measured only once. Practice shouldn't be included in the grade, especially if the student had help.
Some of these claims are bogus, of course. Most are not.

Let's be honest here. There are a lot of adults who walk into meetings who begin by saying "I was never very good at math." There are memes aplenty that laugh at us math teachers saying "I've never had to factor a trinomial in my career. Everything I've ever done was done with 7th grade math."

Students have their own version of this game, "When am I ever gonna have to use this?" and then they promptly shut down if the answer doesn't fit into their narrow view of their future life and career.

Reformers claim, "Clearly something isn't working."

Despite the fact that the most important problems that exist in traditional education won't be solved by switching to PBE, the switch is worthwhile in my view.

The most important problem is that someone has to subjectively measure the student's performance.
This has been the problem for centuries and it won't change. There are so many ways that this judgement can be altered, massaged, changed, or mangled.

Every teacher knows it.
  • "Why did you give that grade to my kid?"
  • "You can't fail a kid if you didn't contact the parents."
  • "She didn't deserve that grade. She worked so hard."
  • "Do you really want him back in your class for another year? He's taken this same course two times already."
  • "If I fail this class my parents are going to kill me."
  • "Did you tell his parents every week that he wasn't doing his work? I don't see any record of this in the contact log."
  • "What are you going to do to help him pass?"
  • "Why didn't you assign him to afterschool help?"
  • "My son was always the best in his class in math, until he had you."
  • "I looked at her test. She should have gotten full credit on this question, and that one isn't wrong. You have to give him a 90."
  • Sometimes it's less subtle: "I'm gonna break your fucking arms if you fail my son. He only needs this one fucking math credit to graduate. I know where you live. I'm going home to get my gun."
These problems remain, no matter the system.

Under PBE, however, we have an opportunity to reframe education. We're going to measure only what they know, and focus on the Big Ideas.
  • Random quizzes on the way to understanding don't count. Only understanding counts.
  • Homework that was done with other people's help doesn't count. Only understanding counts.
  • The "Gentleman's C" is no longer a thing.
  • "Pity points" is no longer a thing.
  • "Extra Credit" is meaningless.
  • A 90% on Order of Operations can't mask a 50% on linear functions.
  • No more marks of 89.5% being considered "better" than 89%.
  • No averages of 60.001% just to allow a student to pass.
Can we do it?

Maybe.

or maybe not.

Sunday, November 19, 2017

PBE part one - getting started

This is the first of several posts about PBE, Proficiency-Based Education. I am trying to set down my understandings and beliefs, give some advice from my (very) limited experience, and lay a groundwork for improving what we're doing in my school and in my state of Vermont.

I plan to discuss what I think my school is doing right, what I think they are doing wrong, and try to find the best answers that I can. Who we are is irrelevant; the entire state public school system is under mandate from the VT AOE to make the change to PBE in order for the class of 2020 to graduate having had four years of high school PBE.

Yep. We are a year behind. We, and almost every other school I know of, have been procrastinating badly. We've spent 4 years on this so far, and been required to write only four modules for our courses because teachers whine "We don't know what you are asking us to do" and, since the person in charge of PD doesn't really know what the end goals should be and what PBE looks like in practice, we waste lots of time making empathy maps, rating and watching videos that are demonstrably ridiculous, and other tasks that don't really advance the program.

The State A.O.E. reps have openly admitted that they have no idea about how this will work. When I ask for sample transcripts, I get "We don't know. This conference is for you teachers to tell us what a typical graduate should be able to do and be." Ask for sample curricula, or sample frameworks, or sample anything and you get "We can't tell you because we don't have any of that and you have local control." That law was passed four years ago and this conference was one month ago!

Much of the Vermont AOE website focuses on convincing people that this is a good idea, rather than on what this idea actually should look like in practice. Here, you can look for yourself.

The Supervisory Union has openly admitted that they have no real idea of how PBE is supposed to work. "We're not sure. Nobody has done this before. We're on the cutting edge. We don't know what the Graduation requirements should be -- you teachers have to decide. Write your modules to this template, but we're not going to look at them critically - you have to do that."

The principal and other school administration are just as much in the dark but, to their credit, are willing to let teachers do this exploration and possibly fail on our way to succeeding.

I'm going to focus at first on what I feel PBE should be and why I feel it's a good idea, then on some of the things that are really making this transition problematic and may end up destroying the initiative and ruining the educations of many students in the meanwhile.

Hopefully, this exploration will prove useful to both of us.

Another Problem with Computer-Based Learning

I am not a fan of computer-based courses except when the alternative is nothing. If the choice is Moodle or nothing, then Moodle wins, but it's not a great solution. Even a mediocre teacher is better than an online course. Charter schools who offload the majority of teaching onto computer programs are doing a real disservice to their students. Computer programs are far too often limited in what they accept as correct answers, too limited in their explanations, and not particularly well thought out.

Style and colors win out over physics.

The example that prompted this note is below. In the exercises for an online edition of a physics textbook, there was this unit conversion problem that asked students to convert km/hr to m/s, a fairly simple but important task. The student had to drag and drop circles onto a fraction structure - the task was to replicate this pattern:


This is the only acceptable answer, however. Any different arrangement was deemed incorrect:


Those "Learn more" links simply repeated the advice to convert the length measurement first without ever giving any reasons why the fractions should be in that order.

It's programmed that way. No exceptions allowed, even if they are correct.

The worst part? It hasn't been fixed. I sent a note three months ago. This content was written and published at least four years ago. Why the holdup?

Friday, October 13, 2017

Consistency of Message

Short speech this afternoon included the following statement:
"We believe that all students should be able to take any or all AP courses at our school."

This was the concluding talk of a day-long conference on Proficiency-Based Education which has as one of its guiding tenets that
"Students should not progress to the next proficiency until they have mastered the first one and should not be allowed to move from course 1 to course 2 until they have reached proficiency in all of the predetermined areas in course 1."
These two statements seem to directly contradict each other, yet both were met with applause and approval from the assembled. How can you take AP Calculus if you haven't reached proficincy in the topics of precalculus, and before that in algebra 2, and before that in geometry, and before that in algebra 1?  (Granted that the geometry course is not strictly in that place across the country.)

What am I missing?

Wednesday, September 20, 2017

More PBE Idiocy

My school is implementing Proficiency - Based education this year. (Some people call it Standards-Based Grading)

We're behind the curve; the State of Vermont has decreed that ALL schools in Vermont will be using PBE so that the Class of 2020 will have had four years of PBE by the time they graduate. That's this year's sophomores.

Yes, that means we're a year behind. Our school's faculty made the decision last May to push forward with this initiative against the wishes of the SU -- we didn't want to wait two more years to begin, putting us three years late according to the directive from the State.

Our reasoning was that, if this is truly a Good Thing, then why should we wait to put it into place?

But our supervisory office and it's IT staff are hopelessly unready. Incompetent isn't a unfair characterization. They have no transcript format ready to go, no sense of how to ascertain academic ineligibility, etc.

So we faculty are doing it for them and fighting against their bad decisions the whole time.

Faculty: "Don't average proficiencies. In fact, don't even think of them as percentages."

"Hold my beer," they said.


Faculty: "Wait, you shouldn't do that ... and what's with the gaps between the levels? .... and what's with 'Not Attempted' being 0% to 15%?"

SU: "Uh, we don't know, and we don't know how to change it."
Faculty: "If you insist we keep percentages AND that they must average, would you at least fix the gaps?"

SU: "Uh, we don't know how to change it."
SU: "Uh, leadership team needs to make that decision."
SU: "Uh, it's your fault for moving too quickly."

Faculty: sigh.

SU: "Uh, you know there's two different scales, right?"

Faculty: "Wait, what? That's ridiculous, and wrong on so many levels. No one would do anything that stupid."

SU: "Yeah, check this out. Hold my beer."


Faculty: "Okay, so the percentages are the same but why is it called Approaching in this scale and 'Nearly' in the other?"

SU: "We thought it would be fun to change it two days before school starts, but not everywhere. You'll randomly see one or the other."

Faculty: "Whaaaat?"

Faculty: "By the way, if I enter a 3 out of 4, I get an NP. It should be Four Levels means One thru Four, but it isn't working that way. Please explain that."

SU: "Uh, we don't know what you're talking about and we don't know how to change it."
SU: "But, we just figured out that if you use a 5-point scale, and enter a 4 out of 5, then you'll get proficient. Think of it as a feature."

Faculty: "You went out of your way and insisting that it was four levels, not five. Would you please get it straight?"

SU: "BTW, did we mention there's a third scale? Check this out!"



Faculty: "WTF is with those percentages changes?"
Faculty: "If I enter a 3 out of 4, I get an NP again. Please explain that. While you're at it, why is 'Emerging' now 0%-50% instead of the 15%-45%?"

SU: "Uh, we don't know what you're talking about and we don't know how to change it, but all three are active in your gradebook at the same time."

Faculty" "Are you serious?" 

SU: "Yep. We're kinda proud of all the work we've done."

Faculty: "It's been all different, the kids and parents are fuming, and we're going back over everything and rescoring everything to make things consistent. THIS HAS NOT BEEN HELPFUL."

SU: "Don't be ungrateful ... BTW, you know how you asked that all of the Common Core State Standards for math be put into the gradebook?"

Faculty: "(Nervously) Um, yeah?"

SU: "We changed the names of each one of them."

Faculty: "Keep your goddamn beer."

Sunday, September 17, 2017

Don't Average Proficieny-Based Grades

Either you are proficient or you are not proficient.

You can pretend to other "Levels" but that is the crux of standards-based education, or Proficiency-Based Education as it has been recently renamed.

What you can't do is assign a percentage to each level, then average them to get an average proficiency, then average the proficiencies to get a final score.



How is "Nearly Proficient = 70%" even valid? Right, it isn't, but in the exciting world of education, there's a difference between what the state of Vermont mandated and what our school is doing and what the superintendent and the district chief IT person seem willing to support.

So we get to start the year with everyone up in our shit over Proficient being a 75% ... and instead of eliminating the percentages, they changed it to 80% hoping that parents and students would shut up and return to their homes.

Can we turn off percents already?

Friday, September 8, 2017

The Students You Have

Periodically, one hears the clarion call:
"Raise Your Standards and the Students will Rise to meet them!"

Bull.

To paraphrase Dick Cheney:
"You teach the kids you have, not the kids you wish you had."

(Dammit. The history teacher reminded me that it was Rumsfeld.)

Saturday, July 15, 2017

Education Research, part 2

<adminfantasy>
Peer Tutoring is great. All the best teachers set it up in their classrooms. Research says it raises achievement. After all, studies prove that "Teaching something is the best way to learn it."
</adminfantasy>

I personally hate it. I've hated it since 7th grade when teachers started "encouraging" me to tutor other kids. I hated it in high school because I always got paired up with kids I didn't like or who resented that I was smarter than they were. Call me selfish? Tough shit; I was a teenager. It was NOT MY JOB. Teenagers have enough stress in their lives.Telling them they're responsible for some meathead's education? Oh, yeah, that is a *great idea*.

I won't require anyone to do it. EVER.
Purely voluntary, "working together"? Absolutely.
Homework club? Bring it on.
Labs? I'll encourage collaboration but if a student wants to go it alone, I won't stop them.

<adminfantasy>
But studies show ...
</adminfantasy>

From dcox, Research is great until you have to use it.
The EEF toolkit rates ‘peer tutoring’ as having a positive possible effect. I could see this and tell my staff ‘I want to see ‘peer tutoring’ in all your classes because that will enhance learning by ‘+5’ months.
However, the evidence behind this summary wouldn’t support this action. It specifies that the tutoring is most effective with cross-age tutoring, with two years between the students. That wouldn’t be the case in one class in the UK.
And crucially it also states:
‘Peer tutoring appears to be less effective when the approach replaces normal teaching, rather than supplementing or enhancing it, suggesting that peer tutoring is most effectively used to consolidate learning, rather than to introduce new material.’
Research in the wrong hands and with superficial or no in-depth analysis can be dangerous….


John Hattie's Visible Learning is a great tool but you've got to pay attention.

Perhaps Dan Willingham's Bill of Research Rights for Educators is appropriate here.

Sunday, June 11, 2017

The Problem with Education Research

"Education Research." Even in these times of political ignorance of research, science, and fact-based decision-making, there's still a place in every American's brain for education research.

It's probably due to the ever-present mantra of "Won't somebody PLEASE think of the children?" coupled with an ferocious need to believe that one's own children would be superstars if only the damned teachers weren't so terrible. Parents tweet, post, and search for information about "best-practices", proCCSS or anti-CCSS, pro-disease or pro-vaccination, in a desperate search for confirmation that they have a brilliant child.

The problem, of course, is that the searchers don't connect with the research.

Linda Graham, in an article on TES, Teachers Need to Trust Research Again, complained that
Just over a year ago, I was disturbed to read the suggestion – tweeted by a teacher attending a ResearchED conference at the University of Cambridge – that education academics should be made to pay schools for access to research participants. I was shocked because education research was clearly not being perceived as a public good; something we should support in the way that we do other forms of research.
I'll say this: it takes a certain chutzpah to complain that education researchers should be any different from others and pay subjects for their time. If you can't do that, then the taxpayer funded research based on studying taxpayer's kids in taxpayer-funded schools should at least be made available to read after its completed, without a $49.95 access fee. It's not that I think this research is a public bad, it's that few understand it and I want to see that it says and means what those above me think it says and means.

This giant game of "telephone" is getting frustrating. I've named it the "Workshop Effect". Here's how it works:
  1. Educational researcher (e.g., Kamii) presents results from her research (e.g., examining 3rd and 4th graders and the appropriateness of the common algorithm for subtraction) at large conference with consultants and workshop presenters in attendance. These folks take notes. Some completely understand what's being said, others less so. Not everyone is an elementary school teacher with a nerd-on for math.
  2. Consultants and presenters then travel, collecting $3000 for a day's workshop in Central Vermont. The presenter has collected several sets of research results and displays them all. Superintendents and Principals from K-12 are here because that's $3000 and "let's make the most of it."  They pick up some details to bring back.
  3. High School Principal hold faculty meetings or PD and mandate that "Research has shown that students should not be taught the common algorithm for subtraction." 
  4. Curriculum coordinators and teachers spend months adapting curriculum to the new paradigm. Anyone who objects, or wants verification, is called "Anti-Team Player", a "Naysayer", a "Curmudgeon", or is criticized or written up for "not obeying District policy."
And that's how the rot begins.  Why should my 10th grade Geometry students be bound by research on third-graders, research that expressly states that it is done on 3rd graders? Nothing in the paper said that extrapolating 7 or 8 years held any meaning.
Underlying much of the critique of research in education is the charge that it doesn’t tell stakeholders “what works”. My first objection to the “what works” mantra is that this is based on a very insular view of what is important in education. My second objection is that it completely discounts the importance of researching what doesn’t work, particularly from the viewpoint of the largest stakeholder group: students. Nonetheless, the value of research in education is increasingly being judged in relation to the “what works” agenda: if something works, then there must be evidence to prove that it works. If there isn’t evidence (perhaps because the research is not about what works but what doesn’t), then that research has no value.
Maybe the criticism that Graham reads is like this, but mine is over not being able to see the original documents. I am not going to spend the money to download and read this research. I only got the Kamii paper because someone sent it to me (Grant Wiggins, Dave Coffey, Bowen Kerins? I can't remember). I understand that research often is intended to find a connection, a correlation, and that a cause is more elusive. I understand that sometimes we need to run the same study again and again to confirm (or not) previous findings.

The problem is in the interpretation and filtering that happens between the researcher and the teacher. What did the research actually say, and what can I actually take from it?
Teachers are now being encouraged to “challenge” education researchers for “evidence” to support their views. That’s OK – if the request is accompanied by an understanding of the research process and how knowledge is accumulated.
Sure. It's called peer-review.

It would be nice to be able to tease out findings instead of leaving it up to the ex-fifth grade teacher - turned curriculum coordinator.

Publish your work or face the criticism.

If you'll excuse me, I've got to get back to work.

Thursday, May 18, 2017

Please Stop Saying it, part 6

Things we really need you to stop saying, part 6.


Fun Fact:
"What you get out of it depends on what you put into it."

I'm their teacher, not their counselor. I agree that I can't be an asshole, but I'm here to teach and they're here to listen, learn, practice, contribute.

Otherwise, don't go to college.


"They won't care how much you know until they know how much you care."

We really need you to stop saying that.

Monday, May 15, 2017

Things We're really going to Need you to Stop Saying, 5b

part 5, update:

It's a goddam supercomputer. Why don't you just put it to use?
  • Look things up.
  • Calculator. If you turn the calculator sideways, it becomes a scientific calculator.
  • Desmos.
  • WolframAlpha.com
  • Formative Quizzes.
Then, they can put it aside and you can be a normal teacher with your worksheets. (I'm not being sarcastic. There's nothing wrong with worksheets for practicing a skill in isolation.)

The phone is just a TOOL. Use it for a purpose. Students need to experience when to use a TOOL and when not to. 

Sunday, May 14, 2017

Things We're Going to Need You To Stop Saying, part 5

False Dichotomy, aka. Twitter Broadside

Education seems to be full of these things, but perhaps they're in every business and I'm only paying attention to education. You see them often, pithy statements that fit into 140 characters by eliminating all the gray area and reducing everything to black or white extremes of "The Right Way" vs "What You're Doing". Often well-meaning but ultimately harmful:

If your exam questions can be googled, then you're asking the wrong questions.

Google is useful for information, less so for understanding. Googling the answer doesn't "show your work" and, given the nature of the Internet, isn't particularly trustworthy.

If kids in your class are more engaged by a fidget spinner than they are by your lesson, the spinner isn't the problem. Your lesson is.

Learning is hard. Kids fidget. Fads come, then go. Your lesson doesn't suck simply because two kids out of 25 are fiddling with this thing.

If your exam questions are multiple choice, then you aren't asking the right questions in the right way.

There's always a place for quick, multiple choice questions, even on summative assessments.

If your exam questions only use integers then they aren't Real World(tm) Questions.
If your exam questions require a calculator, then you're asking the wrong questions.

Integral answers allow students to show their work, are useful to the learning process because the arithmetic is secondary to the learning. Integral answers can also encourage students to search for different solution methods. Decimal answers that require a calculator are great for Real-World data but Real-World data is often confusing and isn't usually appropriate during the learning process. Learn first, then use the learning. Calculators make guessing too easy and encourage kids to waste time with it.

If you are asking questions at all, then your students aren't agents of their own education. 


This is just silly. Teachers are there to teach. Sometimes the students "lead" the class down the carefully prepared road through the weeds ... but the teacher has laid the groundwork for that.


I am really tired of this nonsense. These blanket statements that reduce the complex world we teach in to just two colors (what you're doing and the right way) are unnecessarily reductive. It encourages simple-minded extremist fads that wither away after a couple of years of damage to children's education.

It's a false dichotomy and we're really going to need you to stop saying it.

Tuesday, May 2, 2017

Repoped Search

Just what is a Repoped Search anyway?

Assuming its for a teacher ...


Ah, yes. I always wanted that job, but I wonder why no one has noticed it yet? It doesn't make applying there very appealing.
"Windsor Schools, in Windsor, Vermont is in search of a high school Geometry teacher to join our middle and high school math department, beginning July 1, 2017. Windsor Schools is a PreK-12 educational facility and implements the Eureka Math Program across all grade levels. All candidates must have a current Vermont Educator's License. Experience and familiarity with the following is preferred:
-Universal Design for Learning
-Habits of Learning and Vermont's Transferrable Skills
-MTSS
-PBIS
-Effective Communication and Collaboration

Perhaps a candidate with proofreading skills, as well?