Archive

Posts Tagged ‘race to the top’

Don’t Rely on Rigor and Relevance

So many educational leaders have jumped onto the Rigor and Relevance bandwagon

Political and Economic Context

Since the publication of A Nation at Risk in 1983, public schools have felt mounting pressure to increase the levels of instructional rigor and academic success for all students. The No Child Left Behind (NCLB) legislation, signed into law in 2002, has forced states to reevaluate their standards and assessment programs according to federal criteria, and adjust to the adequate yearly progress (AYP) provision of NCLB. The American Recovery and Reinvestment Act of 2009 (ARRA) and now the Race to the Top funding has brought additional federal carrot and stick measures to induce states to follow federal guidelines and initiatives.

Concurrently, concerns about the growing Achievement Gap, especially with respect to underperforming African-American and Latino sub-groups have come to the national consciousness. Traditionally liberal voices have begun supporting traditionally conservative, anti-public school proposals such as charter schools, open enrollment, vouchers, and teacher accountability-via-assessment. The Obama Administration and U.S. Department of Education support these initiatives. The National Education Association is reeling.

For example, the ARRA funds are to be used to improve student achievement and close the achievement gap through “shared commitment and responsibility.” What is this process defined by the federal government?

  • Adopting rigorous college- and career-ready standards and high-quality assessments
  • Establishing data systems and using data for improvement
  • Increasing teacher effectiveness and equitable distribution of effective teachers
  • Turning around the lowest-performing schools
  • Improving results for all students, including early childhood learning, extended learning time, use of technology, preparation for college, and school modernization http://www.irs.gov/newsroom/article/0,,id=204335,00.html

In other words, more and more governmental accountability and less autonomy for school districts, administrators, and teachers.

School districts are failing during the current economic downturn. Deep in debt, districts are enacting furlough days with the consent of powerless teacher unions. Compromises are made to ensure some sort of survival. Districts and teachers are devolving more control to states and the federal government for money to keep afloat. Public education is in crisis mode.

Academic Context

As a precursor to this crisis mode, the in vogue educational leadership trend was the Rigor and Relevance Movement. Popularized over the last decades by Bill Daggett and the International Center for Leadership in Education, with concurrent support from the Institute of Education Sciences (the federal research agency) arm of the U.S. Department of Education, the movement has swept the nation. Largely as a result of historical timing, the Rigor and Relevance (and now, relationships) Movement has become the de facto solution to the ills of public education. Administrators and teachers throughout the United States are using the Rigor and Relevance quadrants to analyze instructional effectiveness.

A Few Working Definitions

Although the movement is pervasive, it is not monolithic. No one holds the trademark on the terms rigor and relevance. In fact, rigor is variously defined. Some define rigor in terms of end-goals, such as high standards or high expectations. Others define rigor as a set of competences as measured by high stakes assessments. Some cross-over adherents from the Essential Schools movement have defined the term as the mastery of educational concepts. Often, the term is defined in terms of process-goals. Instructional methodologies are featured prominently in discussions about rigor. Bloom’s Taxonomy is a favorite, as well as any instructional strategies that elicit critical thinking, deep understanding, exploration, and research.

The usage of relevance also varies. Relevance for students refers to interdisciplinary and contextual learning situations directly connected to real-world problems ranging from routine to complex. Relevance for teachers and administrators implies establishing a vision and mission, and moving forward on school improvement and change initiatives that have purpose and are focused on the agreed-upon needs of that particular school and student population.” http://rebel6.blogspot.com/2010/01/3-rs-not-just-for-students.html David Britten January 3, 2010. So, relevance refers to real-world applications, as well as to the needs and interests of student and school cultures.

Critique of the Rigor and Relevance Movement

As is frequently the case, any educational reform movement produces nuggets that can and should be mined by thoughtful public school stakeholders. However, the harder-to-mine gold often remains, as the placer (surface-level) gold is depleted.

Rigor

Much of what passes for rigor is arbitrary, subjective, and contrived.  For example, proponents of rigor usually align themselves with those who advocate standards-based education. Such standards beg the question on many fronts. Why don’t states all agree on the same standards, if there is such a broad educational consensus as to what they should be? What happens when the consensus changes? Which standards are most/least important? Do standards really reflect broader educational priorities, such as can the student read, write, do math, and think well? What prerequisites are necessary to demonstrate mastery of the standards? Why are certain standards appropriate at certain grade levels? Who decided that a standard is a standard and for what reasons?

Rigor that is not arbitrary, subjective, and contrived consists of instructional content and strategies determined through direct diagnostic and formative assessments of individual students, not arbitrary “Below Basic,” “Basic”, “Proficient,” or “Advanced” categorizations derived from annual standards-based assessments. Although we teach subject matter (content), we also teach children. Rigorous  teachers find out what students need and differentiate instruction to match those needs. Students experience success by successive approximation. Teachers challenge students just enough to help students take risks, but not too much to overwhelm them. Success builds upon success.

Relevance

Much of the renewed interest in relevance has developed from panic-attack reactions to the highly publicized Achievement Gap. Well-intentioned, teacher-induced guilt brings the “it must be my fault that I am not meeting student needs” response. Teachers rush to develop “real-world” career applications to lessons on primary numbers. Teachers ditch archaic Shakespeare for analyses of current hip hop songs. Teachers spend inordinate amounts of time establishing a motivational framework to convince students to memorize the scientific method or key elements from the Periodic Table of Elements. Teachers drop rules of classroom decorum to be culturally sensitive to students who have the proclivity to engage in impulsive outbursts.

Perhaps another view of relevance should be considered. Renowned reading researcher, Anita Archer, categorizes the Achievement Gap as largely a misnomer. She says what we really have is a “literacy gap.” I tend to agree. Until we address this fundamental issue, issues such as instructional strategies to establish relevance are futile. In fact, content literacy should be the true means of attaining educational and personal relevance. Relevance becomes a by-product of educational success, not a series of instructional strategies designed by well-intentioned educators.

Intervention Program Science of Reading

The Science of Reading Intervention Program

The Science of Reading Intervention Program: Word Recognition includes explicit, scripted instruction and practice with the 5 Daily Google Slide Activities every reading intervention student needs: 1. Phonemic Awareness and Morphology 2. Blending, Segmenting, and Spelling 3. Sounds and Spellings (including handwriting) 4. Heart Words Practice 5. Sam and Friends Phonics Books (decodables). Plus, digital and printable sound wall cards and speech articulation songs. Print versions are available for all activities. First Half of the Year Program (55 minutes-per-day, 18 weeks)

The Science of Reading Intervention Program: Language Comprehension resources are designed for students who have completed the word recognition program or have demonstrated basic mastery of the alphabetic code and can read with some degree of fluency. The program features the 5 Weekly Language Comprehension Activities: 1. Background Knowledge Mentor Texts 2. Academic Language, Greek and Latin Morphology, Figures of Speech, Connotations, Multiple Meaning Words 3. Syntax in Reading 4. Reading Comprehension Strategies 5. Literacy Knowledge (Narrative and Expository). Second Half of the Year Program (30 minutes-per-day, 18 weeks)

The Science of Reading Intervention Program: Assessment-based Instruction provides diagnostically-based “second chance” instructional resources. The program includes 13 comprehensive assessments and matching instructional resources to fill in the yet-to-be-mastered gaps in phonemic awareness, alphabetic awareness, phonics, fluency (with YouTube modeled readings), Heart Words and Phonics Games, spelling patterns, grammar, usage, and mechanics, syllabication and morphology, executive function shills. Second Half of the Year Program (25 minutes-per-day, 18 weeks)

The Science of Reading Intervention Program BUNDLE  includes all 3 program components for the comprehensive, state-of-the-art (and science) grades 4-adult full-year program. Scripted, easy-to-teach, no prep, no need for time-consuming (albeit valuable) LETRS training or O-G certification… Learn as you teach and get results NOW for your students. Print to speech with plenty of speech to print instructional components.

SCIENCE OF READING INTERVENTION PROGRAM RESOURCES HERE for detailed product description and sample lessons.

Reading, Writing , , , , , , , , , , , , , , , , ,

Response to Intervention: What Doesn’t Work

Having served as a reading specialist at elementary, middle, and high school levels (and even part-time at the community college level), I have taught numerous reading and writing intervention courses and trained teachers to doing so. With the new emphasis on Response to Intervention (RtI) voices of real-world teaching experience need to begin shouting quickly and boldly to be heard. Although I commend the International Reading Association (IRA) for assigning reading assessment a prominent role in their Response to Intervention (RtI) document; however, the language of the document betrays certain pedagogical presuppositions and is, at points, flat unrealistic. For reference, the document is found at  Let’s take a look at one section of this document to see if my analyses ring true.

On page two, the IRA Commission lists these guiding principles under the subheading of “Assessment”:

“Assessments, tools, and techniques should provide useful and timely information about desired language and literacy goals. They should reflect authentic language and literacy activities as opposed to contrived texts or tasks generated specifically for assessment purposes. The quality of assessment information should not be sacrificed for the efficiency of an assessment procedure.”

Clearly, the commission has in mind the content, form, and delivery of diagnostic, formative, and summative assessments, particularly reading assessments.

Presupposition #1 Authentic Text is Better than Contrived Text for Assessment Purposes

Since when did reading assessments have to use authentic language? As a writer of numerous reading and writing assessments, contrived text is often essential to produce an effective assessment. In fact, it is nigh on to impossible to create assessments with internal validity that don’t use contrived text. Good assessments isolate variables to ensure that we really do test what we are supposed to be testing.

One example should suffice to demonstrate how unworkable and unreliable authentic language can be when used for reading assessments. At random, I opened up to the middle (pp. 679-680) of one of my favorite novels: Fyodor Dostoyevsky’s The Brothers Karamazov. I skimmed to find the beginning of a start-to-finish passage of typical length for a one-minute fluency assessment and copied such below.  Feel free to time your reading out loud, keeping track of word attack accuracy, unknown vocabulary, and comprehension as you read.

‘Glory be to God in Heaven,

(6) Glory be to God in me…

(12) ‘That verse came from my heart once, it’s not a verse, but

(24) a tear…. I made it myself… not while I was pulling the captain’s

(37) beard, though..’

(39) ‘Why do you bring him in all of a sudden?’

(49) ‘Why do I bring him in? Foolery! All things come to an

(61) end; all things are made equal. That’s the long and short of

(73) it.’

(74) ‘You know, I keep thinking of your pistols.’

(82) ‘That’s all foolery, too! Drink, and don’t be fanciful. I love

(93) life. I’ve loved life too much, shamefully much. Enough!

(102) Let’s drink to life, dear boy, I propose the toast. Why am

(114) I pleased with myself? I’m a scoundrel, but I’m satisfied

(124) with myself. And yet I’m tortured by the thought that I’m a

(136) scoundrel, but satisfied with myself. I bless the creation. I’m

(146) ready to bless God and His creation directly, but… I must

(157) kill one noxious insect for fear it should crawl and spoil life

(169) for others…. Let us drink to life, dear brother. What can be

(181) more precious than life? Nothing! To life, and to one queen

(192) of queens!’

(194) ‘Let’s drink to life and to your queen, too, if you like.’

(206) They drank a glass each. Although Mitya was excited

(215) and expansive, yet he was melancholy, too. It was as though

(226) some heavy, overwhelming anxiety were weighing upon

(233) him.

(234) ‘Misha… here’s your Misha come! Misha, come here, my

(243) boy, drink this glass to Phoebus the golden-haired, of tomorrow

(254) morn..’

(255) ‘What are you giving it him for?’ cried Pyotr Ilyitch, irritably.

(266) ‘Yes, yes, yes, let me! I want to!’

(274) ‘E — ech!’

(275) Misha emptied the glass, bowed, and ran out.

(283)

Words Read in One Minute ____ – Miscues = ____ Net Fluency Score

How did you do? Difficult passage? Not so, according to the Flesch-Kincaid readability scores: Reading Level 1.1  Reading Ease 94.6. Average Word Length 4.0.

As illustrated above, using authentic language is far from an accurate means of assessing one’s fluency. Would you use this 1.1 grade level passage as a diagnostic assessment and follow with a Dr. Seuss 1.1 grade level passage to formatively assess progress two months later? Of course not. Most real-text reading passages of a length suitable for fluency assessments have similar variables as in the Dostoyevsky passage above: They are necessarily out of context and they include unfamiliar language, including names, idiomatic expressions, vocabulary, and culturally-based word choice.

Authentic text does not meet the standards of reliability we need to measure baseline ability or growth. The results cannot be generalized in any meaningful way. Even using the same source for subsequent fluency assessments provides no guaranteed compatibility. Most importantly, authentic language does not give the reading diagnostician the information needed to differentiate instruction. We need to isolate variables with contrived text to insure that we are using accurate reading assessments to inform our instruction. And this is true with all forms of reading assessments, including reading comprehension and phonics (mysteriously not even mentioned in the RtI document) diagnostic instruments. How could a comprehension test effectively measure how much a third-grader understands without using a controlled vocabulary? How could a phonics test measure a sixth-grader’s ability to decode without using nonsense words to isolate the variable of sight word knowledge?

Presupposition #2 Quality Assessments Must be Inefficient

On page two, the IRA Commission lists these guiding principles under the subheading of “Assessment”:

“Assessments, tools, and techniques should provide useful and timely information about desired language and literacy goals. They should reflect authentic language and literacy activities as opposed to contrived texts or tasks generated specifically for assessment purposes. The quality of assessment information should not be sacrificed for the efficiency of an assessment procedure.”

Now, the commission does not say that quality assessments must be inefficient, but by their own criteria they effectively preclude efficient assessment design, form, and delivery. See their referenced document: Standards for the Assessment of Reading and Writing developed jointly by the International Reading Association and the National Council of Teachers of English (2010) a a case in point.

It would seem that the IRA Commission wants to have its cake and eat it, too. The commission equates assessment quality with authentic language testing. Authentic language testing involves long in-context reading passages, whole-to-part (e.g. miscue analyses), no nonsense words, multiple measures, etc. and necessitates individual administration. Ever done a complete Individual Reading Inventory?  Pretty time-consuming—hours for an individual student. Individualized assessments require significant training to both correctly administer and accurately interpret results. Inefficient and flat unrealistic. Job protection for reading specialists, special education teachers, and reading coaches?

Although using inclusive language to encourage teachers to be responsible for diagnostic assessments and progress monitoring, the real-world application of the above RtI principles would be to maintain the status quo:

1. Reading specialists, special education teachers, and reading coaches as the “keeper of the keys” and 2. Intervention instruction based upon canned-all-students-start-on-page-one programs, rather than upon diagnostic assessments that will enable teachers to differentiate instruction.

In the real world, there is not enough time to assess students, according to the IRA principles. Teachers do not have the requisite training to assess, interpret data, and accurately inform their instructional decision-making, using the inefficient authentic language assessments. In fact, many of the teachers assigned to reading intervention classes are not the most experienced teachers.

My suggestions? Let’s leave our presuppositions behind and live in the real world. Let’s get off our high horses and train teachers to use simple whole-class, multiple-choice diagnostic reading assessments, so that they can effectively differentiate reading instruction for their intervention students. Sacrifice authentic language? Have a negligible impact on accuracy (debatable) by assessing whole-class? Oh, well… well worth the sacrifices, if teachers will be able to use assessments to inform and differentiate instruction for their intervention students.

Here are some free diagnostic assessments, created by a team of reading specialists, that are user-friendly, simple to score and analyze, and designed to enable teachers of all levels of expertise to differentiate reading instruction: assessments Now, that’s RtI that does work.

Intervention Program Science of Reading

The Science of Reading Intervention Program

The Science of Reading Intervention Program: Word Recognition includes explicit, scripted instruction and practice with the 5 Daily Google Slide Activities every reading intervention student needs: 1. Phonemic Awareness and Morphology 2. Blending, Segmenting, and Spelling 3. Sounds and Spellings (including handwriting) 4. Heart Words Practice 5. Sam and Friends Phonics Books (decodables). Plus, digital and printable sound wall cards and speech articulation songs. Print versions are available for all activities. First Half of the Year Program (55 minutes-per-day, 18 weeks)

The Science of Reading Intervention Program: Language Comprehension resources are designed for students who have completed the word recognition program or have demonstrated basic mastery of the alphabetic code and can read with some degree of fluency. The program features the 5 Weekly Language Comprehension Activities: 1. Background Knowledge Mentor Texts 2. Academic Language, Greek and Latin Morphology, Figures of Speech, Connotations, Multiple Meaning Words 3. Syntax in Reading 4. Reading Comprehension Strategies 5. Literacy Knowledge (Narrative and Expository). Second Half of the Year Program (30 minutes-per-day, 18 weeks)

The Science of Reading Intervention Program: Assessment-based Instruction provides diagnostically-based “second chance” instructional resources. The program includes 13 comprehensive assessments and matching instructional resources to fill in the yet-to-be-mastered gaps in phonemic awareness, alphabetic awareness, phonics, fluency (with YouTube modeled readings), Heart Words and Phonics Games, spelling patterns, grammar, usage, and mechanics, syllabication and morphology, executive function shills. Second Half of the Year Program (25 minutes-per-day, 18 weeks)

The Science of Reading Intervention Program BUNDLE  includes all 3 program components for the comprehensive, state-of-the-art (and science) grades 4-adult full-year program. Scripted, easy-to-teach, no prep, no need for time-consuming (albeit valuable) LETRS training or O-G certification… Learn as you teach and get results NOW for your students. Print to speech with plenty of speech to print instructional components.

SCIENCE OF READING INTERVENTION PROGRAM RESOURCES HERE for detailed product description and sample lessons.

Get the SCRIP Comprehension Strategies FREE Resource:

Get the Diagnostic ELA and Reading Assessments FREE Resource:

Reading, Spelling/Vocabulary, Study Skills , , , , , , , , , , ,