Archive

Posts Tagged ‘tier 2 vocabulary’

How to Practice Reading Comprehension

Don't Teach Reading Comprehension: Practice It!

Don’t Teach Reading Comprehension

Well, I stirred up somewhat of a ruckus with my companion article titled “Don’t Teach Reading Comprehension” and I think I understand why. Admittedly, the hook is designed to do exactly what we teachers teach our students: Grab the readers’ attention and make them want to read more.” Back in high school, my fellow journalist, Kraig King, somehow was able to get this story headline approved by Mr. Devlin, our school newspaper teacher: “Drugs Are Great” with the first sentence following with “that’s what my friend Joe kept telling me.” Every student read that article.

In my previous article I provided evidence that the reading community of practitioners (we teachers and reading specialists) and academics (reading researchers) really don’t have a consensus as to what exactly is reading comprehension. The instructional implications seem clear to me: We shouldn’t assess or pretend to teach what we don’t know.

I also cautioned that teachers face enormous pressure to adopt a particular definition of reading comprehension from administrators and publishers of assessments and curricula. I’ll say it again, “We have to be crap detectors” in our business of teaching students.

Since “everyone and their mother” (horrible grammar) has their own definition of reading comprehension, I developed my own: We sort of know it when we see it, but we all don’t agree on exactly what it is and how to get it. 

The “when we see it” part of my working definition for reading comprehension offers some practical advice for helping students practice their reading comprehension. Most of us can spot a good reader when we see one. And, fortunately, most teachers are pretty good readers. So let’s remind ourselves about what good readers do.

Here the reading research provides helpful insight. Although causal connections (This teaching practice will effect this learning effect) can rarely be established, we do have a body of statistically significant reading research indicating positive correlations between certain learning practices and reading comprehension… admittedly we beg the question as to just what reading comprehension is; however, this is beside the point for our working definition). For example, oral reading fluency has a statistically significant correlation with reading comprehension; the practice and result share a high correlation (Fuchs, Fuchs, Hosp, and Jenkins).

We may not know exactly “how to get it,” but Johnny has high fluency scores and everyone knows he’s a good reader, so one way to practice reading comprehension would be… let’s be like Johnny. The following is certainly not an exhaustive list of what good readers like Johnny do, but each has research studies supporting statistically significant correlations between the description or practice and reading comprehension. I’ll add on links to that research later. Please comment with relevant links and additional suggestions and I’ll add onto the list. Or, even better yet, challenge my assumptions.

Practice Doing What Good Readers Do

Practice Reading Comprehension

Students Practicing Reading Comprehension

  • Good readers are fluent in all senses of the word, both orally and silently.
  • Good readers understand why they are reading something and tend to read toward a specific purpose.
  • Good readers are smart. Sad, but true. We educators wish that every student had the aptitude or capability to be brilliant, but nature gets in the way. In one way or another, reading is a thinking activity and good thinkers have the opportunity to be good readers. Maybe someday we will understand the brain enough to even the playing field, but we are still a long way from that day.
  • Good readers bring plenty of prior knowledge to the table through experience, content learning, practice, study skills. Good for them, but not for all our students. Nurture gets in the way. Fortunately, we have some of the tools needed to somewhat level the playing field, but it takes a lot of work.
  • Good readers have a good understanding of English idioms. English-language learners do have challenges here. Let’s be honest.
  • Good readers read for meaning and monitor their own comprehension.
  • Good readers dialogue with the text and see the reading experience as interactive between reader and author and others. They question the text.
  • Good readers have high vocabularies, especially Tier 1 and Tier 2 words.
  • Good readers know how to find resources to help them understand difficult text.
  • Good readers are flexible: Good readers vary reading speed, re-read what they don’t understand, know when to skim and not to skim.
  • Good readers know what’s important and what’s not.
  • Good readers know they need to infer meaning from the text and draw conclusions.
  • Good readers relate one part of the text to others.
  • Good readers understand text structure.
  • Good readers understand the craft of writing.
  • Good readers understand how genre affects story development.
  • Good readers do a better job of answering recall and inferential reading selection questions.
  • Good readers read narrative differently than expository text.

Teaching Practices to Practice Reading Comprehension

I’ll keep the explanations in this list short and let the links broaden any topics or ideas you may wish to explore. Several of the lists include ready-to-use resources to help your students practice reading comprehension. I suggest teachers use this list as a sort of a “I do that (pat on the back affirmation),” “I used to do that (reminder that you should use that practice again),” and “I want to think about doing that or do that instead of what I’m doing” self-analysis.

1. Think-Alouds: Good readers (both teachers and students) can share how they understand and interpret text in light of their own personal and academic experiences, text-based strategies, self-questioning, and monitoring for understanding. Click HERE for suggestions as to how to use this technique. Think-Alouds will help your students understand what reading is, for example connecting parts of text, and what reading isn’t, for example, word calling.

2. Close Readings: If you haven’t heard of close readings, you’ve been asleep at the wheel. If you read my article, Close Reading: Don’t Read Too Closely, you may wind up with a different take on this trendy reading strategy, but it is still useful to help students practice reading comprehension and it works well in conjunction with think-alouds and external, text dependent questions.

3. External Questions: Any search of Common Core reading standards will bring up text dependent questions, the favorite subject of the Common Core authors, after the need for text complexity. The time-tested QAR Reading Strategy helps students practice comprehension through recognizing and applying the types of text-dependent questions publishers, teachers, and good readers ask themselves about text.

4. Internal Questions: Reading research indicates that self-generated reader questioning improves reading comprehension as much or even more than publisher or teacher questions. My article, How to Improve Reading Comprehension with Self-Questioning, provides a helpful overview and summary of the research. Also, I’ve developed a useful set of five internal questions which prompt active engagement with both narrative and expository text. These SCRIP Comprehension Strategies (includes posters, five worksheets, and SCRIP Bookmarks) are memorable and effective. Plus, they provide a language of instruction for literary discussions.

5. Student Monitoring of Text: Teaching students to self-monitor their reading comprehension is wonderful practice. Read my article, Interactive Reading-Making a Movie in Your Head, for a nice explanation of how to read interactively. Follow up with a think-aloud and have students pair share their own think-alouds. Now that’s reading comprehension practice!

6. Literary Discussions: When we build upon (and sometimes revise) prior knowledge with relevant content and life experience, we better comprehend text. Modeling and practicing thinking skills via Socratic Seminars, literacy circles, cooperative groups, and the like help students practice reading comprehension, which is truly a listening and speaking skill. Check out How to Lead Effective Group Discussions to fine tune your discussion experience. Also check out my Critical Thinking Openers.

7. Pre-teach and Re-teach: Read the king of these reading comprehension practices (Marzano). We have to level the playing field by making text accessible to all students. By the way, why not show the movie first before reading the novel upon which it is based? Just an idea, but an effective one. Give students the keys to effective reading comprehension practice; don’t withhold them.

8. Fluency Practice: Students need both oral and silent fluency practice. Check out these articles: How and Why to Teach Fluency, Differentiated Fluency Practice, and Reading Fluency Homework. My Teaching Reading Strategies reading intervention program provides modeled oral reading fluency practice at three separate speeds. The expository animal fluency passages are tiered in terms of reading level: the first two paragraphs of each article at grade 3, the next two paragraphs at grade 5, and the last two at grade 7. Each article has word counts and corresponding timing sheets.

9. Syllabication Practice: The original and new editions Rewards (Archer) programs stretch decoding to the multi-syllabic academic vocabulary that we want students to practice to improve reading comprehension. My own Syllable Transformers (a nice article with lesson downloads) activity is essential practice for students at all reading levels. You’ll also want to check out these great reference lists: Syllable Rules with Examples and Accent Rules with Examples.

10. Vocabulary Practice with the Common Core Language Standards: The best section of the Common Core State Standards, and perhaps the only set of Standards that has produced universal praise and no criticism is found in the Language Strand: Standards 4, 5, and 6. Every teacher and reading researcher agrees that a growing and targeted vocabulary is a prerequisite and concurrent necessity to improving reading comprehension. The Common Core State Standards Appendix A  argument by Isabel Beck and Margaret McKeown that teachers should focus on Tier 2 words academic words has wide acceptance as does the teaching of Greek and Latin word parts. Check out this resource: How to Teach Prefixes, Roots, and Suffixes.

Furthermore, teachers should check out the research-based Academic Word List used in my Common Core Vocabulary Toolkits. Following are nice ready-to-teach samples as to how to teach these Standards: Four Grade 4 Vocabulary Worksheets, Flashcards, and Unit Test with AnswersFour Grade 5 Vocabulary Worksheets, Flashcards, and Unit Test with AnswersFour Grade 6 Vocabulary Worksheets, Flashcards, and Unit Test with AnswersFour Grade 7 Vocabulary Worksheets, Flashcards, and Unit Test with Answers, and Four Grade 8 Vocabulary Worksheets, Flashcards, and Unit Test with Answers.

11. Independent Reading for Vocabulary Acquisition and Content Knowledge:  The best homework? Independent reading with accountability: not for reading comprehension practice, per se, but for vocabulary acquisition and content knowledge. Read a set of articles HERE regarding how to set up an effective independent reading program with accountability and how to help students select books at the optimal word recognition levels. No, you do not need Lexiles, nor Accelerated Reader. Teach your students how to maximize vocabulary acquisition by using the FP’S BAG SALE Context Clues Strategies lesson, including two practice worksheets with answers.

12. Read a Variety of Genre: True, the Common Core State Standards have renewed our focus on non-narrative genre, but the Standards do not outlaw short stories, poetry, and novels. Check our this particularly helpful resource: How to Read Textbooks with PQ RAR.

13. Write About Reading: A good writing program is excellent reading comprehension practice. See Twelve Tips to Teach the Reading-Writing Connection.

14. Fill in the Gaps: Help students practice reading comprehension by ensuring that they have the necessary tools to do so. We know that good readers have phonemic awareness and they can apply the alphabetic code through their knowledge of how sounds connect to spellings. In other words, good readers tend to have their phonics mastered, irrespective of how they got there; they can decode. That’s simply not up for debate anymore.  We also know that good readers tend to have the “other side of the coin” mastered as well, that is they can encode (spell) the sound-spellings.

“75% of children who were poor readers in the 3rd grade remained poor readers in the 9th grade and could not read well when they became adults.” – Joseph Torgeson from Catch Them Before They Fall

Check out these FREE diagnostic reading and spelling assessments to determine exactly which gaps to fill. These assessments pinpoint specific, teachable areas that students have not yet mastered, but need to. These are comprehensive assessments, not random samples indicating a generic “problem area.” For example, the Vowel Sound Phonics Assessment will indicate that Raphael has not mastered the Long a, ai_. For example, the Diagnostic Spelling Assessment does not indicate a problem with syllable juncture as a qualitative spelling inventory might; instead, the test would indicate that Frances does not understand the consonant-le spelling patterns.

Why not get each of these assessments plus all of the instructional resources to teach to these assessments?

Mark Pennington, MA Reading Specialist, is the author of the comprehensive reading intervention curriculum, Teaching Reading StrategiesDesigned to significantly increase the reading abilities of students ages eight through adult within one year, the curriculum is decidedly un-canned, is adaptable to various instructional settings, and is simple to use–a perfect choice for Response to Intervention tiered instruction. The program provides multiple-choice diagnostic reading and spelling assessments (many with audio files), phonemic awareness activities, blending and syllabication activitiesphonics workshops with formative assessments, 102 spelling pattern worksheets, comprehension worksheets, multi-level fluency passages recorded at three different reading speeds and accessed on YouTube, 644 reading, spelling, and vocabulary game cards, posters, activities, and games.

Also get the accompanying Sam and Friends Guided Reading Phonics Books. These 54 decodable eBooks (includes print-ready and digital display versions) have been designed for older readers with teenage cartoon characters and plots. Each book introduces focus sight words and phonics sound-spellings aligned to the instructional sequence found in Teaching Reading Strategies. Plus, each book has a 30-second word fluency to review previously learned sight words and sound-spelling patterns, five higher-level comprehension questions, and an easy-to-use running record. Your students will love these fun, heart-warming, and comical stories about the adventures of Sam and his friends: Tom, Kit, and Deb. Oh, and also that crazy dog, Pug.

Teaching Reading Strategies and Sam and Friends Guided Reading Phonics Books BUNDLE

Teaching Reading Strategies and Sam and Friends Guided Reading Phonics Books

Or why not get both programs as a discounted BUNDLE? Everything teachers need to teach an assessment-based reading intervention program for struggling readers is found in this comprehensive curriculum. Ideal for students reading two or more grade levels below current grade level, tiered response to intervention programs, ESL, ELL, ELD, and special education students. Simple directions, YouTube training videos, and well-crafted activities truly make this an almost no-prep curriculum. Works well as a half-year intensive program or full-year program.

Reading , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,

Don’t Teach Reading Comprehension

Don't Teach Reading Comprehension: Practice It!

Don’t Teach Reading Comprehension

Okay, I’ll admit it; the article title is a bit of an attention grabber. However, as an MA reading specialist and author of plenty of reading programs over the years, I do believe that the title does point to some helpful advice. And I don’t believe I’m splitting hairs or making a distinction without a difference (pick your figure of speech) by advising “Don’t Teach Reading Comprehension” here while alternatively advocating “How to Practice Reading Comprehension” in my companion article. Teaching is different than practicing.

Let’s Be Honest About Teaching Reading Comprehension

Years ago I served as an elementary reading specialist, training teachers in our district-adopted reading program. I had plenty of diagnostic and instructional tools in my toolbox, ready to hand out to teachers to improve the quality of reading instruction for their classes and individual students. Fresh from my masters program, I knew stuff that the teachers did not and I felt pretty good about the level of my expertise.

At a grade level team meeting, veteran teachers were asking me about the results of their San Diego Quick Assessments, how to teach the r, l, w controlled vowels, and my take on schema theory. I was on a roll. Next, teachers tossed out their progress monitoring assessments and I suggested how to improve the fluency of Raphael, how to teach the outlaw (sight) words to Marci, and how to get Huong to practice his common Greek and Latin prefixes. Teachers were nodding their heads in a approval, and I was just about to step down from my throne and dismiss my subjects when a brand new teacher asked the question about Alberto: Even though Alberto has mastered all of his sight words, passed the phonics tests, and has the second highest fluency rate in the class, why can’t he tell me about what he has read or answer any simple questions about the reading?

The question stopped me dead in my tracks. I faked the answer pretty well, suggesting something along the lines of confusion with his primary language (Spanish) and English, not knowing that he was supposed to read for meaning, dietary issues, and perhaps some degree of cognitive impairment. But her follow-up question was devastating: “How can I teach reading comprehension to him?” I had no answer. We never covered that in my MA reading specialist program. I muttered something about the issue being complicated and said I’d get back to her. I never did.

Since those early years as an elementary reading specialist, I’ve also served as both a middle and high school reading intervention teacher and a reading instructor at a community college. After a few years under my belt, I’ve learned to be more like that new teacher. I ask harder questions and I’m not satisfied with simplistic or speculative answers. Today my answer to her question would be, “We don’t know how to teach reading comprehension, so don’t teach it.” However, that answer does require some explanation. First, let’s take a look at why we can’t teach reading comprehension; next, the instructional implications; and lastly in my companion article, how to help students practice reading comprehension

Why We Can’t Teach Reading Comprehension

In the short-lived 1969-1970 television show, Then Came Bronson, a middle-aged man in a business hat pulls his family station wagon alongside the lead character, Bronson, who is riding a

Then Cam Bronson

“Wherever I wind up, I guess”

motorcycle.

The car driver asks, “Taking a trip?”

Bronson shakes his head and answers, “Yeah.”

 “Where to?”

 “I don’t know… Wherever I wind up, I guess.”

 “Man, I wish I was you…”

“Really, well hang in there.”

Great dialogue… We all want to be about the journey with no cares about the destination, but this attitude is simply not acceptable when applied to the subject of reading comprehension. We need to know where we are going before we figure out how to get there. So, just what is reading comprehension and how do we get there?

What is Reading Comprehension? We Don’t All Agree

I googled “reading comprehension definition” and found these top results from practitioners:

“Simply put, reading comprehension is the act of understanding what you are reading” (K12 Reader).

“Comprehension is the understanding and interpretation of what is read… For many years, reading instruction was based on a concept of reading as the application of a set of isolated skills such as identifying words, finding main ideas, identifying cause and effect relationships, comparing and contrasting and sequencing. Comprehension was viewed as the mastery of these skills.” (Reading Rockets).

“I’ve noticed that many books about reading, and specifically about comprehension for that matter, don’t even define what comprehension is. Perhaps it’s assumed that we all know what it is; or maybe comprehension is a slippery term that we have trouble grasping, or comprehending, if you will!” Webster’s Collegiate Dictionary offers this definition: ‘capacity of the mind to perceive and understand.’ Reading comprehension, then, would be the capacity to perceive and understand the meanings communicated by texts. Simple, huh? Clear. Now we comprehend comprehension! (Jeff Wilhelm, Scholastic).

Next, I googled “reading comprehension scholarly definition” and found a wide variety of results from the academics:

“We define reading comprehension as the process of simultaneously extracting and constructing meaning through interaction and involvement with written language. We use the words extracting and constructing to emphasize both the importance and the insufficiency of the text as a determinant of reading comprehension” (Greenleaf, Murphy, Schoenbach).

“Reading comprehension is the construction of the meaning of a written or spoken communication through a reciprocal, holistic interchange of ideas between the interpreter and the message.
. . . The presumption here is that meaning resides in the intentional problem-solving, thinking processes of the interpreter, . . . that the content of the meaning is influenced by that
person’s prior knowledge and experience” (Harris and Hodges).

“From a cognitive or psycholinguistic perspective, comprehension is viewed as a process of constructing meaning in transaction with texts” (Goodman, 1996; Smith, 2004).¹

“(Reading comprehension is) a combination of decoding and oral comprehension skills” (Hoover & Gough, 1990).²

“From a post-structuralist or socio-cultural perspective, there is no meaning that simply resides in a text until a reader with the requisite knowledge and skills constructs the meaning with the signs on a page (McCormick, 1995; O’Neill,1993).³

1,2,3 from Rethinking Reading Comprehension: Definitions, Instructional Practices, and Assessment (Serafini).

One observation: I can’t tell you how many times I read the equivalent of “After years of… there is a growing consensus that…” for diametrically opposed summaries of the reading research.

I read the experts in cognitive science. Professor Daniel Willingham from the University of Virginia is quoted in the Washington Post:

Can reading comprehension be taught? In this blog post, I’ll suggest that the most straightforward answer is “no.” Reading comprehension strategies (1) don’t boost comprehension per se; (2) do indirectly help comprehension but; (3) don’t need to be practiced.

Finally, I went to the Common Core State Standards to see how the authors weighed in on reading comprehension. The Common Core Standards divides its Reading Standards into Reading Foundational Skills, Reading Literature, and Reading Informational Text. Its Appendix A focuses on text complexity, but offers no working definition of reading comprehension. The closest we get to a definition is “the ability to perform literacy tasks.”

Instructional Implications

At this point we are, at best, left with this working definition of reading comprehension: We sort of know it when we see it, but we all don’t agree on exactly what it is and how to get it. 

Now, that’s not the worst thing in the world. It does provide some helpful hints about the limitations of reading assessments and instructional strategies. At the minimum, this working definition

"Don't Follow Leaders"

(From Don’t Look Back produced by Leacock-Pennebaker (1965); Pennebaker Films)

informs our “crap detectors” and keeps us questioning authority. “Don’t follow leaders; watch your parking meters” (Dylan).

We Can’t and Shouldn’t Assess Reading Comprehension

Assessments are designed to measure stuff. If we can’t agree on what we are testing, reading comprehension assessments may actually lead us into teaching to the results of the test, rather than helping students improve comprehension. Reading comprehension tests become self-fulfilling prophesies. Additionally, publishers love comprehension assessments that test concrete skills: Think test prep materials, skill workbooks, etc.

Teachers should rightfully be cautious about making instructional decisions from the results of the Common Core Standards-based PAARC and Smarter Balanced tests. These high stakes tests drive instructional decisions which often counter reading research and teacher judgment. The pressure to make these achievement tests the arbiters of what reading comprehension is and is not is increasingly difficult for teachers to challenge. Furthermore, each of the criterion-referenced and normed assessments purporting to measure reading comprehension have their own biases: the Kaufman Test of Educational Achievement, Second Edition (KTEA-II), Wechsler Individual Achievement Test, Third Edition (WIAT-III), Woodcock-Johnson III Tests of Achievement (WJ III ACH), The Gray Oral Reading Tests, Fifth Edition (GORT-5), Test of Reading Comprehension, Fourth Edition (TORC-4), Iowa Tests of Basic Skills (ITBS) Gates-MacGinitie Reading Tests Terra Nova Comprehensive Test of Basic Skills (CTBS) Stanford Achievement Test, etc.

As a reading specialist for quite a few years, I also recommend not using informal reading inventories to measure comprehension. I am a huge advocate for teacher-based reading assessments, but not with comprehension. If we can’t test it (and we can’t), we can’t teach it. Make sure to avoid making reading assessments “walk on all fours.” I can’t tell you how many teachers I’ve known who use the Slosson, San Diego Quick, or the Read Naturally Brief Oral Screener and predictors of reading grade level. Wrong. And for goodness sake, avoid using the Accelerated Reader STAR test for the same misguided purpose.

The results of the above tests give us nothing to reliably inform our reading instruction. Be suspect of aggregated results which purport to provide useful instructional information. And labels can lead to silly instructional decisions, for example, tracking all far below basic readers into remedial reading classes. As if each low-performing reader had the same reading issues. Sigh.

What Doesn’t Improve Reading Comprehension

Time to step on a few toes. We may not be able to define exactly what reading comprehension is and we may not know how to assess or directly teach reading comprehension, but by any of the working definitions, assessment results, and reading research detailed in the National Reading Panel Report most of us would agree that the following practices do not improve reading comprehension.

1. Free Voluntary Reading (Sustained Silent Reading)

According to noted reading researcher, Doctor Timothy Shanahan in his August 13, 2017 article:

NRP did conclude that there was no convincing evidence that giving kids free reading time during the school day improved achievement — or did so very much. There has been a lot of work on that since NRP but with pretty much the same findings: either no benefits to that practice or really small benefits (a .05 effect size — which is tiny). Today, NRP would likely conclude that practice is not beneficial rather than that there is insufficient data. But that’s arguable, of course.

Remember that this is regarding reading comprehension, not vocabulary acquisition.

2. Teaching according to learning styles and multiple intelligences. Click HERE for the a complete debunking of these misguided approaches.

3. Visual (graphophonic) reading strategies. Over-reliance on letter shapes, pictures, and context clues to practice reading comprehension is, indeed, a “psycholinguistic guessing game” (Goodman) and the results of the whole language movement of the 1980s and 1990s strongly suggest that whatever reading comprehension is, it isn’t something that ignores the alphabetic code.

4. Leveling books for guided reading by “comprehension grade level” (whatever that means). Also, use Lexiles only as flexible guidelines for independent reading or for selecting class novels.

5. Reading ability groups by reading comprehension levels. Whatever reading comprehension is, it’s not a skill which can be taught to a flexible ability group, such as a group of students who don’t know their basic sight words.

6. Reading strategy worksheets. It’s not that worksheets don’t have a place… they do, but teaching main idea, inferencing, drawing conclusions, visualizing, and text

Should We Teach Reading Strategies?

Don’t Teach Reading Strategies???

structure are important tools for skillful readers to acquire, but passing out skill worksheets on each and excessive practice does not teach reading comprehension. Read this article, “Should We Teach Reading Strategies?” for more reasons.

7. Reading techniques, such as close reading, the QAR strategy, reciprocal teaching, and even the KWL may be helpful, but in them of themselves they don’t teach reading comprehension and even too much of a good thing can be counterproductive.

So, if you agree with my advice: Don’t Teach Reading Comprehension, you may be interested in the specifics on How to Practice Reading Comprehension. The article goes into detail about practicing reading comprehension that way good readers do and has a wealth of article and ready-to-teach FREE resources and lessons. How about a great FREEBIE now? Here you go…

Get the SCRIP Comprehension Strategies FREE Resource:


Mark Pennington, MA Reading Specialist, is the author of the comprehensive reading intervention curriculum, Teaching Reading StrategiesDesigned to significantly increase the reading abilities of students ages eight through adult within one year, the curriculum is decidedly un-canned, is adaptable to various instructional settings, and is simple to use–a perfect choice for Response to Intervention tiered instruction. The program provides multiple-choice diagnostic reading and spelling assessments (many with audio files), phonemic awareness activities, blending and syllabication activitiesphonics workshops with formative assessments, 102 spelling pattern worksheets, comprehension worksheets, multi-level fluency passages recorded at three different reading speeds and accessed on YouTube, 644 reading, spelling, and vocabulary game cards, posters, activities, and games.

Also get the accompanying Sam and Friends Guided Reading Phonics Books. These 54 decodable eBooks (includes print-ready and digital display versions) have been designed for older readers with teenage cartoon characters and plots. Each book introduces focus sight words and phonics sound-spellings aligned to the instructional sequence found in Teaching Reading Strategies. Plus, each book has a 30-second word fluency to review previously learned sight words and sound-spelling patterns, five higher-level comprehension questions, and an easy-to-use running record. Your students will love these fun, heart-warming, and comical stories about the adventures of Sam and his friends: Tom, Kit, and Deb. Oh, and also that crazy dog, Pug.

Teaching Reading Strategies and Sam and Friends Guided Reading Phonics Books BUNDLE

Teaching Reading Strategies and Sam and Friends Guided Reading Phonics Books

Or why not get both programs as a discounted BUNDLE? Everything teachers need to teach an assessment-based reading intervention program for struggling readers is found in this comprehensive curriculum. Ideal for students reading two or more grade levels below current grade level, tiered response to intervention programs, ESL, ELL, ELD, and special education students. Simple directions, YouTube training videos, and well-crafted activities truly make this an almost no-prep curriculum. Works well as a half-year intensive program or full-year program.

What do teachers have to say about the program?

I just visited your website and, oh my, I actually felt my heart leap with joy! I am working with one class of ESL students and two classes of Read 180 students with behavior issues and have been struggling to find methods to address their specific areas of weakness. I am also teaching three senior level English classes and have found them to have serious deficits in many critical areas that may impact their success if they are attending college level courses in a year’s time. I have been trying to find a way to help all of them in specific and measurable ways – and I found you! I just wanted to thank you for creating these explicit and extensive resources for students in need. Thank you!

Cathy Ford

By the way, I got Sam and Friends a few weeks ago, and I love it. I teach ESL in S Korea. Phonics is poorly taught here, so teaching phonics means going back to square one. Fortunately, Sam and Friends does that and speeds up pretty quickly. I also like that I can send it home and not charge the parents – we all love that.  I like it a lot! It’s also not about something stupid, like cats and dogs. 

Joseph Curd

I work with a large ELL population at my school.Through my research in best practices, I know that spelling patterns and word study are so important. However, I just couldn’t find anything out there that combines the two. The grade level spelling program and remediation are perfect for my students. 

Heidi

Literacy Centers, Reading, Study Skills , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,

Context Clues in Reading and Writing

Context Clues Strategy and Worksheets

Context Clues Strategy for Reading and Writing

We teachers love a bargain. Especially a “two-for one” bargain. the two for one skill which can be used in more than one context. We are all about efficiency! Context clues strategies provide that skill which can be used both to improve reading comprehension and writing clarity and coherence.

Reading and writing do have a reciprocal relationship. Check out my Twelve Tips to Teach the Reading-Writing Connection on the Pennington Publishing Blog when you have time. Learning context clues strategies helps students not only understand and apply new words, but also helps students apply more precise vocabulary in their writing to improve clarity and coherence.

In reading, context clues help students apply strategies to figure out the meaning of unknown words through hints in the surrounding text. These hints include pictures, syntax, text format, grammatical constructions, mood or tone, mechanics, and surrounding words that provide synonym, antonym, logic, or example clues.

Many of these teachers would also label the structural analysis of the unknown word itself as a context clue. Using morphemes (meaningful word parts, such as Greek and Latinates), syllabication strategies, grammatical inflections, and parts of speech also can help students figure of the meaning of unknown words. Some teachers would also include using hints outside of the text, such as prior knowledge or story schema in their definition and application of context clue strategies.

In writing, context clues help students define unfamiliar or technical vocabulary to be courteous and readable to their audience.

So, how can you get students to use context clues in their reading and writing? Teach the memorable FP’S BAG SALE strategy. Click on this Context Clues Worksheets Resource to download the strategy (see below) and two accompanying worksheets (with answers).

Get the Context Clues Worksheets FREE Resource:

But wouldn’t it be better to teach Tier II (academic) and III (domain specific) reading and writing vocabulary by using the dictionary?

No. The dictionary is a fine tool and should be used to look up words that are critical to the comprehension of any reading and for precise usage in writing. However, the dictionary is not a practical tool for most reading and writing.

So, learning and practicing context clue strategies makes sense. Context clue strategies can be mastered with sufficient practice and can be flexibly applied both to figure out the meaning of many unknown words in reading and to support the use of technical language in writing. Teach students to use the whole FP’S BAG SALE strategy for reading and the last part, i.e., the SALE strategy for writing.

FP’S BAG SALE

  • Finish the sentence. See how the word fits into the whole sentence.
  • Pronounce the word out loud. Sometimes hearing the word will give you a clue to meaning.
  • Syllables–Examine each word part. Word parts can be helpful clues to meaning.
  • Before–Read the sentence before the unknown word. The sentence before can hint at what the word means.
  • After–Read the sentence after the unknown word. The sentence after can define, explain, or provide an example of the word.
  • Grammar–Determine the part of speech. Pay attention to where the word is placed in the sentence, the ending of the word, and its grammatical relationship to other known words for clues to meaning.
  • Synonym–Sometimes an unknown word is defined by the use of a synonym. Synonyms appear in apposition, in which case commas, dashes, or parentheses are used. Example: The wardrobe, or closet, opened the door to a brand new world.
  • Antonym–Sometimes an unknown word is defined by the use of an antonym. Antonym clues will often use Signal Words such as however, not, but, in contrast Example: He promised innovation, not keeping things the way they are.
  • Logic–Your own knowledge about the content and text structure may provide clues to meaning. Logic clues can lead to a logical guess as to the meaning of an unknown word. Example: He petted the canine, and then made her sit up and beg for a bone.
  • Example–When part of a list of examples or if the unknown word itself provides an example, either provides good clues to meaning. Example clues will often use Signal Words such as for example, like, such as Example: Adventurous, rowdy, and crazy pioneers all found their way out West.

When shouldn’t we encourage students to use context clues?

Using context clues to guess the pronunciation and meanings of Tier I words (conversational, not academic English) is not efficient. Teaching students to use the alphabetic code (phonics) to sound out words and syllabication skills plus the conventional spelling rules (encoding) to write these words is essential. Context clues strategies are not useful for the “psycholinguistic guessing games (Goodman)” whole language method of developing word identification and word recognition.

Kylene Beers, in her book When Kids Can’t Read, summarizes the problem of using context clues strategies for word identification: “. . . Discerning the meaning of unknown words using context clues requires a sophisticated interaction with the text that dependent readers have not yet achieved.”

Common Core Vocabulary Toolkits Grades 4, 5, 6, 7, 8 Standards

Common Core Vocabulary Toolkits Grades 4, 5, 6, 7, 8

Mark Pennington, MA Reading Specialist, is the author of the grades 4, 5, 6, 7, and 8 Common Core Vocabulary ToolkitsEach full-year program provides 56 worksheets, along with vocabulary study guides, and biweekly unit tests to help your students collaboratively practice and master these Common Core Standards:

  • Multiple Meaning Words and Context Clues (L.4.a.)
  • Greek and Latin Word Parts (L.4.a.)
  • Language Resources (L.4.c.d.)
  • Figures of Speech (L.5.a.)
  • Word Relationships (L.5.b.)
  • Connotations (L.5.c.)
  • Academic Language Words (L.6.0)

 

Mark is also the author of the comprehensive reading intervention curriculum, Teaching Reading StrategiesDesigned to significantly increase the reading abilities of students ages eight through adult within one year, the curriculum is decidedly un-canned, is adaptable to various instructional settings, and is simple to use–a perfect choice for Response to Intervention tiered instruction. The program provides multiple-choice diagnostic reading and spelling assessments (many with audio files), phonemic awareness activities, blending and syllabication activitiesphonics workshops with formative assessments, 102 spelling pattern worksheets, comprehension worksheets, multi-level fluency passages recorded at three different reading speeds and accessed on YouTube, 644 reading, spelling, and vocabulary game cards, posters, activities, and games.

Also get the accompanying Sam and Friends Guided Reading Phonics Books. These 54 decodable eBooks (includes print-ready and digital display versions) have been designed for older readers with teenage cartoon characters and plots. Each book introduces focus sight words and phonics sound-spellings aligned to the instructional sequence found in Teaching Reading Strategies. Plus, each book has a 30-second word fluency to review previously learned sight words and sound-spelling patterns, five higher-level comprehension questions, and an easy-to-use running record. Your students will love these fun, heart-warming, and comical stories about the adventures of Sam and his friends: Tom, Kit, and Deb. Oh, and also that crazy dog, Pug.

Teaching Reading Strategies and Sam and Friends Guided Reading Phonics Books BUNDLE

Teaching Reading Strategies and Sam and Friends Guided Reading Phonics Books

Or why not get both programs as a discounted BUNDLE? Everything teachers need to teach an assessment-based reading intervention program for struggling readers is found in this comprehensive curriculum. Ideal for students reading two or more grade levels below current grade level, tiered response to intervention programs, ESL, ELL, ELD, and special education students. Simple directions, YouTube training videos, and well-crafted activities truly make this an almost no-prep curriculum. Works well as a half-year intensive program or full-year program.

Reading, Spelling/Vocabulary, Writing , , , , , , , , , , , ,

Vocabulary Scope and Sequence

According the the authors of the Common Core State Standards…

“The importance of students acquiring a rich and varied vocabulary cannot be overstated. Vocabulary has been empirically connected to reading comprehension since at least 1925 (Whipple, 1925) and had its importance to comprehension confirmed in recent years (National Institute of Child Health and Human Development, 2000). It is widely accepted among researchers that the difference in students’ vocabulary levels is a key factor in disparities in academic achievement (Baumann & Kameenui, 1991; Becker, 1977; Stanovich, 1986) but that vocabulary instruction has been neither frequent nor systematic in most schools (Biemiller, 2001; Durkin, 1978; Lesaux, Kieffer, Faller, & Kelley, 2010; Scott & Nagy, 1997).” Common Core State Standards Appendix A 

Words are important. Of course, every teacher would agree. But which words should we teach? And in what instructional order?

Here’s what the authors have to say about which words

Tier Two words (what the Standards refer to as general academic words) are far more likely to appear in written texts than in speech. They appear in all sorts of texts: informational texts (words such as relative, vary, formulate, specificity, and accumulate), technical texts (calibrate, itemize, periphery), and literary texts (misfortune, dignified, faltered, unabashedly). Tier Two words often represent subtle or precise ways to say relatively simple things—saunter instead of walk, for example. Because Tier Two words are found across many types of texts, they are highly generalizable. Common Core State Standards Appendix A 

Tier Three words (what the Standards refer to as domain-specific words) are specific to a domain or field of study (lava, carburetor, legislature, circumference, aorta) and key to understanding a new concept within a text. Because of their specificity and close ties to content knowledge, Tier Three words are far more common in informational texts than in literature. Recognized as new and “hard” words for most readers (particularly student readers), they are often explicitly defined by the author of a text, repeatedly used, and otherwise heavily scaffolded (e.g., made a part of a glossary). Common Core State Standards Appendix A 

So, every teacher should be focusing on Tier Two words because they are generalizable and they are most frequently used in complex text. For example, the following Standards would be applicable for teaching Tier Two words in ELA classes:

The Language Strand: Vocabulary Acquisition and Use (Standards 4, 5, and 6) 

The Standards focus on these kinds of words: multiple meaning words (L.4.a.), words with Greek and Latin roots and affixes (L.4.a.), figures of speech (L.5.a.), words with special relationships (L.5.b.), words with connotative meanings (L.5.c.), and academic language words (L.6.0). CCSS Language Strand

Tier Three words should be introduced in the context of content study. For example, the following Standard would be applicable for teaching Tier Three words in ELA classes:

The Reading Strand: Literature (Standard 4) Craft and Structure

Determine the meaning of words and phrases as they are used in a text, including figurative and connotative meanings; analyze the impact of rhymes and other repetitions of sounds (e.g., alliteration) on a specific verse or stanza of a poem or section of a story or drama. CCSS Reading: Literature Strand
 *****
Is there any research about the instructional order of Tier Two words

Yes. Dr. Averil Coxhead, senior lecturer at the Victoria University of Wellington School of Linguistics and Applied Language Studies developed and evaluated The Academic Word List (AWL) for her MA thesis. The list has 570 word families which were selected according to certain criteria:

  • The word families must occur in over half of the 28 academic subject areas. “Just over 94% of the words in the AWL occur in 20 or more subject areas. This principle ensures that the words in the AWL are useful for all learners, no matter what their area of study or what combination of subjects they take at tertiary level.”
  • “The AWL families had to occur over 100 times in the 3,500,000 word Academic Corpus in order to be considered for inclusion in the list. This principle ensures that the words will be met a reasonable number of times in academic texts.” The academic corpus refers to a computer-generated list of most-frequently occurring academic words.
  • “The AWL families had to occur a minimum of 10 times in each faculty of the Academic Corpus to be considered for inclusion in the list. This principle ensures that the vocabulary is useful for all learners.”

Words Excluded From the Academic Word List

  • “Words occurring in the first 2,000 words of English.”
  • “Narrow range words. Words which occurred in fewer than 4 faculty sections of the Academic Corpus or which occurred in fewer than 15 of the 28 subject areas of the Academic Corpus were excluded because they had narrow range. Technical or specialist words often have narrow range and were excluded on this basis.”
  • “Proper nouns. The names of places, people, countries, for example, New Zealand, Jim Bolger and Wellington were excluded from the list.”
  • “Latin forms. Some of the most common Latin forms in the Academic Corpus were et al, etc, ie, and ibid.” http://www.victoria.ac.nz/lals/resources/academicwordlist/information

Furthermore, computer generated word frequencies have determined the frequency of Greek and Latin word parts. 

  • Over 60% of the words students will encounter in school textbooks have recognizable word parts; and many of these Latin and Greek roots (Nagy, Anderson,Schommer, Scott, & Stallman, 1989).
  • Latin and Greek prefixes, roots, and suffixes have predictable spelling patterns.(Rasinski & Padak, 2001; Bear, Invernizzi, Templeton & Johnston, 2000).
  • Content area vocabulary is largely Greek and Latin-based and research supports this instruction, especially for struggling readers (Harmon, Hedrick & Wood, 2005).
  • Many words from Greek and Latin word parts are included in “Tier Two” and “Tier Three” words that Beck, McKeown, and Kucan (2002) have found to be essential to vocabulary word study.
  • Knowing Greek and Latin word parts helps students recognize and gain clues to understanding of other words that use known affixes and roots(Nagy & Scott, 2000).
  • “One Latin or Greek root or affix (word pattern) aids understanding (as well as decoding and encoding) of 20 or more English words.” 
  • “Since Spanish is also a Latin-based language, Latin (and Greek) can be used as a bridge to help Spanish speaking students use knowledge of their native language to learn English.” 

A Model Grades 4-8 Vocabulary Scope and Sequence

Preview the Grades 4-8 Vocabulary Scope and Sequence tied to the author’s comprehensive grades 4-8 Language Strand programs. The instructional scope and sequence includes grammar, usage, mechanics, spelling, and vocabulary. The grades 4, 5, 6, 7, and 8 vocabulary instructional scope and sequence appears at the end of the document and include multiple meaning words (L.4.a.), words with Greek and Latin roots and affixes (L.4.a.), figures of speech (L.5.a.), words with special relationships (L.5.b.), words with connotative meanings (L.5.c.), and academic language words (L.6.0). Teachers and district personnel are authorized to print and share this planning tool, with proper credit and/or citation. Why reinvent the wheel? Also check out my articles on Grammar Scope and Sequence, Mechanics Scope and Sequence, and Spelling Scope and Sequence.

Pennington Publishing's Grammar, Mechanics, Spelling, and Vocabulary (Teaching the Language Strand) Grades 4-8 Programs

Grammar, Mechanics, Spelling, and Vocabulary (Teaching the Language Strand) Grades 4-8 Programs

The author of this article, Mark Pennington, has written the assessment-based grades 4-8 Grammar, Mechanics, Spelling, and Vocabulary (Teaching the Language Strand)  programs to teach the Common Core Language Strand Standards. Each full-year program provides 56 interactive grammar, usage, and mechanics worksheets and includes sentence diagrams, error analysis, mentor texts, writing applications, and sentence dictation formative assessments with accompanying worksheets (L.1, 2). Plus, each grade-level program has weekly spelling pattern tests and accompanying spelling sort worksheets (L.2), 56 language application opener worksheets (L.3), and 56 vocabulary worksheets with multiple-meaning words, Greek and Latin word parts, figures of speech, word relationships with context clue practice, connotations, and four square academic language practice (L.4, 5, and 6). Comprehensive biweekly unit tests measure recognition, understanding, and application of all language components.

The program also has the resources to meet the needs of diverse learners. Diagnostic grammar, usage, mechanics, and spelling assessments provide the data to enable teachers to individualize instruction with targeted worksheets. Each remedial worksheet (over 200 per program) includes independent practice and a brief formative assessment. Students CATCH Up on previous unmastered Standards while they KEEP UP with current grade-level Standards. Check out the YouTube introductory video of the author’s program.


Here are FREE samples of vocabulary worksheets from this comprehensive program–ready to teach in your class today. Each resource includes directions, four grade-specific vocabulary worksheets, worksheet answers, vocabulary study cards, and a short unit test with answers.

Get the Grade 4 Vocabulary Worksheets FREE Resource:

Get the Grade 5 Vocabulary Worksheets FREE Resource:

Get the Grade 6 Vocabulary Worksheets FREE Resource:

Get the Grade 7 Vocabulary Worksheets FREE Resource:

Get the Grade 8 Vocabulary Worksheets FREE Resource:

Reading, Spelling/Vocabulary , , , , , , , , , , , , , , , , , , , , , ,

Research-Based Vocabulary Worksheets

The two most often-used methods of vocabulary instruction include passing out a vocabulary list to be memorized for the Friday quiz and pre-teaching a few vocabulary words prior to reading. Each method has its limitations. Retention of rote memorization without reinforced, deliberate practice is minimal. Exposure to a key word in a reading selection without context provides minimal understanding.

Whereas the Common Core State Standards have been widely criticized in some academic areas, I’ve never heard a parent, student, or teacher criticize the vocabulary Standards detailed in the Language Strand. Whether states re-write, re-name, or simply re-number the Common Core State Standards, the essential components of vocabulary instruction are retained. As an MA reading specialist, both vocabulary acquisition and retention are the keys to the kingdom. But minds are not simply empty vessels to be filled with ACT/SAT vocabulary; minds are also to be trained to acquire and retain words on their own. The latter is not the natural process that some describe (or hope for). Surely the process of vocabulary growth can be made more efficient and accurate with training. That’s where good teaching comes in… and one important instructional strategy is the research-based vocabulary worksheet.

The educational research provides insight as to what makes a vocabulary worksheet an effective instructional strategy for knowledge and/or skills acquisition.

In a January 2016 article, the American Psychological Association published a helpful article titled “Practice for Knowledge Acquisition (Not Drill and Kill)” in which researchers distinguish between deliberate practice and “drill and kill” rote memorization: “Deliberate practice involves attention, rehearsal and repetition and leads to new knowledge or skills that can later be developed into more complex knowledge and skills… (Campitelli & Gobet, 2011).”

“… several conditions that must be in place in order for practice activities to be most effective in moving students closer to skillful performance (Anderson, 2008; Campitelli & Gobet, 2011; Ericsson, Krampe, & Clemens, 1993). Each of these conditions can be met with carefully designed instruction.”

Most of the Tier II academic (not content-specific) language is gained through widespread reading of challenging text, Reading lots of words matters, but reading at a word recognition level of about 5% unknown words, coupled with context clues instruction and practice maximizes the amount of vocabulary acquisition and retention. According the writers of the Common Core, text complexity really matters. Research-based vocabulary worksheets can help provide deliberate practice in how to independently grow vocabulary.

The second key to vocabulary development is deep instruction in the words themselves. Passing out the vocabulary list to memorize is not “deep instruction.” Let’s take a look at the Common Core Vocabulary Standards to understand. Following are the eighth grade Standards. Highlights are my own to facilitate skimming and to provide your own vocabulary check-list of “Do that,” “Don’t do that, but need to” self-evaluation. After the Standards follows research-based vocabulary worksheets from my grades 4-8 Grammar, Mechanics, Spelling, and Vocabulary (Teaching the Language Strand) programs and the grades 4-8 Common Core Vocabulary Toolkit (slices of the aforementioned programs) to see how each of the Language Strand Vocabulary Standards L.4, 5, and 6 are incorporated into weekly classroom practice. The examples are from the fifth grade program. Yes, flashcards and tests are included in each program. Each program follows a grades 4-8 instructional scope and sequence and includes the Tier II Academic Words List.

Vocabulary Acquisition and Use:

CCSS.ELA-LITERACY.L.8.4
Determine or clarify the meaning of unknown and multiple-meaning words or phrases based on grade 8 reading and content, choosing flexibly from a range of strategies.
CCSS.ELA-LITERACY.L.8.4.A
Use context (e.g., the overall meaning of a sentence or paragraph; a word’s position or function in a sentence) as a clue to the meaning of a word or phrase.
CCSS.ELA-LITERACY.L.8.4.B
Use common, grade-appropriate Greek or Latin affixes and roots as clues to the meaning of a word (e.g., precede, recede, secede).
CCSS.ELA-LITERACY.L.8.4.C
Consult general and specialized reference materials (e.g., dictionaries, glossaries, thesauruses), both print and digital, to find the pronunciation of a word or determine or clarify its precise meaning or its part of speech.
CCSS.ELA-LITERACY.L.8.4.D
Verify the preliminary determination of the meaning of a word or phrase (e.g., by checking the inferred meaning in context or in a dictionary).
CCSS.ELA-LITERACY.L.8.5
Demonstrate understanding of figurative language, word relationships, and nuances in word meanings.
CCSS.ELA-LITERACY.L.8.5.A
Interpret figures of speech (e.g. verbal irony, puns) in context.
CCSS.ELA-LITERACY.L.8.5.B
Use the relationship between particular words to better understand each of the words.
CCSS.ELA-LITERACY.L.8.5.C
Distinguish among the connotations (associations) of words with similar denotations (definitions) (e.g., bullheaded, willful, firm, persistent, resolute).
CCSS.ELA-LITERACY.L.8.6
Acquire and use accurately grade-appropriate general academic and domain-specific words and phrases; gather vocabulary knowledge when considering a word or phrase important to comprehension or expression.
 [pdf-embedder url=”http://blog.penningtonpublishing.com/wp-content/uploads/2016/06/Vocabulary-Worksheets.pdf”]

Check out the research-based grammar, usage, and mechanics worksheet and the research-based spelling patterns worksheets.

Grammar, Mechanics, Spelling, and Vocabulary

Grammar, Mechanics, Spelling, and Vocabulary (Teaching the Language Strand)

The author of this article, Mark Pennington, has written the assessment-based grades 4-8 Grammar, Mechanics, Spelling, and Vocabulary (Teaching the Language Strand)  programs to teach the Common Core Language Strand Standards. Each full-year program provides 56 interactive grammar, usage, and mechanics worksheets and includes sentence diagrams, error analysis, mentor texts, writing applications, and sentence dictation formative assessments with accompanying worksheets (L.1, 2). Plus, each grade-level program has weekly spelling pattern tests and accompanying spelling sort worksheets (L.2), 56 language application opener worksheets (L.3), and 56 vocabulary worksheets with multiple-meaning words, Greek and Latin word parts, figures of speech, word relationships with context clue practice, connotations, and four square academic language practice (L.4, 5, and 6). Comprehensive biweekly unit tests measure recognition, understanding, and application of all language components.

The program also has the resources to meet the needs of diverse learners. Diagnostic grammar, usage, mechanics, and spelling assessments provide the data to enable teachers to individualize instruction with targeted worksheets. Each remedial worksheet (over 200 per program) includes independent practice and a brief formative assessment. Students CATCH Up on previous unmastered Standards while they KEEP UP with current grade-level Standards. Check out the YouTube introductory video of the author’s program.

 
Here are FREE samples of vocabulary worksheets from this comprehensive program–ready to teach in your class today. Each resource includes directions, four grade-specific vocabulary worksheets, worksheet answers, vocabulary study cards, and a short unit test with answers.

Get the Grade 4 Vocabulary Worksheets FREE Resource:

Get the Grade 5 Vocabulary Worksheets FREE Resource:

Get the Grade 6 Vocabulary Worksheets FREE Resource:

Get the Grade 7 Vocabulary Worksheets FREE Resource:

Get the Grade 8 Vocabulary Worksheets FREE Resource:

Spelling/Vocabulary , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,