Archive

Posts Tagged ‘Tier 3’

The Science of Reading Intervention Program: Assessment-based Instruction

There’s never enough instructional time to teach students who struggle with reading.

However…

The Science of Reading Intervention Program: Assessment-based Instruction provides diagnostically-based instructional resources to individualize instruction for students grades 4–adult in 25 minutes per day for 18 weeks. Perfect for early-late schedules or Tier 3 pull-out instruction. Ideal for EL and ESL learners or students in Resource programs with IEPs. A great option for students in continuation school settings or community college and adult literacy programs with self-paced instructional modules.

Although it certainly makes sense to teach a comprehensive word recognition program to all struggling readers to ensure a solid foundation, some students and new transfer students will need second-chance instruction with more intense tutoring and practice in easily-managed small groups and independent practice. Only assessment-based instruction affords teachers the opportunity to address the diverse reading deficits of their students with targeted lessons. Make your instructional minutes count!

If time is limited, why waste instructional time with lengthy assessments?

The diagnostic assessments in this program are different. First, they are quick and easy to administer and grade (formatted in print, audio, and Google forms). Second, each assessment couples with short lessons to target each and every assessment item. And each lesson provides a short formative assessment to determine mastery. You choose which assessments need to be given and to which students.

Diagnostic Assessments with Mastery Matrices                                 

  • Vowel Sound Phonics Assessment (10:42 audio file)
  • Consonant Sounds Phonics Assessments (12:07 audio file)
  • Syllable Awareness Assessment (5:48 audio file)
  • Syllable Rhyming Assessment (5:38 audio file)
  • Phonemic Isolation Assessments (5:54 audio file)
  • Phonemic Blending Assessment (5:53 audio file)
  • Phonemic Segmenting Assessment (5:21 audio file)
  • Alphabetic Awareness Assessments (10 minutes)
  • “Pets” Fluency Assessment (2 minutes per student)
  • Heart Words Assessment (5:48 audio file)
  • Spelling Assessment (22.38 audio file)
  • Grammar and Usage Assessment (15–20 minutes)
  • Mechanics Assessment (10–15 minutes)

Corresponding Lessons (all individualized practice except as noted)

  • Phonemic Awareness and Alphabetic Awareness Lessons (Small Groups)
  • Phonics Lessons (Small Groups)
  • Expository Reading Fluency Lessons (YouTube Modeled Readings at 3 Different Speeds)
  • Spelling Pattern Worksheets
  • Grammar, Usage, and Mechanics Worksheets
  • Heart Words and Phonics Games
  • Syllabication and Morphology Lessons
  • Executive Function Skill Lessons
Intervention Program Science of Reading

The Science of Reading Intervention Program

The Science of Reading Intervention Program: Word Recognition includes explicit, scripted instruction and practice with the 5 Daily Google Slide Activities every reading intervention student needs: 1. Phonemic Awareness and Morphology 2. Blending, Segmenting, and Spelling 3. Sounds and Spellings (including handwriting) 4. Heart Words Practice 5. Sam and Friends Phonics Books (decodables). Plus, digital and printable sound wall cards and speech articulation songs. Print versions are available for all activities. First Half of the Year Program (55 minutes-per-day, 18 weeks)

The Science of Reading Intervention Program: Language Comprehension resources are designed for students who have completed the word recognition program or have demonstrated basic mastery of the alphabetic code and can read with some degree of fluency. The program features the 5 Weekly Language Comprehension Activities: 1. Background Knowledge Mentor Texts 2. Academic Language, Greek and Latin Morphology, Figures of Speech, Connotations, Multiple Meaning Words 3. Syntax in Reading 4. Reading Comprehension Strategies 5. Literacy Knowledge (Narrative and Expository). Second Half of the Year Program (30 minutes-per-day, 18 weeks)

The Science of Reading Intervention Program: Assessment-based Instruction provides diagnostically-based “second chance” instructional resources. The program includes 13 comprehensive assessments and matching instructional resources to fill in the yet-to-be-mastered gaps in phonemic awareness, alphabetic awareness, phonics, fluency (with YouTube modeled readings), Heart Words and Phonics Games, spelling patterns, grammar, usage, and mechanics, syllabication and morphology, executive function shills. Second Half of the Year Program (25 minutes-per-day, 18 weeks)

The Science of Reading Intervention Program BUNDLE  includes all 3 program components for the comprehensive, state-of-the-art (and science) grades 4-adult full-year program. Scripted, easy-to-teach, no prep, no need for time-consuming (albeit valuable) LETRS training or O-G certification… Learn as you teach and get results NOW for your students. Print to speech with plenty of speech to print instructional components.

Grammar/Mechanics , , , , , , , , ,

Which High Frequency Words?

Most teachers and reading specialists advocate some teaching of high frequency words: the question is which ones make sense to teach and which ones don’t make sense to teach?

First, let’s dispel a few notions about how we learn to read. It’s not a which came first, the chicken or the egg? question some still suggest. In other words, the end result is not all that matters. Witness the plethora of reading intervention classes in upper elementary and middle schools to see how many of our students can “read,” but not understand what they are “word calling.” How we get to the end result does matter. Reading does not teach phonemic awareness, nor does reading teach phonics and multi-syllabic decoding. These are prerequisite skills which students need in order to to read well.

We have plenty of reading research to positively assert that explicit, systematic phonics instruction is the most efficient approach to teaching beginning and remedial readers. The Look-Say Method of the Dick and Jane readers (sight words only instruction) and the Onset-Rime Method (b-ack, h-ack, j-ack, l-ack, p-ack, r-ack, s-ack, t-ack) have largely been placed on the dustbin of instructional approaches.

However…

We can certainly take things too far. We know some things, but we don’t know a lot of things about reading. We are only at the beginning stages of brain research.

So…

A prudent approach to both beginning and remedial reading instruction is to focus on decoding (phonics) and encoding (spelling) instruction and practice, but to also “throw in” a healthy dose of fluency practice with high frequency words.

Which High Frequency Words Not to Teach and Why

Don’t pass out flashcards or lists of high frequency reading or spelling words for students to memorize. Intuitively, it would seem to make sense to have students memorize the words that they are going to read or spell most often. However, our gut-level instincts lead us astray here.

  • The Dolch and Fry word lists of the most commonly used words in basal readers were never designed to provide a list of words to study. Countless U.S. classrooms still, unfortunately, have these reading goals (and assign parents the task of teaching): 10 words by the end of kindergarten; 100 words by the end of first grade; 200 words by the end of second grade; and 300 words by the end of third grade. As a reading specialist, I’ve worked with hundreds of elementary, middle school, high school, and even community college students who can word call each of these lists, but not read with comprehension. Now, there is some sense to pre-teaching a limited number of high frequency words before beginning systematic phonics instruction.
  • Similarly, the Slosson Oral Word Reading Test and San Diego Quick Assessment were only designed to test word recognition and they do provide correlations to reading comprehension, but authors Richard L. Slosson and Charles L. Nicholson, as well as Margaret La Pray and Ramon Ross respectively, never advocated using their random sample assessments as instructional tools.
  • The “No Excuse” spelling word lists, floating around since Rebecca Sitton popularized this band aid approach to spelling mastery during the height of the whole language movement of the 1980s and 1990s still, unfortunately, serves as the entire spelling program for countless U.S. classrooms with absolutely no research validating its instructional validity.

Which High Frequency Words to Teach and Why

The first group of high frequency words are, indeed, words; the second and third groups are word parts.

  • Heart Words: These words include one or more non-phonetic parts, also known as “the parts to learn by heart.” Or Heart Words may also designated as those sound-spelling patterns not yet taught, such as the “_ve” pattern with words such as live, love, and have. Check out how to teach Heart Words.

Get the Heart Words Assessment FREE Resource:

  • High Frequency Greek and Latin Prefixes and Roots: Greek and Latin word parts make up over 50% of the words in the dictionary. Some are decodable in English, and some are not. Because of the strong reading-vocabulary connection, it does make sense to have students teach and practice the Greek and Latin high frequency prefixes and suffixes which they do not know. Like with rimes, the analogous relationships formed by morphological (meaning-based) word parts make this a sound sight words instructional focus. For example,  bi means two in bicycle, just as it means two in bicameral or biped.
Intervention Program Science of Reading

The Science of Reading Intervention Program

The Science of Reading Intervention Program: Word Recognition includes explicit, scripted instruction and practice with the 5 Daily Google Slide Activities every reading intervention student needs: 1. Phonemic Awareness and Morphology 2. Blending, Segmenting, and Spelling 3. Sounds and Spellings (including handwriting) 4. Heart Words Practice 5. Sam and Friends Phonics Books (decodables). Plus, digital and printable sound wall cards and speech articulation songs. Print versions are available for all activities. First Half of the Year Program (55 minutes-per-day, 18 weeks)

The Science of Reading Intervention Program: Language Comprehension resources are designed for students who have completed the word recognition program or have demonstrated basic mastery of the alphabetic code and can read with some degree of fluency. The program features the 5 Weekly Language Comprehension Activities: 1. Background Knowledge Mentor Texts 2. Academic Language, Greek and Latin Morphology, Figures of Speech, Connotations, Multiple Meaning Words 3. Syntax in Reading 4. Reading Comprehension Strategies 5. Literacy Knowledge (Narrative and Expository). Second Half of the Year Program (30 minutes-per-day, 18 weeks)

The Science of Reading Intervention Program: Assessment-based Instruction provides diagnostically-based “second chance” instructional resources. The program includes 13 comprehensive assessments and matching instructional resources to fill in the yet-to-be-mastered gaps in phonemic awareness, alphabetic awareness, phonics, fluency (with YouTube modeled readings), Heart Words and Phonics Games, spelling patterns, grammar, usage, and mechanics, syllabication and morphology, executive function shills. Second Half of the Year Program (25 minutes-per-day, 18 weeks)

The Science of Reading Intervention Program BUNDLE  includes all 3 program components for the comprehensive, state-of-the-art (and science) grades 4-adult full-year program. Scripted, easy-to-teach, no prep, no need for time-consuming (albeit valuable) LETRS training or O-G certification… Learn as you teach and get results NOW for your students. Print to speech with plenty of speech to print instructional components.

Reading , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,

Reading Fluency Assessment

Individualized Assessment-based Instruction

Assessment-based Instruction

It’s back to school and good teachers want to know if their students can read the class novel, assigned articles, or their textbooks. Teachers also want to know what level reading is appropriate for each of their students. Teachers need a reading fluency assessment that matches their curriculum. With the move to more and more informational/expository reading, it makes sense to assess students’ reading fluency accordingly. Wouldn’t it be great if you found a two-minute, numbered reading fluency that was leveled, at say first through seventh grade reading levels, did not require prior knowledge, was interesting, and was expository text, and was FREE? Here you go!

This “Pets” expository fluency article is leveled in a special pyramid design: Using the Fleish-Kincaid formula, the first paragraph is at the first grade reading level; the second paragraph is at the second grade level; the third paragraph is at the third grade level; the fourth paragraph is at the fourth grade level; the fifth paragraph is at the fifth grade level; the sixth paragraph is at the sixth grade level; and the seventh paragraph is at the seventh grade level.

With this design, the reader begins at an easier level to build confidence and then moves to more difficult academic language, longer sentences, and multi-syllabic words. As the student reads the article, the teacher notes  the reading levels at which the student has a comfortable degree of accuracy and automaticity. Accuracy at the 95% or better decoding and automaticity with relatively effortless reading. The 383 word “Pets” expository fluency article is a two-minute expository reading fluency, which is a much superior measurement than a one-minute narrative reading fluency at only one grade level.

High levels of reading fluency are positively correlated with high levels of comprehension. Although not a causal connection, it makes sense that a certain degree of effortless automaticity is necessary for any reader to fully attend to meaning-making.

Following are end-of-year expected reading fluency rates (Hasbrouk, Tindal):

Grades 1-6 Reading Fluency Norms

Reading Fluency Norms Grades 1-6

 

 

Grades 7-8 Reading Fluency Norms

Reading Fluency Norms Grades 7-8

The Pets Fluency Assessment is my gift to you and your students. But, how do I best remediate reading fluency deficits? Pennington Publishing’s Reading Fluency and Comprehension Toolkit (a slice of the comprehensive Teaching Reading Strategies reading intervention program) includes 43 animal fluency articles with vocabulary to pre-teach. Word counts are provided in the left margin for fluency timings. The YouTube videos of each article are recorded at three different reading speeds (Level A at 95-115 words per minute; Level B at 115-135 words; and Level C at 135-155 words) to provide modeled readings at each of your students’ challenge levels.

Why not get this assessment plus 12 other reading assessments AND all of the instructional resources to teach to these assessments?

Intervention Program Science of Reading

The Science of Reading Intervention Program

The Science of Reading Intervention Program: Word Recognition includes explicit, scripted instruction and practice with the 5 Daily Google Slide Activities every reading intervention student needs: 1. Phonemic Awareness and Morphology 2. Blending, Segmenting, and Spelling 3. Sounds and Spellings (including handwriting) 4. Heart Words Practice 5. Sam and Friends Phonics Books (decodables). Plus, digital and printable sound wall cards and speech articulation songs. Print versions are available for all activities. First Half of the Year Program (55 minutes-per-day, 18 weeks)

The Science of Reading Intervention Program: Language Comprehension resources are designed for students who have completed the word recognition program or have demonstrated basic mastery of the alphabetic code and can read with some degree of fluency. The program features the 5 Weekly Language Comprehension Activities: 1. Background Knowledge Mentor Texts 2. Academic Language, Greek and Latin Morphology, Figures of Speech, Connotations, Multiple Meaning Words 3. Syntax in Reading 4. Reading Comprehension Strategies 5. Literacy Knowledge (Narrative and Expository). Second Half of the Year Program (30 minutes-per-day, 18 weeks)

The Science of Reading Intervention Program: Assessment-based Instruction provides diagnostically-based “second chance” instructional resources. The program includes 13 comprehensive assessments and matching instructional resources to fill in the yet-to-be-mastered gaps in phonemic awareness, alphabetic awareness, phonics, fluency (with YouTube modeled readings), Heart Words and Phonics Games, spelling patterns, grammar, usage, and mechanics, syllabication and morphology, executive function shills. Second Half of the Year Program (25 minutes-per-day, 18 weeks)

The Science of Reading Intervention Program BUNDLE  includes all 3 program components for the comprehensive, state-of-the-art (and science) grades 4-adult full-year program. Scripted, easy-to-teach, no prep, no need for time-consuming (albeit valuable) LETRS training or O-G certification… Learn as you teach and get results NOW for your students. Print to speech with plenty of speech to print instructional components.

Reading , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,

Phonemic Awareness Assessments

Phonemic Awareness Tests

Phonemic Awareness Assessments

“There is considerable evidence that the primary difference between good and poor readers lies in the good reader’s phonological processing ability” (University of Oregon Center on Teaching and Learning). We all know the importance of phonemic awareness as both a predictor (Goldstein, 1976; Zifcak, 1977; Stanovich, 1986, 1994) and causal factor (Adams, 1990) in reading readiness. Students need to hear, identify, and manipulate the sounds of the language before (or while) learning to read. Although some researchers still posit the notion that complete phonemic awareness is a by-product of reading, most reading researchers and teachers now see phonemic awareness as a teachable prerequisite to reading (Smith, Simmons, & Kame’enui, 1998).

If phonemic awareness is critically important to reading and it can be taught, we should do so both as pre-school to second grade beginning reading instruction and as third grade to adult reading remediation.

Some encouraging research indicates that remedial readers can learn phonemic awareness with the right teaching strategies. Bhat, Griffin, and Sindelar (2003) reported that middle school remedial readers do benefit from phonemic awareness training, although, unfortunately, not as much as do younger learners.

Additionally, although specific speech sounds (phonemes) do differ among languages, making phonemic awareness and phonics acquisition more challenging for English-language Learners (ELs), these students are certainly able to transfer their phonemic awareness skills from their primary languages to English, and research supports the benefits of phonemic awareness training for second language learners (Abbot, Quiroga, Lernos-Britton, Mostafapour, and Berninger, 2002). In fact, some primary languages, such as Spanish, share more phonemes with English than not.

Moreover, because phonemic awareness is an auditory skill, speech therapists will emphasize the importance of teaching and practicing phoneme manipulation to special education students, many of whom are diagnosed with auditory learning challenges.

So how should we teach phonemic awareness to beginning, remedial, EL/ELD, and special education students? Assessment-based instruction.

1. Efficient, comprehensive, and accurate whole class (or at least small group) phonemic awareness assessments to determine what beginning and remedial readers know and don’t know. With these tests, teachers can feel confident that “if they know it, they will show it; if they don’t, they won’t.” Not all students will have mastered the same components of phonemic awareness. No more time-consuming individual phonemic awareness assessments? Yeah! Download the six assessments below for free.

2. Assessment-based phonemic awareness activities designed to teach the phonemic awareness deficits indicated by the assessments. Why teach the same phonemic awareness activity whole class to, say a kindergarten or an intermediate or middle school reading intervention class, when not all students need to remediate the same phonemic awareness skill? Instead, use the assessment-data to determine instructional decisions. Perfect for whole class (if the assessments so indicate the need), small ability groups (think learning stations and cooperative groups), and individualized instruction. Download the sample phonemic awareness activities below for free.

Phonemic Awareness Assessments

Here are the six phonemic awareness assessments. By the way, reading specialists suggest remediating these skills in the order listed here:

  • Rhyming Awareness
  • Alphabetic Awareness (Make sure to check out the Mp3 “New Alphabet Song” found in the phonemic awareness activities packet.)
  • Syllable Awareness and Syllable Manipulation
  • Phonemic Isolation
  • Phonemic Blending
  • Phonemic Segmentation

Each of the assessments has a teacher and student page (for recording… remember that phonemic awareness is an auditory skill).

Get the Phonemic Awareness Assessments FREE Resource:

Plus, five of the six (not the alphabetic awareness assessment) include audio files. Woohoo!

Phonemic Awareness Audio Files

Syllable Awareness Assessment (5:48)

Syllable Awareness Assessment

Syllable Rhyming Assessment (5:38)

Syllable Rhyming Assessment

Phonemic Isolation Assessment (5:54)

Phonemic Isolation Assessment

Phonemic Blending Assessment (5:53)

Phonemic Blending Assessment

Phonemic Segmenting Assessment (5:21)

Phonemic Segmenting Assessment

Reading Assessment Matrix

You’ll love this one-page assessment matrix for student data and simple progress monitoring: Reading Assessments Recording Matrix

But what about the resources to teach what the phonemic awareness assessments indicate to be unmastered skills? Got you covered! Check out some of the phonemic awareness activities used in the author’s reading intervention program linked at the end of this related article

Each of the above resources is included for teachers to review components of my two reading intervention programs. Click on the provided links to view video overviews and to download sample lessons.

Intervention Program Science of Reading

The Teaching Reading Strategies (Intervention Program) is designed for non-readers or below grade level readers ages eight–adult. This full-year, 55 minutes per day program provides both word recognition and language comprehension instructional resources (Google slides and print). Affordable and evidence-based, the program features the 54 Sam and Friends Phonics Books–decodables for each lesson and designed for older students. The digital and print word recognition activities and decodables are also available as a half-year (or 30 minutes per day) option in The Science of Reading Intervention Program. Both programs include the easy-to-teach, interactive 5 Daily Google Slide Activities.

PREVIEW TEACHING READING STRATEGIES and THE SCIENCE OF READING INTERVENTION PROGRAM RESOURCES HERE

Reading, Spelling/Vocabulary , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,

Reading Assessment Issues

As an elementary, middle school, and high school reading specialist (Yes, I’ve also taught remedial reading courses at the community college level), I’ve found more and more teachers feeling that obligatory reading assessments were a waste of time… Things that had to be done because the district, principal, site reading specialist, Response to Intervention Coordinator, or grade level team members said to do so. This article discusses reading assessment issues.

I have a bit of advice: Don’t assess what your won’t teach. Only administer, correct, record, and monitor reading assessments if they are quick, comprehensive and teachable and if you, the teacher, are given the instructional resources and training to teach to the specific assessment data. These are reasonable requests/demands/expectations. Let’s explore these conditions just a bit and get you the FREE phonics test that you googled.

Why Teachers Don’t Value Reading Assessments

1. We are here to teach and not spend all of our time testing. Test administration, correction, recording, progress monitoring, re-testing takes away from instructional time. Why, for example, should we administer a two-minute reading fluency assessment if last year’s teacher already tested the child at above grade level? Why should we give a decoding test again and again (with most RtI models) when the diagnostic phonics test indicated complete mastery of all vowel and consonant sound-spellings?

31 Flavor Ice Cream

Students are 31 flavors.

2. Reading Assessments are random samples. If you had limited experience in eating ice cream, and you were taken to Baskin Robbins 31 Flavors to see if you liked ice cream, tasting a half-dozen random flavor samples would probably let you answer “Yes” or “No.” However, there are 25 other flavors that you did not taste. You could hate every one, love every one, or more probably prefer some more than others. You don’t really know until you try all 31 flavors. The same is true with, say a phonics test.

The DIBELS Next, Aimsweb, and K12 Reading Placement Tests (some of the most widely used phonics tests) all provide interesting data; however, their phonics tests do not assess all 31 flavors. Now the test creators would be quick to ask if I’ve had an educational statistics class (Yes, got an A) and understand experimental design. They might argue that if you tasted chocolate and liked it, you would not have to taste mocha almond fudge, rocky road, etc. to predict that you would also like these similar flavors. Similarly, they would suggest that if your phonics assessment tests the “au_” sound-spelling, it would not be necessary to assess the “aw,” “ou_,” “augh,” “a(l),” and “a(ll)” sound-spellings. I disagree; I love chocolate, but can’t stand mocha almond fudge and rocky road. Poor Raphael may know that “au_” sound-spelling on the phonics test, but not know any of those other sound-spellings unless each is tested.

3. Reading Assessments often provide non-teachable data. Knowing that a child is below reading grade level doesn’t tell us why, nor show us what to do to address the deficit.

For example, an individual reading inventory (I’ve done hundreds) might indicate the following for Amy, a sixth grade Vietnamese child, who came to the United States three years ago:

Amy was tested on the Insert Normed Reading Comprehension Test of Your Choice at 2.5 grade level. She had frequent ear infections as a child. Amy has mastered some, but not all, of her phonemic awareness and phonics skills. She scored at grade level 3.1 on the San Diego Quick Assessment. Her fluency on the grade 6 passage was 65 with 82% accuracy. She scored below the syllable juncture stage on the qualitative spelling inventory. She knew 182 of 300 on the Dolch list. She does not like to read.

That data might be enough to ship Amy off to an ELD class or get her tested for special education; but the data provide nothing that is concrete, specific, and teachable.

What Types of Reading Assessments Teachers Would Like to Use

1. Whole class assessments that are quick and easy to administer (How about audio files? Google forms? Google Sheets?), simple to correct and record, with easy-entry progress monitoring charts.

2. Comprehensive reading assessments that assess everything the student does and does not know. No random sampling.

3. Teachable data with student test errors which indicate specific reading deficits that are discrete and generalizable. Tests that inform the teacher exactly what needs teaching and what does not need teaching for the individual student, flexible ability groups, and the class as a whole.

Like most teachers, you would be excited to use vowel and consonant phonics tests that are quick, comprehensive and teachable. Diagnostics that don’t have reading assessment problems. Here are two phonics assessments (vowels and consonants) with answers and audio files, Google forms, and a simple one-page recording matrix for progress monitoring: 

Vowel Sounds Phonics Assessment

Use this comprehensive 52 item whole class assessment to determine your students’ mastery of short vowels, long vowels, silent final e, vowel digraphs, vowel diphthongs, and r-controlled vowels. The assessment uses nonsense words to test students’ knowledge of the sound-spellings to isolate the variable of sight word recognition. Unlike other phonics assessments, this assessment is not a random sample of phonics knowledge. The Vowel Sounds Phonics Assessment includes every common sound-spelling. Thus, the results of the assessment permit targeted instruction in any vowel sound phonics deficits.

Vowel Sounds Phonics Assessment (10:42) *

Vowel Sounds Phonics Assessment

Consonant Sounds Phonics Assessment

Use this comprehensive 50 item whole class assessment to determine your students’ mastery of consonant digraphs, beginning consonant blends, and ending consonant blends. The assessment uses nonsense words to test students’ knowledge of the sound-spellings to isolate the variable of sight word recognition. Unlike other phonics assessments, this assessment is not a random sample of phonics knowledge. Read more…

Reading, Spelling/Vocabulary , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,