Effects of Supplemental Multisensory Instruction Correlated With a Basal Reading Program on First Graders’ Decoding, Encoding, and Oral Reading Fluency Skills
A dissertation Research Study
By Christina Franco
Effects of Supplemental Multisensory Instruction Correlated With a Basal Reading Program on First Graders’ Decoding, Encoding, and Oral Reading Fluency Skills
A dissertation Research Study
By Christina Franco
This quantitative study purposed to determine whether and to what extent the decoding, encoding and oral reading fluency skills of first-grade students in a Bob Jones Academy (BJA) reading program were affected depending upon one of two treatments of classroom instruction received: (1) classroom reading program with no supplemental reinforcement, (2) classroom reading program supplemented with multisensory methods taught by the researcher with additional classroom teacher reinforcement. These students were evaluated using a combination of researcher-created and professionally developed pretests and posttests to examine differences in achievement between the two groups in decoding skills, which were measured by word attack (nonsense words) and word identification (real words) subtests, as well as encoding and oral reading fluency skills. The multisensory instruction was correlated with the school’s basal reading curriculum by following the same order in which phonics skills were presented as listed in the scope and sequence. The study included 63 first grade participants, which were divided into two treatment group classes and two control group classes. Independent T-tests were used to analyze the data. Improvement scores revealed statistically significant results on all decoding and encoding subtests favoring the entire population of the treatment group. Although oral reading fluency improvement scores were not statistically significant, the treatment group mean scores were greater than the control group mean scores. Improvement scores from the treatment group students within the bottom and top 50th percentile revealed statistically significant gains in the word identification subtest. Treatment group students within the bottom 50th percentile also revealed statistically significant gains in the word attack test and encoding (words spelled correctly) subtest.
TABLE OF CONTENTS
LIST OF TABLES
LIST OF FIGURES
Chapter
INTRODUCTION
Spiritual Significance
State of the Nation
General Description of Multisensory Education
History of Multisensory Methods
Statement of the Problem
Statement of Research Questions
Null Hypotheses
Assumptions
Delimitations
Definition of Terms
Significance of Study
Summary
A REVIEW OF LITERATURE
Process of Reading Acquisition
Critical Components of Reading Acquisition
Phonemic Awareness
Phonics
Vocabulary
Fluency
Comprehension
Factors Contributing to Children’s Reading Difficulties
Biological Factors
Environmental Factors
Explanation of Multisensory Language Instruction
Definition and Description of Multisensory Language Instruction
The Goal of Multisensory Language Instruction
The Wilson Reading System Approach
The Impact of Multisensory Language Instruction on Struggling and At-Risk Readers
The Impact of Multisensory Language Instruction in the Regular Classroom
The Impact of Supplementing a Basal Reading Program with Multisensory Language Instruction
Conclusion
METHODS AND PROCEDURES
Introduction
Restatement of the Problem
Restatement of Research Questions
Restatement of Null Hypotheses
Acquisition of Permission
Description and Selection of Population and Sample
Research Design
Methods within the Design
Sample Population Confidentiality and Reliability of the Design
Description of Bob Jones Phonics and Reading Program
Description of Supplemental Multisensory Instruction
Test Instruments and Data Collection
Overview of Pre- and Posttests.
Data Analysis of Study Assessments
Pilot Study
Reliability for Researcher-Created Subtests
Data Analysis for the Pilot Study
Sample Size for the Study
ANALYSIS OF DATA STUDY
Restatement of the Problem
Restatement of Research Questions
Restatement of Null Hypotheses
Description of the Sample
Experiment and Data Collection Procedures
Testing of the Null Hypotheses
SUMMARY, CONCLUSIONS AND RECOMMENDATIONS
Restatement of the Problem
Summary of the Literature Review
Critical Components of Reading Acquisition
Factors Contributing to Children’s Reading Difficulties
Explanation of Multisensory Language Instruction
Summary of Methodology
Discussion of the Research Questions
Discussion of Null Hypotheses Results
Limitations of the Study
Implications for the Study
Recommendations for Further Research
REFERENCES
APPENDICES
A Dissertation Study Plan
B Parent Opt Out form
C Implementation Checklist
D Decoding Word Identification Pre-and Posttest Evaluator Forms
E Decoding Word Attack Pre- and Posttest Evaluator Forms
F Encoding Pre- and Posttest Evaluator Forms
G Decoding Word Identification Pre- and Posttest Split-Halves Reliability Test
H Decoding Word Attack Pre- and Posttest Split-Halves Reliability Test
I Encoding Pre- and Posttest Split-Halves Reliability Test
J Decoding Word Identification Pre- and Posttest Inter-Rater Reliability
K Decoding Word Attack Pre- and Posttest Inter-Rater Reliability
L Oral Reading Fluency Pre- and Posttest Inter-Rater Reliability
M Script for Encoding Subtest
N Script and Directions for Administering and Scoring Decoding Word Attack Subtest
O Pilot Study Analysis for Decoding Word Identification Subtest
P Pilot Study Analysis for Decoding Word Attack Subtest
Q Pilot Study Analysis for Encoding Subtest
R Pilot Study Analysis for Oral Reading Fluency Subtest
S Approval for Statistical Analysis Procedure
Table
Figure
INTRODUCTION
Virtually every elementary school teacher who has been teaching reading for any length of time understands the challenge that presents itself when called upon to instruct twenty or more children with varying degrees of reading readiness skills, intellectual abilities and learning styles. The necessity of engaging and effectively teaching reading to a population of students with such diverse abilities and experiences creates a tremendously difficult task for these teachers. In many typical reading classrooms, students are divided into reading groups according to ability in order to better individualize the content and pace of instruction for the students. These groups work through a series of basal readers with connected phonics activities throughout the year. This scenario presents the problem of how to handle those in the lower reading groups that need more time than their counterparts to process the related phonics skills. In many cases within the younger grades, the struggling readers in the lowest group have difficulty even reading the simplest words within the basal readers. So, the question that must be answered is how the teacher maintains pace amongst these groups so that all students can achieve core content by the end of the year.
One option is for the teacher to slow down instruction for this lowest group and take the risk that all grade level core content may not be covered for these students who are already struggling to read. A second option is for the teacher to skip stories in the basal readers for this group in order to reach end of year objectives, despite the fact that readability and sight vocabulary are built up story by story. This scenario, however, is likely to create frustration on the part of the student because he or she has not learned the necessary skills to keep up. A third option is to periodically remove these children from the regular classroom and provide more individualized, small group reading instruction in a separate classroom. The difficulty with this option is that if a different curriculum is being used during this time, it may not be covering the same skills at the same time as the regular classroom. An alternative, and possibly more effective, solution to these issues may be to present new phonics skills to all classroom students at the same time, using systematic, multisensory methods, and directly correlate the introduction of these skills with the existing curriculum. Doing so may well enable those students who learn best with a kinesthetic/tactile approach to better grasp the phonics concepts when they are initially being taught, with the goal that they will be able to stay on pace with the rest of the classroom without the teacher having to slow down or skip stories with these students. The purpose of this study then was to explore the effects of supplementing the traditional classroom reading and phonics curriculum with additional multisensory instructional methods and to measure the impact this had on student reading outcomes.
Spiritual Significance
The ability to read and learn is a gift from God. God chose to use written symbols to guide His people into a greater understanding of Himself and to preserve His Word. Hebrews 4:12 describes God’s Word as “…living and active, sharper than any two-edged sword, piercing to the division of soul and of spirit, of joints and of marrow, and discerning the thoughts and intentions of the heart” (English Standard Version). God’s written Word also provides His people with an understanding of His expectations. While preparing for the temple repair during the reign of Josiah, the high priest Hilkiah found the Book of the Law and read it to the king:
When the king heard the words of the Book of the Law, he tore his clothes…go, inquire of the Lord for me, and for the people, and for all Judah, concerning the words of this book that has been found. For great is the wrath of the Lord that is kindled against us, because our fathers have not obeyed the words of this book, to do according to all that is written concerning us. (II Kings 22:11, 13)
It was through the reading of this Book of the Law that King Josiah and his people saw their sin as God saw it.
The original purpose of education in our own country, when it formally began in Puritan New England, was to teach children to read the Bible in order to gain an understanding of salvation and learn how to live a life that pleased God (Gelbrich, 1999; Adams, 1990). In 1647, for example, Massachusetts passed one of the earliest compulsory education laws, known as “The Old Deluder Satan Act.” The Act required Puritan colonies with more than 50 households to appoint someone to teach children within the colony to read and write. The Act got its name from its first line wherein its purpose is stated: “it being one chief project of that old deluder, Satan, to keep men from the knowledge of the Scriptures . . .” (ca. 1853, p. 1). The colonists’ goal in creating a literate society was to defeat Satan, who had used illiteracy in the old world to keep people from reading the Word of God. Literacy is truly the only way a person can read and determine for himself what the Scriptures say, and is thus a fundamental need for every human being who desires to know and understand God’s Word (ca. 1853).
State of the Nation
In 2011, a staggering 33% of fourth grade public school students in the United States scored at or below a Basic reading level on the national reading assessment (National Center for Education Statistics [NCES], 2013). To achieve a Basic reading score on this assessment a student must, with respect to word knowledge, have a “partial mastery of fundamental skills” (NCES, 2013, p. 102). This means that one-third of the middle-elementary school student population in the United States has inadequate reading skills expected for their grade level. In a discussion of reading instruction inadequacies, Bhat, Rapport, and Griffin (2000) reported that
[w]hile basal reading programs are used widely by teachers in public schools, multisensory experiences, direct instruction, and the development of alphabetic reading skills may not be a part of the instructional methods included in these programs. . . . [This has] led a group of parents of students . . . to question the appropriateness of programs and methods used by schools to teach their children to read . . . particularly . . .for students who have not made adequate progress in school. (p. 283)
Because of the large percentage of students that struggle to read, it is imperative that young struggling readers be identified and remediated as early as possible. Introducing phonics and related skills to beginning readers in ways that will strengthen understanding from the very beginning of their reading experiences may help reduce the number of children who struggle and need such remediation.
General Description of Multisensory Education
A multisensory approach to learning is one in which multiple methods of instruction are employed in an effort to help create and reinforce brain pathways so as to solidify understanding of the concepts being taught. Multisensory approaches to learning entail the use of these (VAKT) senses during instruction. The objective in this process is to create links between these sensory pathways in order to maximize a child’s learning potential.
History of Multisensory Methods
Students entering the classroom are increasingly diverse in their ethnicity, cultural backgrounds, school readiness abilities, home environments, and other factors that contribute to their learning abilities. This diversity impacts the classroom in that a broad array of learning styles is represented. Given this, the potential benefit from a multisensory approach to reading in the classroom is greater than ever. The use of multisensory teaching techniques is by no means a new concept, however. The master teacher, Jesus Christ, used various multisensory methods for communicating truths to those around Him. Jesus used the kinesthetic-tactile method of teaching when He used His own saliva to create clay from dirt to heal a blind man (John 9:1-6). Jesus could easily just have spoken words of healing, yet He added in these other sensory components as He illustrated to His disciples that the man’s disability was not due to his or his parents’ sins, but was rather given to him as an opportunity for God’s glory to be manifested.
Peter probably had the most memorable kinesthetic-tactile lesson in the Bible when he jumped from his boat into a raging storm and walked on water towards Jesus. Matthew 14: 30, 31 says
But when he saw the wind, he was afraid, and beginning to sink he cried out, ‘Lord, save me.’ Jesus immediately reached out his hand and took hold of him, saying to him, ‘O you of little faith, why did you doubt?’
Jesus used that experience as an illustration of the power He gives His children to rise above their circumstances (i.e., billowing waves) and sustain focus on Him. In another setting, Jesus used a coin as a visual illustration to the Pharisees when they asked, “Is it lawful to pay taxes to Caesar, or not? Should we pay them, or should we not?” Instructing them to bring Him the coin, Jesus pointed out Caesar’s face on the coin and told them, “Render to Caesar the things that are Caesar’s, and to God the things that are God’s” (Mark 12:14-17). Jesus also employed the auditory senses as He delivered sermons to the multitudes on a number of occasions (Matt. 5-7. Luke 5: 1-3; Matt 9:35). In one instance He preached to the people from a mountaintop. The Scriptures declare, “He opened his mouth and taught them saying . . .” (Matt. 5:2). Jesus used this particular sermon, the “Sermon on the Mount,” to verbally describe how His followers should live.
Within the academic context, the development of multisensory instruction is most notably attributed to Samuel Orton, a neurologist, during the twentieth century (Bates, 2013). Orton worked with stroke victims and sought to determine the areas of the brain that had been affected by the stroke. During his work, he encountered a young girl who was unable to read and had similar difficulties to those experienced by his stroke patients, despite the fact that she had not had a stroke and there was no notable brain damage causing these difficulties. This young girl’s deficiencies piqued Orton’s curiosity about the underlying causes of reading difficulties and their relationship to brain function (Orton, 1925). As a result of his research, Orton developed a theory called strephosymbolia (also called “twisted symbols”), which described as dyslexic those persons who had difficulty making the connection between letters and their associated sounds (McClelland, 1989). He discovered that many children with reading difficulties had average or above average IQ scores. Further investigation led him to conclude that the potential root cause of these reading difficulties was the person’s decreased ability to access the left hemisphere of the brain when reading (Dahl, 2011), which is the primary hemisphere where the process of reading takes place (Shaywitz & Shaywitz, 2007; Pugh et al, 2013). In light of this belief, he sought to teach children how to read by means of accessing both the left and the right parts of the brain through a variety of learning modalities during instruction (Campbell, 2004).
Orton worked with psychologist and educator, Anna Gillingham, to develop what is considered the first multisensory language instruction curriculum (Ritchey & Goeke, 2006; Campbell, 2004). The curriculum was based on the idea that letter-sound associations could be reinforced by adding in a kinesthetic-tactile component in conjunction with other physiological senses (i.e., visual and auditory) during instruction, which could “correct the tendency of confusing similar letters and transposing the sequence of letters while reading and writing” (International Dyslexia Association [IDA], 2009, p. 2). The phrase Orton-Gillingham approach refers to the “structured, sequential, multisensory techniques established by Doctor Orton, Miss Gillingham, and their colleagues” (IDA, 2009, p. 2). This idea of disseminating language instruction with the addition of a kinesthetic mode thus became the backbone of multisensory instruction (IDA, 2009).
Statement of the Problem
According to Petrilli (2011) “the greatest challenge facing America’s schools today . . . is the enormous variation in the academic level of students coming into any given classroom” (p. 1). Of particular importance is the necessity of meeting the academic needs of the struggling readers without sacrificing their core reading content (Woodward & Talbert-Johnson, 2009). As a result, varying approaches to multisensory structured language instruction have been developed for the purpose of meeting these students’ needs (International Dyslexia Association [IDA], 2009).
The purpose of this study was to determine whether and to what extent the decoding, encoding and oral reading fluency skills of first-grade students using the Bob Jones basal reading program were affected depending upon one of two treatments of classroom instruction received: (1) classroom reading program with no supplemental reinforcement, (2) classroom reading program supplemented with multisensory methods taught by the researcher with additional classroom teacher reinforcement. These students were evaluated using a combination of researcher-created and professionally developed pretests and posttests in order to examine differences in achievement between the two groups in decoding, encoding and oral reading fluency skills. The decoding word attack subtests measured the total phonemes (sounds) within each word that were pronounced correctly until the student reached a ceiling by incorrectly decoding five consecutive words (Woodcock, 2011; Brigance, 1999). The decoding word identification subtests measured the number of words read correctly within a one-minute time frame (Good & Kaminski, 2002). The encoding subtests measured correct letter-sound association (called “phonics points” on the subtests) and correct spelling of words (Bear, Invernizzi, Templeton, & Johnston, 2008). The students’ oral reading fluency was assessed by averaging the number of correct words read within three connected word passages during a one-minute timed sample (Good & Kaminski, 2002).
Statement of Research Questions
This study attempted to answer the following questions related to the inclusion of supplemental multisensory instruction correlated with the classroom basal reading curriculum:
Null Hypotheses
Ho1: Among all first-grade students, there is no significant difference in the improvement scores on the decoding word identification (real word) subtest, as measured by the pretest and posttest, between those students receiving classroom reading instruction only (control group) and those receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho2: Among all first-grade students, there is no significant difference in the improvement scores on the decoding word attack (nonsense word) subtest, as measured by the pretest and posttest, between those students receiving classroom reading instruction only (control group) and those receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho3: Among all first-grade students, there is no significant difference in the improvement scores of words spelled correctly on the encoding subtest, as measured by the pretest and posttest, between those students receiving classroom reading instruction only (control group) and those receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho4: Among all first-grade students, there is no significant difference in the improvement scores of phonics points on the encoding subtest, as measured by the pretest and posttest, between those students receiving classroom reading instruction only (control group) and those receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho5: Among all first-grade students, there is no significant difference in the improvement scores on the DIBELS Oral Reading Fluency subtest, as measured by the pretest and posttest, between those students receiving classroom reading instruction only (control group) and those receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho6: Among the bottom 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores on the decoding word identification (real word) subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho7: Among the bottom 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores on the decoding word attack (nonsense word) subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho8: Among the bottom 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores of words spelled correctly on the encoding subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho9: Among the bottom 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores of phonics points on the encoding subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho10: Among the bottom 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores on the DIBELS Oral Reading Fluency subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho11: Among the top 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores on the decoding word identification (real word) subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho12: Among the top 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores on the decoding word attack (nonsense word) subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho13: Among the top 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores of words spelled correctly on the encoding subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho14: Among the top 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores of phonics points on the encoding subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho15: Among the top 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores on the DIBELS Oral Reading Fluency subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Assumptions
An assumption is defined by The Merriam-Webster Dictionary as “a fact or statement (as a proposition, axiom, postulate, or notion) taken for granted” (2013, expression 5). The researcher accepted the following assumptions:
Delimitations
This study included the following uncontrollable variables, which may limit the value of the experimental results:
Definition of Terms
Significance of Study
Because young children enter school with such an array of reading readiness abilities and the development of reading acquisition is so crucial at this age, it is imperative that the classroom curriculum contain instructional strategies and assessments that meet the diverse learning needs and abilities of individual students (Richards, Pavri, Golez, Canges, & Murphy, 2007). A strong predictor of reading achievement in young children is the amount of time spent in direct instruction on phonics-related activities. (Adams, 1990; NRP, 2000). Basal reading programs are a popular choice for connecting phonics-related activities to words within stories that are then read aloud by the children (Adams, 1990). Yet, the structure of such a program comes with its set of problems for the teacher with struggling readers. Teachers with students that have low reading readiness often encounter the problem of how to meet the needs of these students and yet maintain a pace that does not cause them to fall further behind their peers. According to Woodward and Talbert-Johnson (2009), the ability to differentiate instruction to meet the needs of all learners without sacrificing core reading content skills necessary for a particular grade level is a constant struggle within the classroom. Supplementing the existing classroom curriculum with additional multisensory instructional strategies and assessments during the introduction and reinforcement of new phonics concepts is a potential solution to this problem.
The significance of this study is in whether, and to what extent those readers who are in the low average to below average range, relative to their peers within the regular classroom, increased their encoding, decoding, and oral reading fluency skills by supplementing traditional classroom reading curriculum with the introduction of multisensory materials and methods being used systematically and consistently along with the classroom reading curriculum. This study also sought to evaluate the extent to which average and above average readers, relative to their peers, improved in their reading abilities due to supplemental multisensory instruction as compared to readers without the intervention. Therefore, the goal of this study was to evaluate whether a multisensory supplement to the existing reading curriculum better supports the different learning styles and reading abilities such that by adding this component, the teacher can adequately cover grade level course objectives for all students using the current classroom curriculum.
Summary
Chapter one presented the primary problem addressed by this study: meeting the needs of diverse learners while using only the core classroom curriculum. The background of the problem and the significance of this study have been explored, along with 15 null hypotheses, assumptions, delimitations and operational definitions. Chapter two examines the literature related to the study. The primary components of reading acquisition as well as factors contributing to children’s reading difficulties are explored in depth before the focus of multisensory instruction is discussed. This is done in order to provide a framework of knowledge upon which the research design is built. Chapter three restates the problem being studied, the research questions and the research hypotheses. It also outlines the research design, describes the sample population, explains the test instrument measurements and corresponding data collection and analysis, and summarizes the pilot study. Chapter four restates the problem, research questions, and null hypotheses. The description of the sample population is summarized, and the data collection procedures are discussed. Each null hypothesis was tested and briefly analyzed. Chapter five contains a general summary and conclusions for each of the null hypotheses. Implications for the current study and recommendations for further research are discussed.
A REVIEW OF THE LITERATURE
In order to present the case for systematic classroom multisensory reading instruction, a review of the literature that examines factors contributing to children’s reading difficulties, as well as a discussion of the reading acquisition process, its components, and the factors that influence that process, is necessary. If one has no understanding of the basic elements that contribute to a child’s ability to read, then that person has no background upon which to determine whether systematic, consistently applied multisensory methods integrated into the reading curriculum will make any difference in the child’s ability to read.
Process of Reading Acquisition
Reading is an essential component of language. It is a written language that represents a spoken language where symbols, representing “linguistic units,” are put together in an accepted arrangement in order to communicate a message (Lundberg, 2009). The process of learning to read, or “reading acquisition,” is a multifaceted one that includes a variety of cognitive and perceptual elements. The multiple components required for success in this endeavor have been likened to driving a car. In order to drive, one must understand how the different parts of the car work together, such as the steering wheel, gear shifts, gas and brake pedals (Adams, 1990). Likewise, a new reader must grasp the basic components of reading in order to discern meaning from a printed text (Friesen & Butera, 2012).
The development of literacy is a progression from an implicit understanding of language, which occurs in verbal communication, to a more explicit understanding of language, which occurs in visual communication through reading and writing (Lundberg, 2009). Before a child even encounters print, he is beginning the process of reading acquisition through observation and interaction with verbal and nonverbal language (Gombert, 2003). During early development, children become implicitly aware of how these verbal sounds are put together into a conventional format in order to produce meaning. As the awareness progresses, children develop the ability to apply syntax to speech by correctly grouping words together and by following grammatical rules for language in order to communicate their message in a more proficient manner (Wiig & Menyuk, 2004). The process of reading acquisition thus involves a shift from implicit comprehension of verbal language to explicit comprehension of written language through the printed text (Gombert, 2003).
Critical Components of Reading Acquisition
According to the National Reading Panel, reading acquisition consists of five primary components: phonemic awareness, phonics, vocabulary, fluency, and comprehension (NRP, 2000). Each of these subskills has particular relevance to the development of reading abilities. The following discussion defines these subskills, examines their importance in the flow of reading acquisition, and explains how they relate to each other.
Phonemic Awareness. Phonemic awareness is the ability of the language learner to manipulate the sounds of oral speech and can be taught through blending, segmenting, phoneme addition or deletion in words, or phoneme substitution in words (IRA, 1998). Phonemic awareness and phonological awareness are often mistakenly used interchangeably; in actuality, phonemic awareness is a subskill of phonological awareness. It is necessary then to differentiate between the two terms and to consider phonemic awareness separately from phonological awareness (Chapman, 2012). Phonemic awareness is the ability to comprehend phonemes, which are the smallest units of sound (International Reading Association [IRA], 1998). For example, the word “dog” is made up of three phonemes because it has three sounds: /d/, /o/, /g/. The word “ship” is also made up of three phonemes because it also has three sounds, even though it has four letters /sh/, /i/, /p/. The term grapheme is the visual symbol used to represent the phoneme. Thus, in the previous example, the sounds (phonemes) /d/, /o/, /g/ are represented by the letters (graphemes) “d”, “o”, “g”. One letter representing one sound creates a sound-to-single-letter correspondence. This contrasts with a sound-to-letter cluster correspondence such as in the word “ship,” where one sound, /sh/, is made up of two letters: “s” and “h” (a letter cluster). (LPA, 2004).
Phonemic awareness is a critical component of reading acquisition because it enables the child to connect the individual sound units to the letters associated within the written word. Hoover (2003) further explains this:
… any system that links written letters to the phonemes underlying the spoken word requires phonemic awareness, because the would-be learner cannot connect the units underlying the written word (the letters) with the units underlying the spoken word (the phonemes) unless she is consciously aware of both and has the intent to learn the relationship between the two (known as the alphabetic principle). (p. 1)
Many studies have been conducted on the impact of phonemic awareness (PA) on reading acquisition. The National Reading Panel (NRP) conducted a meta-analysis of 52 studies on phonemic awareness and concluded that PA instruction is highly effective in helping children develop the ability to read and spell. In their report, Teaching Children to Read, the NRP explicitly states “PA training benefits not only word reading but also reading comprehension. PA training contributes to children’s ability to read and spell for months, if not years, after the training has ended” (p. 2-40). In this meta-analysis, the overall effect size on phonemic awareness ability was large (d = 0.86). The overall effect size on reading outcomes was moderate (d = 0.53), and the overall effect on spelling was also moderate (d = 0.59). Interestingly, tests given several months following the intervention revealed statistically significant effects. Effects were also significant on standardized tests as well as experimenter-created tests. Effect sizes were larger when the instruction was explicit and structured with a focus on one (d = 0.71) or two (d = 0.79) PA skills rather than a combination of three (d = 0.27) or more PA skills. The results from this comprehensive analysis showed that instruction with a focus on phonemic awareness improves reading for children across all ranges of reading abilities, grade levels, SES status and ELL status, more than instruction that does not include it.
Phonics
Phonics is considered the print form of the larger skill of phonological awareness and includes specifically an understanding of letter-sound correspondence (Semingson, 2011). Phonological awareness is a general understanding of word structure with an understanding of rhyming, onsets and rimes, alliteration, and syllabication (Cummings, Kaminski, Roland, Good, & O’Neil, 2010). Phonics encapsulates these subskills into a curriculum in order to develop students’ abilities in reading, writing, and spelling (Semingson, 2011). According to Popp (2004) “rather than ensuring students master all the rules for decoding words, phonics provides children with an awareness of word structure, and this awareness, in turn, allows them to generalize the rules they have mastered to read new words” (p. 51). According to the National Reading Panel (2000), it is the “systematic phonics instruction [which] leads to significant and positive benefits for students in kindergarten through sixth grade and for children with difficulty learning to read” (p. 1).
Phonics is considered an essential component of reading acquisition because it enables readers to make sense of the sequence of sounds in written form through a basic understanding of the alphabetic principle (Foy & Mann, 2006; Allor, 2002; Anthony et al, 2006). In other words, it is an understanding of the sound-to-letter(s) correspondence (sometimes referred to as sound-to-symbol correspondence or grapheme-phoneme relationship) that communicates a message to the reader (IRA, 1998). The stronger these sound-to-letter connections are, the more proficient the reading becomes (LPA, 2004). Teaching phonics in a systematic manner means that phonics rules are taught in an increasingly complex developmental progression so that the child is building upon previous skills as he continues through the program rather than being introduced to random rules as they appear. The National Reading Panel (NRP, 2000) conducted a meta-analysis of thirty-eight studies with 66 treatment-control group comparisons to determine the effectiveness of phonics instruction in early reading acquisition. The results showed that systematic phonics instruction produced a moderate effect size (d = .44) in helping children become good readers. Phonics instruction during the younger grades was most effective with a mean effect size for kindergarten (d = 0.56), first grade (d = 0.54), and second through sixth grade (d = .027). Measures of reading comprehension as a result of systematic phonics instruction were also noted with a significant effect size (d = 0.51) in young children. According to the NRP (2002) “these findings should dispel any belief that teaching phonics systematically to young children interferes with their ability to read and comprehend” (p. 94). The National Dissemination Center for Children with Disabilities (NICHCY, 2000) also states that
systematic phonics instruction helped children learn to read better than all forms of control group instruction, including whole language. In sum, systematic phonics instruction proved effective and should be implemented as part of literacy programs to teach beginning reading as well as to prevent and remediate reading difficulties. (p. 1)
Vocabulary
Vocabulary words are words that must be comprehended in order for productive communication to take place (National Institute for Literacy [NIL], 2002). A person with a good vocabulary understands specific words and their correct meanings within context. There are two types of vocabulary words: oral and print (Marullis & Neuman, 2010). Oral vocabulary words are the words that are heard and spoken in verbal communication. Print vocabulary words are those read and written in print communication. There are also two forms of word knowledge: receptive and productive. Receptive knowledge is when word meanings are understood as they are heard and read (Lehr, F., Osborn, Jean, Hiebert, & Elfrieda, 2004). Productive word knowledge is a deeper understanding of words in that it is words used in speaking or writing. Most people have a larger receptive vocabulary than productive vocabulary, yet it is the productive vocabulary that demonstrates a deeper understanding of word meaning because it requires this knowledge to be applied in an appropriate manner (Hiebert & Kamil, 2005).
An understanding of vocabulary words is critical to reading acquisition because it helps students make sense of what they read (NRP, 2000). Evidence indicates a correlation between word knowledge and phonological awareness. If a printed word is already in their productive vocabulary, children have an easier time decoding the word and comprehending its meaning. This knowledge helps children map spoken sounds to words in print. (NRP, 2000; Goswami, 2001). Conversely, children who do not have sufficient word knowledge struggle to comprehend the text and often get frustrated. This in turn causes them to read less which provides less exposure to a variety of words, and ultimately results in lower reading comprehension (Stanovich, 1986).
The National Reading Panel reviewed fifty studies from 1979 to 1999 to determine the best instructional methods for teaching vocabulary as well as how it relates to reading comprehension. Although there were no statistics listed for their overall effectiveness, the report does provide a breakdown of the individual studies involved in the meta-analysis with a brief explanation of the type of vocabulary instruction that was used and the general results of their effectiveness. Most of these studies were conducted between grades three and eight. There was relatively little research available on the value of vocabulary instruction for the younger grades (NRP, 2000). The NRP meta-analysis reported two effective methods for vocabulary instruction that positively contribute to reading comprehension: direct and indirect. Direct instruction involves introducing new vocabulary words before reading the text, working with these words in different contexts over an extended period of time (White, Graves, & Slater, 1990), and teaching word-learning strategies (Lehr & Osborn, 2005). Indirect instruction does not involve a formal introduction to previously unknown words. Rather, children learn vocabulary through conversations with adults, being read to (Dickinson & Smith, 1994), and reading on their own (Herman, Anderson, Pearson, & Nagy, 1987). As previously mentioned, if the word in print is in the reader’s oral (productive) vocabulary, there is a higher likelihood that the reader will be able to sound it out. Therefore, larger vocabulary knowledge equates with increased text comprehension (NRP, 2000).
Fluency
Fluency is defined as the ability to read texts quickly and accurately (National Institute for Literacy [NIL], 2002). A fluent reader is able to group words together and gain meaning from what is read by reading phrase by phrase rather than word by word (Hooks & Jones, 2002). Readers that become fluent will be proficient in three primary areas: their reading rate, reading accuracy, and reading expression (NRP, 2000; Kuhn & Stahl, 2004). Reading rate can be defined as the pace at which a person is able to orally and/or silently read the text. Reading accuracy refers to the ability to correctly pronounce each word and pause appropriately. Reading expression is the voice inflection that correctly communicates the meaning of what is written. By second or third grade, children are expected to read fluently (quickly, accurately, and with expression). By fourth grade, children are expected to transition from ‘learning to read to reading to learn’ (Chall, 1996).
Studies have shown that oral reading fluency affects comprehension (Nation & Snowling, 1997; Wise et al, 2010) and is thus a critical component of reading acquisition because it bridges the gap between word recognition and comprehension (NIL, 2002). Evidence suggests that fluent reading can be improved through guided reading and repeated reading (NRP, 2000). As the reader is exposed to the words in the text selection multiple times, they become familiar. The working memory, which was previously devoted to decoding, can now focus on comprehension (LPA, 2004).
Because reading fluency is so critical to comprehension, many studies focus on improving this skill. As previously mentioned, guided oral reading, and repeated readings are considered the best methods for enhancing reading proficiency. The NRP conducted a meta-analysis of 16 studies to determine the effects of guided oral reading practices. These studies included a variety of learners in a range of classroom settings. Students who were part of guided repeated oral reading groups statistically outperformed students in control groups in all but two studies. The overall average effect size was moderate (d = 0.48), although the variance between studies was quite large, ranging from 0.05 to 1.48. Students in these studies ranged from second grade to ninth grade. The results of instruction in guided oral reading weighted a moderate effect size (d = 0.41) on reading achievement. The NRP concluded that guided oral reading practices that include feedback, such as teacher/parent modeling, direct instruction, and positive suggestions about rate expression and accuracy (Conderman & Strobel, 2006) from different people, including teachers, parents, and peers, had a “significant, positive impact on word recognition, fluency, and comprehension across a range of grade levels.” (NRP, 2000, p. 1). The NRP (2002) report further reiterated that “word recognition accuracy is not the end point of reading instruction. Fluency represents a level of expertise beyond word recognition accuracy and reading comprehension may be aided by fluency” (p. 3-3).
A mixed method dissertation study by Underwood (2010) purposed to determine whether guided oral reading would result in significant improvement in reading achievement as measured by the Illinois Standards Achievement Test (ISAT) on student scores that were tracked through fourth and fifth grade. Fourth and fifth grade students received a 25-minute daily block of guided reading instruction in addition to the 45-minute block of whole-group reading instruction already being delivered. Quantitative results, using a paired-samples T-test, from this study showed a significant correlation between guided oral reading practices and improved student results on the ISAT. The mean score at the end of third grade was 162.79 while the mean in fourth grade was 216.61 with a significant improvement (p ˂ .001). The results from fourth to fifth grade were also statistically significant. The mean score at the end of fifth grade was 225.18 revealing a significance of p ˂ .001 in reading improvement between grade levels. Qualitative results also revealed that the teachers believed that this instructional strategy had a positive impact on student reading ability.
Comprehension
The final critical component, and the ultimate goal of reading, is comprehension (van der Lely & Marshall, 2010; NRP, 2000). The importance of comprehension not only for learning in all academic subjects, but also for learning throughout one’s entire lifetime (NRP, 2000, LPA, 2004) cannot be overstated. Reading comprehension can be defined as the connection between a reader’s own background knowledge (or schema) to what is being read (LPA, 2004). This occurs as the reader uses a variety of comprehension strategies, such as identifying the purpose of reading, asking questions about the text, connecting text to prior knowledge, and summarizing sections of text and then fusing them together to form an overall analysis (Janzen & Stoller, 1998). The use of these comprehension strategies bridges the gap between insufficient language knowledge and literal meaning within the text (Yang, 2006). In order to understand the meaning within the text, the reader must be aware of the thought processes (referred to as metacognition) that are occurring during actual reading (NIL, 2002, Yang, 2006). This awareness gives the reader control over the reading process through an active monitoring of thinking strategies in order to determine what is working and what is not.
Comprehension is a critical component of reading acquisition because it enables the reader to gather and understand information from the text. Without comprehension there is no meaning, but rather just senseless symbols on a page (Brummit-Yale, 2012). This reading skill extends its impact into both the academic arena and in life outside of school. It impacts a student’s ability to be successful in school because it is reliant on “understanding, analyzing and applying” the information that is gained through reading (Basabara, Yovanoff, Alonzo, Tindal, 2012).
The National Reading Panel conducted a meta-analysis of 204 studies and ascertained that there are seven methods of reading comprehension instruction with solid scientific evidence of their positive effects on student reading abilities. These methods include: comprehension monitoring (teaching readers to monitor their own understanding of the text), cooperative learning (using different reading strategies together as a group), graphic and semantic organizers (diagram or other pictorial format illustrating text interrelationships), question and answers (students answer questions that are given by the teacher and are given feedback on those answers), question generation (students ask themselves questions about what was read), story structure (ability to recall the organization of the story to answer questions about what they read), and summarization (generalizations from the text selection) (NRP, 2000). According to the NRP (2003), of all these strategies, the ‘question generation’ strategy produced the strongest scientific evidence of effectiveness, although teaching a combination of these reading comprehension strategies is considered the most effective.
Conclusion
Reading acquisition enables the individual to acquire meaning from print. It is a combination of word recognition and literacy comprehension (Gough & Tunmer, 1986). Phonemic awareness and phonics instruction help the reader to decode the symbols on the page. Vocabulary knowledge attaches meaning to specific words in the text. Fluency involves the ability to connect the text together at an appropriate rate, with accuracy and good expression in order to gain an overall view of the message being portrayed. Comprehension is the ultimate goal of reading and enables the reader to understand the message as connections are made from background knowledge to the text. All these skills combine together to create the reading experience and are the essential components of skilled reading.
Factors Contributing to Children’s Reading Difficulties
Studies show that a deficit in phonological awareness, which is an understanding of the sound structure within words, is the primary underlying reason for poor written and oral language comprehension (Vellutino, Fletcher, Snowling, & Scanlon, 2004; Scarborough, 1998; Badian, 1998). Poor phonological awareness in young children is evidenced by slow oral and silent reading rates and impaired spelling abilities (Fuchs et al., 2012; Manganaro, 2011). Since these children have not mastered the basic sounds and are thus unable to easily identify the name and/or sound of the letter, this leads to difficulties with word identification (Wiig & Menyuk, 2004). Pseudowords (or nonsense words) are commonly used to identify deficits in this sound-symbol correspondence in young readers because such words do not allow the children to rely on memory, visual clues, or context clues when decoding. (Miller-Shaul, 2005).
Biological Factors
When considering the factors that contribute to reading deficits perhaps the most commonly recognized and scientifically studied are biological in nature. Interestingly, 50-60% of reading disabilities have some type of genetic linkage (Vellutino, 2004). Family segregation studies report that, on average, a child is eight times more likely to be diagnosed with a reading disability if either parent has the disability. Furthermore, if the child suffers from a reading disability, there is a 25%-60% likelihood that one parent has also been diagnosed (Grigorenko, 2001, Fisher & DeFries, 2002). Five different laboratories have also identified a gene on chromosome 6 that has been linked to people with reading disabilities (Grigorenko, 2001; Paracchini, Scerri, & Monaco, 2007). This provides further evidence of the strong genetic influence on reading disabilities.
Brain imaging studies have indicated that certain people who experience one of the most prevalent reading disabilities diagnosed among school-aged children, dyslexia, (Shaywitz & Shaywitz, 2005), have a difference in brain function and composition when compared with the brain of non-dyslexic persons. Although the sample population of the current dissertation study does not involve a large number of diagnosed dyslexic students, difficulties that struggling first grade readers have oftentimes mirror those of dyslexics, and students with pervasive issues may eventually receive that diagnosis. The International Dyslexia Association (2007) lists several common potential symptoms of dyslexia in young children. These symptoms include:
(p. 1). While these studies give a greater understanding of the biological make-up of those who struggle with this specific learning disability, similarities between the difficulties encountered by early struggling readers and older dyslexic students and adults give rise to the need for a discussion as to the potential biological factors that contribute to these difficulties.
Studies comparing brain function focus on the location and amount of brain activity during cognitive reading tasks (Shaywitz et al., 2002; Stoodley & Stein, 2013), while studies comparing brain composition focus on the volume of gray and white matter within specific regions (Booth & Burman, 2001; Klingberg, Hedehus, Temple, Salz, & Gabrieli 2000; Deutsch et al., 2005), and the symmetry of the left and right hemispheres (Heim & Keil, 2004). A major focus for both brain composition and brain function studies is on the ability to map sounds to print (i.e. associate sounds with their connected letters) (Stoodley & Stein, 2013; Booth & Burman, 2001; Klingberg, et al., 2000; Brunswick, McCrory, Price, Frith & Frith, 1999; Shaywitz et al. 2002). According to Frey and Fisher (2010),
letter and sound recognition must be . . . coordinated with the auditory areas of the brain that process the sounds of language and assemble them into meaningful strings. This loop between the occipital lobe, Broca’s area in the [left] frontal lobe [associated with the production of language] and Wernicke’s area in the left temporal lobe [associated with the processing of spoken words] must be trained to coordinate efficiently. Any disruption in this pathway can potentially interfere with reading comprehension. (p. 104)
Evidence of differences in brain function has been gathered from studies conducted on dyslexic and non-dyslexic children while they were performing reading-related tasks. In one of the largest studies conducted on this subject, Shaywitz et al. (2002) examined 144 children, 70 dyslexic readers and 74 non-impaired readers between the ages of 7 and18 years with a mean age of 13.3 years. These children were required to do the following cognitive processes: identify the names or sounds of letters, sound out nonsense words, and sound out and compare the meanings of real words. Brain images were taken of the children as they were performing these skills. The results of the study showed that children who were fluent readers had a higher amount of activity in the left, as opposed to the right, hemisphere of the brain (p ˂ .001). Shaywitz et al. (2002) noted a positive correlation between reading skill and activation in the left occipital-temporal region of the brain, the area involved in critical reading skills, and a negative correlation between reading skill and activation in the right occipital-temporal region. In other words, there was an underactivation in the area involved in critical reading skills and an overactivation in the areas of the brain where compensating strategies were potentially being used in order to accomplish the reading tasks.
A study by Brunswick, et al., (1999) focused on the Wernicke and Broca areas of the brain by examining brain activation patterns in six dyslexic males and compared them with six non-dyslexic males during reading-related tasks involving reading aloud simple words and pseudo (nonsense) words. The dyslexic readers showed less activation in the left posterior inferior temporal cortex (part of Wernicke’s area) during these literacy tasks. They also noted that the dyslexic males had greater activation in the Broca areas (p=.001) during the read aloud experiment. The researchers suggested this was due to compensatory strategies being used because the two areas were not working together with the same intensity. These studies by Shaywitz, et al., and Brunswick, et al., provide convincing evidence that the brains of dyslexic individuals function quite differently, particularly with regard to the location and amount of brain activity used during the reading process, compared with those who do not struggle with this reading deficiency.
Not only does the brain function differ between those with and without dyslexia, but multiple brain imaging studies also provide evidence that the brain composition in these two groups also differs from one another. One study on brain composition by Booth and Burman (2001) shows that persons with dyslexia have less gray matter in the left parietotemporal area, which is the area that appears to be involved in word identification (i.e. decoding skills used in alphabetic mapping). Gray matter consists of nerve cells and is used for processing information. Thus, less gray matter would indicate a decreased ability to process language appropriately (i.e. phonological awareness). The researchers also found that those with dyslexia had less white matter in the tempoparietal region of the brain, which is the area that aids in correlating written words to spoken words. White matter within the language areas of the brain coincides with reading abilities (Klingbert, et al., 2000), and are responsible for helping different areas of the brain to communicate with each other. A reduction in white matter within these language areas therefore is thus thought to be responsible for slowing a reader’s processing speed (Booth and Burman, 2001).
The brain is composed of both a left and a right hemisphere, each of which is responsible for performing certain functions. The left hemisphere contains the primary components used during the reading process, (Hudson, High, & Al Otaiba, 2007; Leonard et al., 2001; Stoodley & Stein, 2013; Shaywitz & Shaywitz, 2007), and is, in cases of strong readers, often observed to be slightly larger than the right hemisphere (Leisman, et al, 2010).Galaburda, Rosen, and Sherman, (1990) performed a comprehensive post-mortem study on five diagnosed cases of developmental dyslexia. Autopsy results showed that all five of the deceaseds’ brains exhibited an enlarged right-hemisphere indicating the possibility that this side of the brain was used more during the reading process than the left hemisphere. Leonard et al. (2001) conducted MRI scans on 15 college students who had been diagnosed with a reading disability. These scans were compared with 15 controls who were matched “on the fluid reasoning cluster of the Woodcock Johnson test of Cognitive Abilities-Revised (WJ-Cog), sex, and a quantitative measure of handedness” (p. 149). Cerebral size was measured by “dividing the left and right differences by the average volume of the two hemispheres” (p. 150). Reliability for these measurements was 0.87. These measurements showed a significant rightward asymmetry in the cerebral hemisphere of those students that were diagnosed with a reading disability. Both studies suggest that among those who struggle to read, right hemisphere of the brain tends to be larger than the left.
The question has been raised by researchers as to whether these structural brain differences are the cause of reading difficulties or rather the result of reading difficulties. The best way to answer this question would be to analyze the brain composition of pre-reading children at-risk for dyslexia with children who are not at-risk. Raschle (2011) recently conducted such a study comparing the brain structure of pre-reading children with a family history of dyslexia with the brain structures of pre-reading children who have no such history. The results showed that the gray matter volume in the at-risk children was much smaller in several areas of the brain that impact reading ability: the left occipitotemporal, bilateral parietotemporal, left fusiform gyrus, and right lingual gyrus. Because the gray matter in the brain aids in processing information, a lesser volume of these nerve cells in at-risk children would indicate that these brain structures are in place prior to reading acquisition. In other words, the evidence from this study suggests that structural brain differences are indeed the cause, rather than the result, of reading deficiencies.
Environmental Factors
A child’s environment, which consists primarily of his home and school life, contributes greatly to his reading abilities and disabilities (Israel, Beaulieu, & Hartless, 2001; Hazelrigg, 2008; Downey, 2001). In a child’s home, the extent to which the English language is spoken and written (NCES, 2011; Hazelrigg, 2008) as well as his socioeconomic status (SES) (Israel,et al., 2001; Baker, 2010) play critical roles influencing his ability to read. At school, factors include teacher expectations for student achievement (Muller, Katz, & Dance, 1999) and other characteristics specific to the school, including the school’s commitment to high academic achievement, the overall school climate as it relates to safety and orderliness, the frequency of student progress evaluations, and the school’s leadership.
The number of children in the United States who speak a primary language at home other than English rose from 10% in 1980 to 21% in 2009 (National Center for Educational Statistics [NCES], 2011). These students are often referred to as English Language Learners (ELL). On the 2011 national reading assessment, 69% of ELLs performed below Basic, 31% performed at or above Basic, 7% at or above Proficient, and 1% performed at the Advanced level (NCES, 2011). These results are likely due to the fact that ELL students, as compared to their English-speaking counterparts, have less background knowledge of English vocabulary and culture and they enter school at a disadvantage due to their limited exposure to and practice of the English language in the home (Hazelrigg, 2008).
Many research studies have shown a correlation between children’s SES and its effect on their educational abilities. (White, 1982; Coleman, 1988; Israel, et al., 2001). A study by Baker (2010) examined 14,049 eighth grade students from 51 middle schools to determine the extent that SES has on academic achievement as measured by the Florida Comprehensive Achievement Test (FCAT). Of the 51 schools assessed, 31 schools (9, 321 students) received Title 1 funds, which are federal grants providing financial assistance to schools with high percentages of children from low-income families, while 17 schools (4,728 students) did not receive these funds. Thirty-nine percent of the group receiving Title 1 funds passed the FCAT whereas 65% of those passed that did not receive Title 1 funds. These results clearly suggest that SES correlates with student achievement. The question of what creates this correlation, however, is a complicated one filled with moral, social, and public policy issues that stretch well beyond the scope of this study. A review of the academic literature on the subject, however, suggests a strong factor influencing this correlation is the poor home literacy environment found in many low SES families (Share, Jorm, Maclean, Matthews, Waterman, 1983; Molfese, DiLalla, & Brunce, 1997). One or more of the following variables, any one of which can contribute to a poor literacy environment, will usually be present in a low SES family: a single parent household (Entwisle & Alexander, 1996); an increased number of siblings (a large family size) (Blake, 1989); and no college or advanced degree on the part of the mother (Moore & Schmidt, 2004). Each one of these variables, when present, has the potential to negatively influence a child’s reading ability. When multiple variables exist within the same low SES home, the potential for reading disabilities increases dramatically (Noble, Farah, & McCandliss, 2006).
A child’s school environment also plays a pivotal role in contributing to the success or struggle a child will have in reading. Student perceptions of their teachers’ expectations can directly influence student attitudes and motivation in school, both of which relate directly to achievement (Muller, et al., 1999). This perception becomes a self-fulfilling prophecy such that children will often achieve whatever expectations are set upon them (Brattesam, Weinstein, & Marshall, 1984). Furthermore, schools that are well organized with clear and fair expectations set upon the students are linked with higher academic achievement (Lee & Bryk, 1989). Educational leadership in particular, influences school-wide student achievement. (Wilson, 2011). According to Leithwood, Louis, Anderson, and Wahlstrom (2004) a school’s ability to convert from a low performing to high performing school rarely occurs without a strong and capable principal. The frequency of student progress assessments is yet another school characteristic that influences reading achievement. As schools, and specifically teachers, evaluate their students’ achievement, curriculum decisions and individual classroom teaching-style decisions can be made to best suit learners (Wilson, 2011). The more often evaluations take place, the higher the probability that instruction can be individualized, thereby positively affecting student reading outcome.
Many researchers have noted what is called the Matthew Effect with respect to children’s reading achievement. This term comes from a passage in the Bible book of Matthew that refers to the rich getting richer and the poor getting poorer (Stanovich, 1986). Students who enter school rich in home-based literacy activities, parental support, and higher SES tend to move faster through the beginning skills of alphabetic and phonemic awareness and become better readers at an earlier age. Conversely, students who do not have these similar backgrounds will often struggle at the onset of school. As the negative factors of low SES, lack of home literacy support, etc., stay consistent, the poor just get poorer. This gives cause to evaluate our current approach to the identification and remediation of young children struggling to read in order to determine best practices and identify any gaps in the process.
Conclusion
Clearly, reading difficulties can have both biological and environmental causes, although environmental influences have the potential to change biological attributes. As Frey and Fisher (2010) describe, “experience changes neural connections. When we experience something, neurons fire. Repeated firings lead to physical changes that, over time and with repetition, become more permanent” (p. 105). In light of this strong environment-biological connection, there is a great need to create a literacy-rich environment for young readers in order to provide them opportunities to establish and solidify pathways to the brain that will enhance their reading abilities.
Explanation of Multisensory Language Instruction
Definition and Description of Multisensory Language Instruction
The term multisensory structured language education originated with the International Dyslexia Association (IDA) as a general description of the specific characteristics of the Orton-Gillingham approach to teaching reading and language (International Multisensory Structured Language Education Council [IMSLEC], 2013). IDA (2009) describes the multisensory method as one that:
involves the use of visual, auditory, and kinesthetic-tactile pathways simultaneously to enhance memory and learning of written language. Links are consistently made between the visual (language we see), auditory (language we hear), and kinesthetic-tactile (language symbols we feel) pathways in learning to read and spell. (p. 1)
The acronym VAKT (visual, auditory, kinesthetic-tactile) (IDA), or the Language Triangle (Ritchey & Goeke, 2006), are terms often used to refer to these different physiological senses involved in multisensory instruction. Although multisensory instruction is generally understood to include an emphasis on kinesthetic-tactile learning, it is much broader than that. It is an approach to learning that uses methods of instruction designed to reinforce brain pathways in both the gathering of information (input) and the communicating of that information (output).
The International Multisensory Structured Language Education Council (IMSLEC) explains that a multisensory approach to language instruction generally features certain content (what is taught) and principles (how that content is taught) (IMSLEC, 2013). The content consists of phonology, sound-symbol association, syllable instruction, morphology, syntax, and semantics. The principles consist of the simultaneous use of multiple senses (VAKT) that are taught systematically and cumulatively, direct instruction that is taught diagnostically, and synthetic and analytic instruction. The IMSLEC summarizes the features of multisensory instruction as the following:
Content of Multisensory Instruction
Principles of Multisensory Instruction
The Goal of Multisensory Language Instruction
Students with reading disabilities often exhibit a breakdown in the neurological pathways between the connections of sound (phonological) and print (orthographic) in language. The goal of multisensory instruction is to bridge the gap in these neurological pathways by making sound-symbol correspondences “click” for children and adults who may otherwise have difficulty making the connection. It does so by utilizing the multiple senses to make that initial connection and then by continuing to reinforce it, which serves to then strengthen and eventually solidify understanding (IDA, 2009).
The Wilson Reading System Approach
A number of commercial multisensory reading programs are available on the market today, many of which base their instruction on the Orton-Gillingham approach. One of the most notable of these programs is the Wilson Reading System (WRS), and much of the current dissertation study uses methods drawn from the WRS. The Wilson program was developed by Barbara Wilson while she was working in the Massachusetts General Hospital’s Language Disorders Unit as well as in her private tutoring business. She saw that there were very intelligent people who had great difficulty learning to read because they could not understand the structure of the English language. She had received training in the Orton-Gillingham (OG) multisensory approach, which, combined with her work experience, led her to develop the WRS. This system seeks to break down the structure of the English language into its individual components using the phonics approach but adds in methods for reinforcing letter-sound correspondence using the different physical senses (Wilson Language Series [WLS], 2010).
The International Dyslexia Association (IDA) has listed 5 components of the English language: “(a) phonology, (b) phonics and word study, (c) fluent, automatic reading of text, (d) vocabulary, (e) handwriting, spelling, written expression” (p. 1). The WRS multisensory approach takes these components and systematically teaches each one to the point of mastery by involving the different senses. They are taught bi-directionally with a focus on encoding (sound-to-letter correspondence) and decoding (letter-to-sound correspondence) relationships in order to establish a better connection between sound and print. It also integrates fluency and reading comprehension with controlled texts (Wilson, 1989).
The decoding section of a WRS lesson consists of five elements:
The encoding section of the lesson consists of three elements:
The last two parts of the lesson make up the fluency and reading comprehension section of the lesson:
The Impact of Multisensory Language Instruction on Struggling and At-Risk Readers
Studies have shown that when a multisensory approach to teaching phonics is introduced to children who struggle to read, in most cases their reading and overall achievement scores improve. A dissertation study by Stewart (2011) tested the Orton-Gillingham method of phonics instruction (multisensory, explicit, and systematic) versus an embedded phonics instructional approach with no multisensory component (teaching phonics skills as they arise in connected text) on first grade reading achievement. The participants in this study had previously scored at or below the 30th percentile on the district’s First Grade Inventory. The independent variable was the multisensory phonics instruction. The treatment group consisted of twenty-five students and the control group consisted of twenty-six students. The treatment group received 45 minutes of daily instruction for twelve weeks in systematic, synthetic (part-to-whole) multisensory phonics instruction. Lessons were highly structured and involved all VAKT senses. The control group also received 45 minutes of daily small group instruction for twelve weeks that focused on the phonics skills that were specified in the district’s basal reading program. The phonics program for the control group had a whole-to-part emphasis where special sounds were identified within whole words. Lessons in the control group were not scripted and instruction was only visual and auditory. The dependent variables were two Woodcock Reading Mastery subtests: word attack and word identification. The word attack subtest measured students’ abilities to apply knowledge of phonics rules to pseudo (nonsense) word decoding. The word identification subtest measured students’ abilities to decode real words. Using a repeated measures T-test to measure intervention effectiveness, the results showed that the treatment group improved significantly (M = 10.04; SD = 6.03 over the control group (M = 6.03; SD = 2.10) on the decoding word attack (nonsense word) subtest. The difference between the groups was significant and the effect size was large (p= .000; t (49) = 6.25). On the decoding word identification (real word) subtest, both experimental and control groups made significant gains on the posttest compared to the pretest, although the gain score mean was greater for the treatment group (9.04 pts.) than the control group (2.56 pts.). This study suggests a strong correlation between an improvement in decoding abilities and the use of multisensory techniques used in conjunction with a systematic phonics instructional approach.
Wilson and O’Connor (1995) conducted a study to determine whether a special education pull-out program with a teacher trained in multisensory methods (from the Wilson Reading System) that focused on encoding and decoding instruction would result in student progress in reading and spelling skills. The participants included 220 students ranging from grades 3-12. Just under half (92) of these students were in the third and fourth grade and the rest of the students (128) were in grades 5-12. Thirty-five percent of these students had been retained at least one grade and most of them received special education services in the form of pull-out instruction. Progress was measured in word attack (nonsense words), passage comprehension, and total reading using the Woodcock Reading Master Test-Revised (WRMT-R, Forms G and H) or the Woodcock Reading Mastery Test (WRMT, Forms A and B). Students were also tested on their spelling achievement using the Wilson Reading System Test. The teachers participated in a two day workshop where they were taught Wilson-based multisensory instructional methods. They were taught how to follow the Wilson lesson plans and were periodically supervised in their implementation of this program by a Wilson Language Trainer during the study. Teachers also attended monthly seminars throughout the school year. Students received two to three individual tutoring lessons per week throughout the school year.
Paired t test results revealed significant gains in word attack and passage comprehension on the Woodcock Reading Mastery Tests and gains in spelling achievement on the Wilson Reading System Test. Results were reported by grade-level gains. Students averaged a 4.6 grade level gain in word attack, a 1.6 grade level gain in passage comprehension, and a 1.9 grade-level gain in total reading. The spelling results averaged a raw score gain of 10. All results, including word attack, passage comprehension, total reading, and spelling were statistically significant (p ˂ .001). According to the researchers, these findings revealed a positive correlation between multisensory instruction from trained teachers and improvement in student reading and spelling abilities. The teachers also noted a gain in student confidence as reading abilities increased throughout the school year. The researchers discussed the need for more intensive, structured, and explicit reading and spelling instruction, especially due to the trend for inclusion of special education students within the regular classroom.
Research on the use of encoding and decoding instruction (major components of multisensory language instruction) has provided empirical evidence of its positive effects on the performance of students who struggle with reading and spelling. According to Popp (2004) “practice in writing letters to represent words, a common way to practice phonics skills, allows children to recognize that their spoken words can be separated into smaller units of sounds and a visual representation can be assigned” (p. 51). In a recent study, Weiser (2010) sought to determine whether integrating encoding (spelling) instruction within a reading curriculum provided stronger gains for first-grade students struggling with reading than programs that included little or no encoding instruction. A total of 175 first-grade students participated in this study. Students were identified by their classroom teacher as showing some risk for reading difficulties. The researcher (along with five research assistants) screened all recommended students to identify those performing below the 20th percentile. In order to eliminate any “compensatory rivalry” (p. 99) between students or their teachers, there was no control group used in this study. All 175 students received their regular 90 minutes of daily language arts instruction. During the study, they received an additional 30 minutes of daily small group encoding instruction in encoding activities. Each participating school’s reading specialist received four 6-hour training sessions to learn how to teach the encoding instruction to the treatment group. Growth was measured in phonemic awareness, decoding real and nonsense words, encoding dictated words, comprehension, and fluency. The research used a cross-classified instructional model to measure growth at the student level by incorporating variables from the classroom teachers and the intervention teachers. The small group supplemental instruction by the reading specialist was observed periodically throughout the school year by the research team using a rating scale to evaluate implementation reliability. Classroom teachers were also observed during the 90-minute language block sessions to determine to what extent decoding and encoding instruction was provided as well as the amount of time spent on this instruction. This enabled the research team to consider influences from both elements and evaluate their impact both separately and collectively on students’ reading and spelling performance. Effect sizes of the treatment group gains were statistically significant ranging from 0.80 to 3.43 collectively on the post-test results. The results also confirmed a reciprocal relationship between decoding ability and encoding performance in all areas of reading and spelling.
Blachman et al. (2004) also conducted a study examining the interaction between encoding and decoding activities in helping struggling students connect letters to sounds. The treatment group included 126 second and third graders in the bottom 25th percentile of word identification skills. Over a period of eight months, these students received one-on-one daily instruction which included teaching letter/sound correspondences, segmenting and blending of phonemes within words using manipulatives, reading words on flashcards and in connected texts, and phoneme/grapheme associations to form words through written work. The control group received either the school’s prescribed core classroom reading instruction or other related reading resource instruction. Posttest assessments evaluated real and nonsense word reading, reading rate, passage reading, and spelling. These assessments revealed significant improvement of the treatment group in decoding, word reading efficiency, phonological awareness, rapid naming of letters, and spellings. Effect sizes ranged from 0.21 to 0.78, revealing a moderate to strong correlation between the intervention and improved students decoding and encoding skills.
A collective reading of the previous studies suggests that systematic and explicit multisensory phonics instruction makes large inroads into improving student reading achievement among struggling readers. The results are less clear, however, when the subjects being studied are considered “treatment resisters.” Campbell (2004) conducted a dissertation study to examine the effects of adding in a multisensory component of instruction for those children who had not previously responded to an explicit and systematic phonics approach to the teaching of reading. According to Torgesen (2000), approximately 2% to 6% of children fall into this category. The participants for this study were six second grade students who were all identified as “treatment resisters.” These students, who had previous reading instruction in Open Court, an evidenced-based reading program with a focus on explicit and systematic phonics instruction, had failed to reach grade level benchmarks on the nonsense word fluency and oral reading fluency subtests of the Dynamic Indicators of Basic Early Literacy Skills (DIBELS) assessment. The researcher provided these students with an additional 20 lessons using Practice Court (PC), an explicit and systematic phonics-based reading program in addition to the Open Court school reading program and conducted a pre and post evaluation to confirm them as “treatment resisters.” Once these students were confirmed as “treatment resisters,” the researcher introduced the additional multisensory intervention, which consisted of 12 weeks of daily 10-minute one-on-one lessons following the PC instruction with the added component of multisensory instruction. The multisensory instruction included decoding and encoding activities. The students used a finger-tapping procedure for sounding out words and manipulated letter tiles to form words on a baking sheet. Phonemic awareness was demonstrated as the student made appropriate changes to the letter tiles that corresponded with the changes in the dictated words. For example, if the word was changed from “dog” to “hog,” the student would switch out the letter “d” for the letter “h”. As the words were read, the student would touch each letter tile and produce the corresponding sound. Although no statistically significant results were discussed in the study results, all six students improved in their ability to decode nonsense words. However, none of the students achieved the maintenance goal on the DIBELS benchmark of 25 correct nonsense words per minute. Campbell hypothesized that due to the fact that these students already had identified weaknesses in the alphabetic principle and did not respond to previous intervention using systematic and explicit phonics instruction, it could be assumed that they would not be as responsive to this treatment as would be non-treatment resisters who would more likely apply new knowledge of the alphabetic principle at a faster rate. Campbell did state that the “results of this study indicate a functional relationship between the addition of multisensory components to a supplemental reading intervention and fluency of decoding VC [vowel-consonant] and CVC [consonant-vowel-consonant] nonsense words” (p. 89).
When struggling readers’ scores and overall reading achievement improves with the introduction of multisensory instruction used in conjunction with systematic, structured phonics instruction, the question can be raised as to whether it is the phonics instruction, the multisensory component, or a combination of both, that produces the desired result of improved reading skills. Torgesen et al., (2001a) studied the effects of intensive phonics instruction without an additional kinesthetic-tactile multisensory component, on students with severe phonological-based reading disabilities as demonstrated by an average student score below the first percentile on the pre-intervention word attack subtest. Sixty participants who had received an average of 16 months of special education intervention prior to the study received one-on-one instruction in two 50 minute segments daily for eight weeks containing phonemic awareness and explicit phonics instruction. Prior to the onset of study intervention, the 60 participants were divided into low, medium, and high groups according to their phonological processing ability as measured by the Comprehensive Test of Phonological Processes. Following treatment, students were assessed in their decoding abilities using the Woodcock Reading Mastery Test-Revised subtest of nonsense words. Standard scores from students in the low group improved from 70.2 to 93.5. The middle group improved 67.4 to 91.6, and the high group improved 74.1 to 95.6. Longitudinal data also reported improvement in all students’ broad reading abilities showing a progression from the 7th percentile to the 30th percentile at the two-year follow up assessment. This study suggests a strong correlation between reading achievement and systematic instruction in phonics skills for struggling readers.
Some may suggest that this study provides clear evidence that it is the phonics instruction alone, rather than the supplemental multisensory instruction to the phonics instruction, that is causing reading gains among struggling readers. While this study does in fact provide strong evidence in favor of an intensive phonics approach to reading, it did not provide a control group/treatment group set-up where one group received supplemental multisensory instruction and one did not. Thus, no comparisons could be made between the two groups. As a whole, however, and particularly given the results of the studies discussed previously, the literature suggests that the use of multisensory methods in addition to a structured, sequential phonics-based reading program benefits struggling readers.
The Impact of Multisensory Language Instruction in the Regular Classroom
Because multisensory methods are often used with students that are exhibiting some type of reading difficulty related to phonological awareness, most of the research focuses on this particular group. However, several studies provide evidence that multisensory methods improve overall student scores rather than just the scores of those who are struggling. Scheffel, Shaw, and Shaw (2008) sought to evaluate the effectiveness of Orton-Gillingham multisensory instruction within three different schools. The participants were 702 first-grade students. The treatment group consisted of 226 students and the control group included 476 students. Both treatment and control groups within this study contained a mix of low and average readers. Both groups received 90 minutes daily of traditional reading instruction using the district’s approved curriculum. The treatment group received 30 minutes daily of supplemental instruction using the Orton-Gillingham multisensory program. Classroom observations of proper implementation were used to ensure variables were limited to additional use of the supplementary program. The teachers completed satisfaction surveys of program effectiveness and the students were given a fall, winter, and spring assessment using the Dynamic Indicators of Basic Early Literacy Skills (DIBELS) to measure achievement in the areas of phonemic awareness and the alphabetic principle using the phonemic segmentation fluency (PSF) subtest, the nonsense words fluency subtest (NWF), and the oral reading fluency (ORF) to measure achievement in the areas of phonemic awareness and the alphabetic principle.
Those students at greatest risk for reading failure within the treatment group (bottom 25th percentile) measured the greatest improvement in phonemic awareness skills as measured by the PSF subtest. The at-risk students in the treatment group scored above the DIBELS benchmark from winter to spring assessments while the control group scored below the DIBELS benchmark. From the fall to winter assessments, the treatment group transitioned 25% and the control group transitioned 20% of the some risk students to the low risk category. The author also noted that the progress of phonological awareness skills during the fall and winter assessments for students in both groups within the bottom 5th percentile was very similar, yet the treatment group measured much greater gains in alphabetic principle, measured by the NWF, during the winter and spring assessments. Although the overall impact was greatest on those students that were considered at-risk during the study, the NWF scores for students in the low-risk category in the treatment schools were significantly higher than the low-risk students in the control group schools (p= .001) (Scheffel, D.L., Shaw, J.C., and Shaw, R., 2008).
Bitter and White (2011) conducted a large-scale, longitudinal study to determine the effect of multisensory language instruction compared to conventional basal reading instruction. The sample size was over 1,000 students across eleven schools. These students participated in the study from kindergarten through the third grade. The control group students were given 80 minutes of daily instruction using a district-approved basal reading program: Harcourt or Houghton Mifflin. The treatment group students were given 90 minutes of daily instruction using the Writing Road to Reading, which was developed by R. B. Spalding and contains components of the Spalding method. This is a multisensory method that explicitly and systematically teaches letter-sound correspondences and integrates the use of spoken language with reading and spelling. It is important to note that the Arizona Department of Education (the state in which the research study took place) concluded that the reading programs used in both treatment and control groups contained instruction in the five critical components of reading as identified by the National Reading Panel. Therefore, these components could be eliminated as variables.
Four subtests of the DIBELS were used for the kindergarten students: Initial Sound Fluency, Letter Naming Fluency, Nonsense Words Fluency, and Word Use Fluency. However, by year four of the study, only data from the Oral Reading Fluency subtest was available on all schools. Results from this study yielded a statistically significant result (p˂ .001) in favor of the treatment group. The treatment group also performed better than the control group on all subtests from kindergarten through third grade. These results were validated by the state-mandated achievement test, the TerraNova, which was administered during the third year of the study to all second graders. Results confirmed the DIBELS scores and revealed that the treatment group significantly outperformed the control group on the reading portion of TerraNova (p˂ .01).
The Impact of Supplementing a Basal Reading Program with Multisensory Language Instruction
Trepanier (2009) conducted a study similar to the one addressed by this dissertation and sought to evaluate the effectiveness of supplementing a basal reading curriculum with Orton-Gillingham (OG) phonetic instruction within the regular classroom. Approximately 50 students in first and second grade participated over a nine-month period. In both grades, there was a control group class and a treatment group class. All of the classes in both grade levels spent 120 minutes a day on reading instruction. As part of this 120-minute block, the treatment group instruction was disseminated using multisensory methods. Assessment of pre and post achievement levels was conducted using the STAR Reading test, which determined the students’ reading levels. An analysis of the data revealed that there was no significant difference between the treatment group and control group in either first or second grade. However, despite this fact, the average reading level gains were greater for both treatment groups (1.07333 for first grade and 0.70000 for second grade) than they were for the control groups (0.65000 for first grade, 0.6780 for second grade). This provides some evidence that even students who are not at-risk for reading difficulties can benefit from supplemental, explicit, systematic multisensory instruction of reading.
Negin (2009) also conducted a study evaluating the effectiveness of supplemental multisensory instruction to an established basal reading program. Students in a third-grade classroom were divided into two fifteen-subject groups: control and treatment. All of the students were given the reading subtest of the Stanford Achievement Test. This test measured word reading skills and reading comprehension skills. The control group (Group B) spent fifteen minutes a day silently reading trade books of interest to them. The treatment group (Group A) spent fifteen minutes a day listening to audio tapes of the same books as Group B. The students followed along by moving their fingers under the words. One of the major components of multisensory instruction is the usage of the visual, auditory, and kinesthetic-tactile component simultaneously. In Group A (the treatment group), the students looked at the words (visual) listened to them being spoken (auditory) and moved their finger across the word(s) as they were being read aloud (kinesthetic-tactile). The Stanford Achievement Reading subtest was administered a second time as a post test. While both groups improved on their reading scores, Negin found that the treatment group (Group A) showed a greater level of reading achievement, as indicated by an average of a two-month reading gain over the control group (Group B). According to Negin, the “differences between the two groups should be attributable to the multisensory component in the treatment for Group A” (p. 381).
These results are corroborated by a similar study conducted by Joshi, Dahlgren, and Boulware-Gooden (2002). Control group students were taught using the Houghton-Mifflin basal reading curriculum and treatment group students were taught using the Language Basic: Elementary which includes components of Alphabetic Phonics a multisensory language program. While both treatment and control groups made statistically significant gains in reading comprehension, the treatment group also made statistically significant gains in phonological awareness and decoding. These results provide evidence that multisensory instruction aligned with a basal reading program improves struggling student performance in reading.
Conclusion
The theory and implementation of multisensory language instruction has been discussed for decades. This approach is considered effective because it focuses on the core component of phonological awareness and more specifically phonemic awareness, both of which are implicated in reading disabilities. Its ability to adapt to different learning styles makes it a popular choice for special educators and regular classroom teachers who want to improve their students’ reading fluency.
METHODS AND PROCEDURES
Introduction
This is an experimental study with the purpose of assessing two different reading method treatments on first-grade students and determining the effects of these treatments within and among the two groups. The method of instruction is the independent variable. The dependent variable is the improvement scores of students, as measured by a pretest and posttest, on decoding, as measured by word identification (real word) and word attack (nonsense word) subtests, encoding (spelling ability and phonics points), and oral reading fluency skills. The sample population included four intact classrooms- two that received the intervention teaching methods (the treatment group) and two that did not (the control group). This chapter presents a restatement of the problem studied, along with a restatement of the research questions and null hypotheses. It also includes a description of the research design and the intervention methods, the sample population, test instrument measurements and data treatment from those tests, as well as how the data from those tests was analyzed. The chapter concludes with a summary of the pilot study.
Restatement of the Problem
The purpose of this study was to determine whether and to what extent the decoding, encoding and oral reading fluency skills of first-grade students using the Bob Jones basal reading program were affected depending upon one of two treatments of classroom instruction received: (1) classroom reading program with no supplemental reinforcement, and (2) classroom reading program supplemented with multisensory methods taught by the researcher with additional classroom teacher reinforcement. These students were evaluated using a combination of researcher-created and professionally developed pretests and posttests in order to examine differences in achievement between the two groups in decoding, which was measured by word attack (nonsense words) and word identification (real words) subtests, as well as encoding and oral reading fluency.
Restatement of Research Questions
This study attempts to answer the following questions related to the inclusion of supplemental multisensory instruction correlated with the classroom basal reading curriculum:
Restatement of Null Hypotheses
Ho1: Among all first-grade students, there is no significant difference in the improvement scores on the decoding word identification (real word) subtest, as measured by the pretest and posttest, between those students receiving classroom reading instruction only (control group) and those receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho2: Among all first-grade students, there is no significant difference in the improvement scores on the decoding word attack (nonsense word) subtest, as measured by the pretest and posttest, between those students receiving classroom reading instruction only (control group) and those receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho3: Among all first-grade students, there is no significant difference in the improvement scores of words spelled correctly on the encoding subtest, as measured by the pretest and posttest, between those students receiving classroom reading instruction only (control group) and those receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho4: Among all first-grade students, there is no significant difference in the improvement scores of phonics points on the encoding subtest, as measured by the pretest and posttest, between those students receiving classroom reading instruction only (control group) and those receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho5: Among all first-grade students, there is no significant difference in the improvement scores on the DIBELS Oral Reading Fluency subtest, as measured by the pretest and posttest, between those students receiving classroom reading instruction only (control group) and those receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho6: Among the bottom 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores on the decoding word identification (real word) subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho7: Among the bottom 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores on the decoding word attack (nonsense word) subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho8: Among the bottom 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores of words spelled correctly on the encoding subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho9: Among the bottom 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores of phonics points on the encoding subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho10: Among the bottom 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores on the DIBELS Oral Reading Fluency subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho11: Among the top 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores on the decoding word identification (real word) subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho12: Among the top 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores on the decoding word attack (nonsense word) subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho13: Among the top 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores of words spelled correctly on the encoding subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho14: Among the top 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores of phonics points on the encoding subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho15: Among the top 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores on the DIBELS Oral Reading Fluency subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Acquisition of Permission
Permission to conduct the study was secured via personal communication by Dr. Dan Barbrow, principal at the elementary school at Bob Jones Academy and Mrs. Patty Fitzgerald, the primary center (grades K4 through 2) supervisor. The four participating first grade teachers also consented to be part of the study via personal communication. A meeting was held between the researcher, administration, and teachers of the treatment groups in the spring of the 2012-2013 school year to discuss scheduling considerations and implementation of the study for the following year. An outline of the study was given to each person with discussion as to the potential timeline for the study to take place in the classrooms (see Appendix A- Dissertation Study Plan). The researcher also described the multisensory techniques and methods that would be used in the classrooms and explained how they relate to the current reading curriculum. The administration and participating teachers were all in agreement on the timeline and format of the intended study within the first-grade classrooms. Dr. Barbrow asked the researcher, and the researcher agreed, to attend each first-grade open house meeting during the fall of the 2013-2014 school year to inform parents of the study. During the open house, a brief explanation of the study was given describing the intention to measure student response to supplemental multisensory methods of phonics instruction added into the reading program. Parents were assured that each child’s information would be kept anonymous and that there would not be any instruction taken away from the current curriculum as part of this study. They were also informed of their right to opt their child out of the research-specific assessments by signing and returning the Request to Opt-Out of Research Study Assessments form (see Appendix B).
Description and Selection of Population and Sample
The sample population includes first-grade students in four classes at Bob Jones Academy in Greenville, South Carolina. There are a total of four classes in the first grade averaging between seventeen and twenty students per class with similar overall class averages on standardized achievement test scores. The two classes that comprised the treatment group were chosen based on teacher-expressed interest in the integration of supplemental multisensory methods within the existing curriculum. The other two first grade classes made up the control group.
The students in this study attend a Christian school that seeks to integrate a biblical worldview within all subject matter. Bob Jones Academy has high standards for student conduct including respect, attentiveness, punctuality, and hard work. While student demographics coupled with the school’s learning environment provide rich educational opportunities, the focus of this study was to examine the extent to which students’ reading skills improved a result of the experimental instructional intervention in relation to students without the experimental intervention.
Research Design
Methods within the Design
“Experimental designs provide the strongest, most convincing arguments of the causal effect of the independent variable because they control for the most sources of internal validity” (McMillan & Schumacher, 2010, p. 278). Within educational research, studies are often conducted on in-tact classes which limit some of the strength of the true experimental design due to the lack of randomization of subjects. This research study is a quasi-experimental pretest-posttest control design, using treatment and control groups, which is a strong alternative structure that controls for most sources of invalidity (McMillan & Schumacher, 2010). The use of a pretest-posttest control design provides the advantage of measuring improvement that students gain as a result of the intervention.
All students within the sample population were given four separate pretests and four separate posttests. The pretests included: two decoding subtests—one that assessed word identification using commonly understood real words (word identification subtest), and one that assessed the ability to connect letter(s) with sounds by decoding nonsense words (word attack subtest); an encoding subtest measuring both: phonics points (use of appropriate phonics rules for spelling words) and words spelled correctly; and a subtest that assessed oral reading fluency (the DORF subtest). The posttests were similar in format to the pretests and covered the three same areas of study (decoding, encoding and oral reading fluency), but were variations on the pretest in order to eliminate recognition of the pretest words.
This study included one treatment group and one control group. The treatment group consisted of two first grade classes at Bob Jones Academy (BJA) and the control group consists of the other two first grade classes. The two classes within the control group received daily instruction from the BJ reading curriculum without any multisensory supplemental instruction. The two classes within the treatment group also received daily instruction from the Bob Jones (BJ) reading curriculum that the researcher supplemented with multisensory instructional methods for 15-20 minutes, three times a week for 12 weeks. The treatment group classroom teachers also reinforced the multisensory methods introduced by the researcher using an implementation checklist with specific instructions as to methods and time allowances for this reinforcement (see Appendix C). All four classroom teachers covered the phonics skills in the order and within the time frame prescribed in the BJ reading curriculum scope and sequence. This ensured that all four classes (treatment and control) were taught the same lesson from the BJ reading curriculum on the same day.
The researcher’s intervention involved supplementing the teaching of the phonics-curriculum concepts from the scope and sequence by using multisensory encoding and decoding instruction that included a kinesthetic-tactile component. Decoding instruction consisted of drilling sounds, blending individual phonemes to form words, using finger-tapping and touching letter tiles as sounds are given, and reading words from word cards. Encoding instruction consists of segmenting individual phonemes within words and correctly associating the letter(s) with these phonemes through kinesthetic-tactile methods of finger-tapping, writing, and forming letter tiles.
The classroom teachers reinforced the (VAKT) methods that focused on both decoding and encoding, by following the implementation checklist mentioned above (see Appendix C). The decoding reinforcement activities included working on individual grapheme-phoneme (letter-sound) correspondences through a daily drill of letters, their associated keywords, and the sounds they make. Encoding instruction was reinforced by the teacher saying the word, students repeating and tapping out the sounds in the word and then writing the word either in the air or on a gel board. A more detailed description of the multisensory methods used by the researcher and the classroom teachers is provided below in the “Description of Supplemental Multisensory Instruction.”
Sample Population Confidentiality and Reliability of the Design
All student data was kept confidential by assigning each student a code number that was unknown to the researcher. Records were divided by class, and by upper and lower 50th reading percentile within each class (as determined by results from the prior year’s Stanford Achievement test total reading scores). Since the DORF (oral reading fluency) subtest, the decoding word identification (real word) subtest and the decoding word attack (nonsense word) subtest must be assessed by the person administering the test as the test is proceeding, the researcher did not administer or score these tests in order to eliminate research bias. Inter-rater reliability of these individually administered tests was established through the pilot study. The encoding subtest were administered by the classroom teachers and directions were given following a scripted format. Because the actual scoring of the encoding subtest required advanced knowledge of phonics concepts that were be taught during the study, the researcher scored each test. However, prior to scoring, a separate evaluator removed personal information from each individual test (ie., student names) and assigned a code number that was unknown to the researcher. The separate evaluator also kept a list as to which group (treatment or control) each test came from and those codes within each group that fall in the top 50th reading percentile and the bottom 50th reading percentile. After all tests were scored, the separate evaluator grouped each code number with its associated test score according to treatment or control group, and within those groups, according to which percentile (bottom 50th or top 50th on the Stanford Achievement test total reading score) the code number belonged, for the researcher to analyze the data. This process helped eliminate any research bias.
The encoding subtest as well as the decoding word identification (real word) and decoding word attack (nonsense word) subtests were created by the researcher. Test validity for each of these was confirmed by an expert panel of three experienced first grade teachers who have taught the same phonics concepts that will be covered in the study, as well as two reading professionals with advanced degrees who are teaching on the university level. The split-halves method (even-odd) was also used to determine the reliability of the test.
Description of Bob Jones Phonics and Reading Program
The Bob Jones first grade reading program consists of six basal readers that increase in difficulty throughout the year. The reading program also has a phonics curriculum that is aligned with the basal readers. This phonics curriculum teaches students to identify the common phonograms, a letter or combination of letters that represent a sound, within words. They use word families containing words that end in similar phonograms to help students practice identifying the similar phonogram and reinforcing the particular sound within words. For example, after the phonogram –ick is taught, students will practice reading through words such as sick, tick, and lick. Reinforcement includes reading through word family lists, completing worksheets, reading stories in the basal readers, and participating in learning center activities.
Description of Supplemental Multisensory Instruction
The multisensory instruction followed a format similar to what is used in the Wilson Reading Series curriculum. The researcher’s lessons, as well as the classroom teachers’ reinforcement lessons were divided into two sections: encoding and decoding. Encoding is the ability to hear a sound(s) and identify the appropriate letter(s) that matches the sound(s). Decoding is the ability to recognize a letter(s) and identify the appropriate sound(s) that it makes.
The difference between the methods used in this study and the Wilson method is that the sequence and time frame of skills taught during this study directly aligned with the skills that were taught and applied in the BJ phonics and reading curriculum scope and sequence as opposed to the Wilson scope and sequence, which teaches these phonics skills in a different order. Additionally, the methods used within this study were a segment of the methods that are used within the Wilson method. The specific multisensory methods of instruction were chosen with the intent of maximizing understanding and reinforcement of letter-sound associations for all students within the regular classroom during the limited time frame available for the intervention. Each of the researcher’s lessons included one or more elements from the decoding sections and one or more elements from the encoding section and were taught for the time frames listed beside the methods below.
The decoding section consisted of five elements:
The encoding section consisted of three elements:
Test Instruments and Data Collection
Overview of Pre- and Posttests
As discussed in the research design section above, the format for the pretest-posttest instrument is divided into three categories: decoding, encoding, and oral reading fluency. The pretests and posttests were alternate forms of each other in order to reduce the possibility of students remembering content from one test to another. Reliability for the alternate forms was established through the split halves method (even-odd). The pretest-posttest design was used for two purposes. First, it was used to determine a baseline level of knowledge for each child’s decoding, encoding, and oral reading fluency skills. This information was used to calculate the level of improvement gained in the posttest score comparison. Second, it was used to determine within-group variances based on the variables listed in the null hypotheses.
Decoding subtests. To assess decoding skills, the researcher developed a word identification subtest and a word attack subtest. The purpose for choosing a researcher-developed test was to provide a more precise assessment of how well students mastered specific classroom curriculum phonics skills that were taught during the study. Words within the test were placed in the order in which they were taught during the study, meaning that the first few words on the test contained phonics rules covered at the beginning of the study, with the last few words containing phonics rules that covered at the end of the study.
Word identification subtest. The word identification subtest involved each student’s timed ability to decode isolated, commonly understood (real) words (see Appendix E). Measurement of a student’s isolated word knowledge is considered a reliable indicator of a student’s oral reading rate. Morris et al. (2010) conducted a study to test the validity of timed word recognition assessments in predicting oral reading rate. The results showed a significant correlation (p ˂ .05). In the present study, the researcher-created word identification subtest contained words that tested phonics skills taught progressively throughout the study.
Evaluation of word identification subtest responses. Students were evaluated by the number of complete words read correctly within a one-minute time sample. If the student hesitated more than 3 seconds, the evaluator scored the word as incorrect and instructed the student to read the next word.
Word attack (nonsense word) subtest. The word attack subtest measured the student’s ability to decode nonsense words (see Appendix E). Using nonsense words forces students to rely upon their understanding and application of the phonics rules they have been taught in order to sound out the words. Since the student is completely unfamiliar with these words, they cannot rely on sight or previous familiarity of those words in the process of decoding. The ability, then, to translate nonsense words into sounds “indicates the presence of a unique process for recognizing printed forms-that is, assembling the pronunciation of a letter string by applying knowledge of typical correspondences between grapheme units and sounds” (Schrank, Wendling, & Woodcock, 2008, p. 26). This researcher-created subtest was similar in format to the Dynamic Indicators of Basic Early Literacy (DIBELS) Nonsense Word Fluency (NWF) subtest. Established reliability for this DIBELS subtest for first grade is .83. The criterion-validity of the DIBELS NWF with the Woodcock-Johnson Psycho-Educational Battery-Revised Readiness Cluster scores is .59 for the middle of first grade (Good & Kaminski, 2002).
Evaluation of word attack (nonsense word) subtest responses. According to the DIBELS scoring guidelines, the benchmark goal for middle first-grade students is 50 correct letter sounds per minute. In this researcher-created subtest, students were presented with a list of nonsense words containing phonics rules that for the pretest, had not yet been taught but would be taught during the course of the study, and, for the posttest, had been taught during the study. The students were asked to verbally produce the individual letter sound (or letter clusters) or read the entire nonsense word. For example, if the student was presented with the word “lin” the student could say /l/ /i/ /n/, or say the word “lin” and receive credit for all three sounds (3/3). On the evaluator’s form, each word was color-coded according to the number of phonemes in that particular word (see Appendix D). Scores were based on whether the student correctly sounded out each phoneme in that word; and thus, partial credit could be awarded for each word. Similar to the previous example of the nonsense word “lin,” if the student pronounced it as /l/ /i/ /m/, then the student only received credit for identifying the /l/ and /i/ sounds and received a score of 2/3. After one-minute, the evaluator placed a line under the last word read, but each student continued reading until either the whole list had been read or a ceiling of five consecutive wrong answers (measured by incorrect reading of the nonsense word) was reached, whichever came first. This enabled the researcher to evaluate the timed reading of nonsense words and measure the level of decoding ability in relationship to the phonics skills that were covered within this list. Five consecutive wrong answers are a common stopping point for diagnostic evaluations such as the Woodcock Reading Mastery Test and the Brigance Diagnostic Comprehensive Inventory of Basic Skills (Woodcock, 2011; Brigance, 1999). Insertions and self-corrections were ignored. Hesitations of more than three seconds were scored as incorrect. The total amount of phonemes in each word for the entire test were tabulated and student scores reflected how many phonemes were correctly identified.
Validity and reliability of decoding (word identification and word attack) subtests. The researcher-created decoding subtests were reviewed by a panel of three experts in the field of lower elementary reading in order to establish the tests’ validity. Each individual on this panel has taught these BJ phonics rules from the reading curriculum for over 8 years and is knowledgeable in her understanding of the phonics rules contained in the words within these decoding subtests. Because the researcher supplemented and the classroom teachers reinforced phonics concepts that were already being taught with the current curriculum, the words on these decoding assessments contained the same phonics rules that were addressed in the BJ Reading curriculum scope and sequence. It is important to note that standards in this curriculum are aligned in similar format with state and national standards. According to the BJ Press website (2013),
BJ Press has consulted national and state standards when developing new textbooks and revising previous editions. Many BJU Press textbooks include charts that illustrate our adherence to national standards wherever possible. We often consult the standards from the “big three” states- Florida, California, and Texas- in addition to consulting standards
from other states that are viewed highly for their standards in a particular content area.
The panel compared each word in these decoding subtests with the BJ Reading curriculum scope and sequence to confirm that the assessments would cover those skills taught during the study. Consistency of measurement reliability for all subtests was established through its administration to ten first-grade students in the pilot study. A separate split-halves method was conducted on both alternate forms and compared to determine content reliability of both tests. Data analysis was conducted using SPSS software, and Spearman Brown Coefficient was used to determine the correlation coefficient.
Encoding subtest. The second category of evaluation involves a measurement of encoding ability (see Appendix F). Encoding, which is very similar to spelling, requires the ability to discern language by segmenting sounds (phonemes) and translating them to letters (graphemes). The Woodcock-Johnson III Test of Achievement (WJ III) evaluates student ability to map sounds to letters through an encoding (spelling) test containing nonsense words. The difference between the WJ III and the researcher-created subtest is that real words were used for the researcher-created encoding subtest and those words only contained phonics rules taught during the study. Each encoding test was administered by the classroom teachers. Student response sheets were collected by an alternate evaluator and assigned each student a code number unknown to the researcher in order to prevent possible bias during researcher-scoring of student results. Similar to the word identification and word attack subtests, the encoding pretest and posttest were alternate forms evaluating the same skills.
Evaluation of encoding subtest responses. Because systematic and explicit multisensory language instruction involves the study of word patterns and the reciprocal relationship between decoding and encoding (Weiser, 2010), the following format for the encoding evaluation form was chosen to reflect this understanding. The researcher created a table similar in format to the Words Their Way Elementary Spelling Inventory (Bear et al., 2008) in order to evaluate students’ abilities to spell each word correctly and their knowledge of word patterns taught during the study.
In the same way as the Words their Way evaluation form, the researcher-created evaluation form assessed student understanding of phoneme-grapheme relationships using invented and developmental spelling knowledge. It did so by separating each word into its individual phonemic components. These phonemic components, which correspond with the phonics and spelling skills that were taught during the study, were placed on a grid across the top of the form. Evaluation consisted of the following letter-sound association skills and measured understanding of the following spelling rules: beginning sounds, short vowels, final sounds, blends, digraphs, glued sounds, long vowels, diphthongs, consonant-le sounds, suffixes, doubled consonants, soft c/soft g, r-controlled, and trigraphs. Student scores are separated into two separate components on this test. The first component consisted of words that were spelled correctly. The second component consisted of the individual phonemic elements within each word (called “phonics points” on the subtest). Students were given credit for applying the correct phonics rule to the word even if the word was spelled incorrectly. For example, the word “fight” contains three separate phonemic components: /f/, /ī/, /t/. The student received full phonics points credit for spelling this word as “fight” or “fite” because correct phonics rules were used to spell the word.
Validity and reliability of encoding subtest. According to Pearson Instructional Resources (2013), the Words Their Way spelling program is now listed as part of an “Instructional Intervention Tool on the National Center on Response to Intervention (NCRTI) website” (p. 1). Sterbinsky (2007) conducted a study to determine validity and reliability for the elementary-age version of Words Their Way Spelling Inventory, which is similar in format to the researcher-created encoding subtest. Eight hundred sixty-two students were evaluated. According to Sterbinsky (2007), “examination of the internal consistency of the instrument yielded an overall reliability coefficient of .915 (Cronbach’s alpha)” (p. 9). Test-retest reliabilities ranged from .931 to .974 and were statistically significant at the p˂.001 level.
Validity for the researcher-created test and evaluation form was established by the same expert panel of three professionals in the field of lower elementary reading that reviewed the decoding subtest. Each word on the pretest and its variation on the posttest and the scoring guidelines for those words on the evaluation form were carefully compared to the word study skills that are covered in the BJ Reading curriculum scope and sequence to determine that skills assessed are those that will be taught during the study. The encoding subtest pretest and posttest were administered by the classroom teachers. Directions were administered following a scripted format similar to the recommendations of the Words Their Way scripted instructions (see Appendix M). Because the actual scoring of the encoding subtest required advanced knowledge of phonics concepts that were taught during the study, the researcher scored each test.
Prior to scoring, a separate evaluator removed personal information (i.e., student names) from each individual test and assigned each student a code number unknown to the researcher. The separate evaluator kept a list as to the assigned code number for each student, and whether the student was in the treatment or control group. During the scoring process, the researcher did not know whether the test came from the treatment group or the control group. After all tests were scored and prior to data analysis by the researcher, the separate evaluator grouped each code number with its associated test score according to treatment or control group, and within those groups, whether each student was in the bottom 50th or the top 50th percentile relative to their peers on the Stanford Achievement Reading Test. This process helped to eliminate any research bias. Consistency of measurement reliability for the subtest was established through its administration to ten first-grade students in the pilot study. Separate split-halves method were conducted on both pretest and the alternate-form posttest and compared to determine reliability of both tests. Data analysis was conducted using SPSS software, and Spearman Brown Correlation Coefficient was used to determine the correlation coefficient.
Oral Reading Fluency Subtest. The third category of evaluation involved a measurement of each student’s ability to accurately decode (read) connected text. With application to reading, the skill most often measured to indicate reading proficiency is oral reading fluency. A reliable indicator of student reading fluency is the assessment of how many words are read correctly in a one-minute oral reading sample (Deno, 1982; Morris et al., 2010; Fuchs & Fuchs, 1999). The posttest reading sample was a variation on the pretest reading sample, testing the same phonics skills that were covered during the study.
Evaluation of the oral reading fluency subtest assessment. Students were assessed in this format using the DIBELS Oral Reading Fluency (DORF) assessment, which is a standardized, individually administered test of accuracy and fluency of connected text. The DORF assessment measured how well a student reads aloud a passage for a one-minute time period. All omissions, substitutions, and hesitations of more than three seconds were considered errors. Self-corrections within three seconds were considered accurate. The oral reading rate is the number of words read correctly from the passage in one-minute. Each student read three passages. Each passage was read for one-minute and scored separately. The average of the three scores was taken as a marker of the student’s oral reading fluency ability.
Validity and reliability of oral reading fluency subtest. DORF assessments are modeled after the Curriculum-Based Measurement (CBM) of reading, which is a form of progress monitoring assessments. These tests use a prescriptive form of measurement procedures (Stecker, Fuchs & Fuchs, 2005) and are used to assess student progress towards end of the year objectives rather than just measuring the short-term skills that the student has learned. The DORF has twenty alternate oral reading fluency passages for first grade. Test-retest reliabilities of CBM reading measures using alternate forms of different reading passages assessing the same level ranged from .89 to .94. Additionally, eight different studies using DORF CBM reading measures reported coefficients ranging from .52 to .91 (Good & Kaminski, 2002).
Validity was established by testing the readability estimates. The Spache readability estimate was used to “revise and refine reading passages . . . because a second-grade analysis of the relation between readability formulas and empirical pattern of children’s reading found the most support for the SPACHE formula” (Good & Kaminski, 2002, p. 2). Therefore, using this readability formula, alternate form passages were revised and refined to precisely measure fluency of skills to be taught during the study.
Data Analysis of Study Assessments
An analysis of data was conducted during the spring of the 2013-2014 school year, following the intervention study in the classrooms. Pretest and posttest assessments for the encoding subtests were scored by the researcher, while pretest and posttest assessments for the decoding word identification and word attack subtests, as well as the oral reading fluency subtests were scored by two separate evaluators. Student scores on the decoding word identification subtest were based upon the total number of words read within a one-minute timed sample. Student scores on the decoding word attack subtest were calculated by the amount of phonemes pronounced within each word until five consecutive words were read incorrectly. Student scores on the encoding skills subtest components, “words spelled correctly” and “phonics points,” were calculated using the evaluation guide established by the researcher (see Appendix F). Student scores on the DORF were calculated by the answer key established in the instrument. The data was entered into the Statistical Package for the Social Sciences (SPSS) statistical software to analyze and test the null hypotheses.
Content validity for the decoding word attack and word identification subtests as well as the encoding researcher-created subtests, was created using the Spearman Brown Coefficient. An independent samples t-test for null hypotheses one through five, was used to determine significant difference in improvement scores between the pre- and posttest assessment on group means for the decoding word identification, decoding word attack, encoding, and oral reading fluency evaluations.
Pilot Study
The researcher conducted a pilot study in order to determine appropriate reliability of instrument measures and to test statistical analysis procedures for measuring student differences. The independent variable was the teaching methods and included two levels: classroom curriculum reading instruction only for the control group and classroom curriculum reading instruction supplemented with multisensory instruction by the researcher and reinforced by the classroom teachers for the treatment group. The dependent variable was improvement scores from pretest to posttest on the following four subtests: decoding word identification, decoding word attack, encoding, and oral reading fluency. The pilot study included the improvement scores on each of the four subtests from 10 first-grade students, five of which were in the treatment group and five of which were in the control group.
Reliability for Researcher-Created Subtests
Content reliability. Statistical correlation coefficients were run for the three researcher-created subtests used in the pilot study: decoding word identification, decoding word attack, and encoding. Because each subtest had an alternate form, data was analyzed on both pretest and posttest for each of these three subtests. According to Hinkle, Wiersma, and Jurs (2003) the rule of thumb is .70 – .90 for ‘high positive correlation’ and .90 + for ‘very high positive correlation’ when establishing content reliability. The data analysis of the Spearman Brown Coefficient yielded .875 for the pretest and .950 for the posttest indicating strong content reliability (see Appendix G). The data analysis for the decoding word attack subtests yielded .882 for the pretest and .845 for the posttest, which also indicates acceptable content reliability (see Appendix H). The data analysis for the encoding subtests yielded .845 for the pretest and .752 for the posttest (see Appendix I). Therefore, content validity was established for all three researcher-created subtests.
Inter-rater reliability. Two evaluators conducted the study assessments for three of the subtests: decoding word identification, decoding word attack, and oral reading fluency. Statistical correlation was conducted using Interclass Correlation Coefficient in SPSS. Average measures for the word identification pretest were 0.980 and the posttest was 0.995 (see Appendix J). Average measures for the decoding word attack pretest were 0.997 and the posttest was 0.996 (see Appendix K). Average measures for the oral reading fluency pretest were 0. 997 and the posttest was 0.999 (see Appendix L). According to Landis and Koch (1977), 0.81-1.0 is an ‘almost perfect’ agreement. Therefore, inter-rater reliability for all three subtests was established through the pilot study.
Data Analysis for the Pilot Study
An analysis of the data for the decoding word identification subtest indicated that there was no significant difference in the constructed mean scores between the treatment and control groups (see Appendix O). However, the equality of means approached significance at 0.58. The null hypothesis stating there was no significant difference between the treatment and control group in decoding word identification skills was accepted. The decoding word attack subtest yielded a .0140 (see Appendix P). Therefore, the null hypothesis stating there was no significant difference between the treatment and control group in the decoding word attack subtest was also accepted. Analysis of the encoding data also revealed no significant differences between the two groups. The encoding test words spelled correctly component yielded 0.18 and the phonics points component yielded 0.158 (see Appendix Q). Both null hypotheses stating there were no significant differences between the two groups in encoding skills were accepted. The oral reading fluency test (see yielded a 0.139 indicated there was no significant difference between the two groups (see Appendix R). The null hypothesis, which there was no significant difference between the two groups in oral reading fluency skills, was accepted. All statistical analysis were set at the .05 level of significance and equal variances were assumed for each subtest.
Sample Size for Study
Four factors must be considered when determining sample size: the level of significance, the power of the test, the standardized effect size, and the treatment levels. Using table C.12. from Hinkle, Wiersma, and Jurs, (2003, p. 655) the following values were used to establish sample size for this dissertation study:
The appropriate sample size for this study would be a minimum of 15 students.
ANALYSIS OF STUDY DATA
The analysis of study data is drawn from the following sections: (a) restatement of the problem, (b) restatement of research questions, (c) restatement of null hypotheses, (d) description of the sample, (e) experiment and data collection procedure, and (f) testing of the null hypotheses.
Restatement of the Problem
The purpose of this study was to determine whether and to what extent the decoding, encoding and oral reading fluency skills of first-grade students using the Bob Jones basal reading program were affected depending upon one of two treatments of classroom instruction received: (1) classroom reading program with no supplemental reinforcement, and (2) classroom reading program supplemented with multisensory methods taught by the researcher with additional classroom teacher reinforcement. These students were evaluated using a combination of researcher-created and professionally developed pretests and posttests in order to examine differences in achievement between the two groups in decoding, which was measured by word attack (nonsense words) and word identification (real words) subtests, as well as encoding and oral reading fluency.
Restatement of Research Questions
This study attempted to answer the following questions related to the inclusion of supplemental multisensory instruction correlated with the classroom basal reading curriculum:
Restatement of Null Hypotheses
Ho1: Among all first-grade students, there is no significant difference in the improvement scores on the decoding word identification (real word) subtest, as measured by the pretest and posttest, between those students receiving classroom reading instruction only (control group) and those receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho2: Among all first-grade students, there is no significant difference in the improvement scores on the decoding word attack (nonsense word) subtest, as measured by the pretest and posttest, between those students receiving classroom reading instruction only (control group) and those receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho3: Among all first-grade students, there is no significant difference in the improvement scores of words spelled correctly on the encoding subtest, as measured by the pretest and posttest, between those students receiving classroom reading instruction only (control group) and those receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho4: Among all first-grade students, there is no significant difference in the improvement scores of phonics points on the encoding subtest, as measured by the pretest and posttest, between those students receiving classroom reading instruction only (control group) and those receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho5: Among all first-grade students, there is no significant difference in the improvement scores on the DIBELS Oral Reading Fluency subtest, as measured by the pretest and posttest, between those students receiving classroom reading instruction only (control group) and those receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho6: Among the bottom 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores on the decoding word identification (real word) subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho7: Among the bottom 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores on the decoding word attack (nonsense word) subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho8: Among the bottom 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores of words spelled correctly on the encoding subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho9: Among the bottom 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores of phonics points on the encoding subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho10: Among the bottom 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores on the DIBELS Oral Reading Fluency subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho11: Among the top 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores on the decoding word identification (real word) subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho12: Among the top 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores on the decoding word attack (nonsense word) subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho13: Among the top 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores of words spelled correctly on the encoding subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho14: Among the top 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores of phonics points on the encoding subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho15: Among the top 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores on the DIBELS Oral Reading Fluency subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Description of the Sample
There were two first grade classes in the treatment group and two first grade classes in the control group. There were 63 participants in the study, with 33 students in the treatment group and 30 in the control group. Students were categorized within the treatment and control group according to whether their individual scores on the reading subtest of the Stanford Achievement Test, relative only to their first-grade peers at BJA, were above or below the 50th percentile. Given that there was an odd number of students within the treatment group, 16 students were above the 50th percentile and 17 were below, while within the control group the numbers above and below the 50th percentile were equal at 15 each. Tables 1 summarizes the participant demographics.
Table 1
Composition of Treatment and Control Groups
______________________________________________________________________________
Group Above 50th percentile Below 50th percentile Total
______________________________________________________________________________
Treatment 16 17 33
Control 15 15 30
______________________________________________________________________________
Experiment and Data Collection Procedures
Four pretests and four posttests were administered to all students as part of this study. These tests measured word attack, word identification (both of which measure decoding skills), oral reading fluency, and encoding abilities. The word attack, word identification, and oral reading fluency tests were individually administered by two separate evaluators. Inter-rater reliability for the two evaluators was established during the pilot study. The encoding tests were administered to each class as a group by their classroom teacher. Each classroom teacher followed a scripted format to maintain test administration consistency. The pretests were administered during the two weeks prior to the intervention and the posttests were administered during the two weeks following the intervention. Pretests and posttests were alternate forms of each other. Content reliability for both sets of tests was established through statistical analysis using the Spearman Brown Coefficient on student results following the pilot study. The pretests were administered to determine students’ base level knowledge of their application of phonics rules to real words, nonsense words, spelling and connected texts.
The teachers participating in the treatment group met with the researcher for two hours prior to the start of the study to discuss classroom implementation by the researcher and additional supplemental instruction by the teachers. During the study the treatment group teachers met with the researcher once a week to discuss intervention implementation. Prior to the study’s commencing, the researcher developed an implementation checklist that listed the supplemental intervention methods for the treatment group classroom teachers to follow. This checklist was given to the teachers each Monday. As the supplemental intervention methods were completed by the teachers during the week, they marked it on the checklist. Checklists were given back to the researcher each Friday and recorded.
Testing of the Null Hypotheses
Null Hypothesis One
Among all first-grade students, there is no significant difference among all first grade student in the improvement scores on the decoding word identification (real word) subtest, as measured by the pretest and posttest, between those students receiving classroom reading instruction only (control group) and those receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
An independent samples t-test was conducted to test the null hypothesis. Table 2 shows the mean differences and standard deviations for the treatment and control group improvement scores from the pretest to the posttest. An analysis of the data reveals that there was a significant difference in favor of the treatment group, between the improvement scores of the treatment group and control group (p= .000). Thus, the null hypothesis that there is no significant difference in the improvement scores on the decoding word identification (real word) subtest is rejected. Results from this analysis are listed in Table 3.
Table 2
Descriptive Statistics for Ho1 Improvement Scores
______________________________________________________________________________
Group N Mean Improvement Standard Deviation
______________________________________________________________________________
Control 30 2.93 6.69
Treatment 33 10.91 6.18
Table 3
Ho1 Decoding Word Identification Independent T-Test Results
Equality of Variance t df Mean Difference Std. Error Difference p
(Sig.)_________________________________________________________________________..985 -4.92 61 -7.98 1.62 .000
Null Hypothesis Two
Among all first-grade students, there is no significant difference in the improvement scores on the decoding word attack (nonsense word) subtest, as measured by the pretest and posttest, between those students receiving classroom reading instruction only (control group) and those receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
An independent samples t-test was conducted to test the null hypothesis. Table 4 shows the mean differences and standard deviations for the treatment and control group improvement scores from the pretest to the posttest. An analysis of the data reveals that there was a significant difference between the improvement scores of the treatment group and the control group (p= .008). Thus, the null hypothesis that there is no significant difference in the improvement scores on the decoding word attack (nonsense word) subtest is rejected. Results from this analysis are listed in Table 5.
Table 4
Descriptive Statistics for Ho2 Improvement Scores
______________________________________________________________________________
Group N Mean Improvement Standard Deviation
______________________________________________________________________________
Control 30 12.90 26.08
Treatment 33 33.70 33.79
Table 5
Ho2 Decoding Word Attack Independent T-Test Results
Equality of Variance t df Mean Difference Std. Error Difference p
(Sig.)_________________________________________________________________________..042 -2.75 59.49 -20.80 7.57 .008
Null Hypothesis Three
Among all first-grade students, there is no significant difference in the improvement scores of words spelled correctly on the encoding subtest, as measured by the pretest and posttest, between those students receiving classroom reading instruction only (control group) and those receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
An independent samples t-test was conducted to test the null hypothesis. Table 6 shows the mean differences and standard deviations for the treatment and control group improvement scores from the pretest to the posttest. An analysis of the data reveals that there was a significant difference between the improvement scores of the treatment group and the control group (p= .000). Thus, the null hypothesis that there is no significant difference in the improvement scores of the words spelled correctly on the encoding subtest is rejected. Results from this analysis are listed in Table 7.
Table 6
Descriptive Statistics for Ho3 Improvement Scores
______________________________________________________________________________
Group N Mean Improvement Standard Deviation
______________________________________________________________________________
Control 30 11.90 5.67
Treatment 33 19.36 7.02
Table 7
Ho3 Encoding (Words Spelled Correctly) Independent T-Test Results
Equality of Variance t df Mean Difference Std. Error Difference p
(Sig.)_________________________________________________________________________..143 -4.61 61 -7.47 1.62 .000
Null Hypothesis Four
Among all first-grade students, there is no significant difference in the improvement scores of phonics points on the encoding subtest, as measured by the pretest and posttest, between those students receiving classroom reading instruction only (control group) and those receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
An independent samples t-test was conducted to test the null hypothesis. Table 8 shows the mean differences and standard deviations for the treatment and control group improvement scores from the pretest to the posttest. An analysis of the data reveals that there was a significant difference between the improvement scores of the treatment group and the control group (p= .040). Thus, the null hypothesis that there is no significant difference in the improvement scores of the phonics points on the encoding subtest is rejected. Results from this analysis are listed in Table 9.
Table 8
Descriptive Statistics for Ho4 Improvement Scores
______________________________________________________________________________
Group N Mean Improvement Standard Deviation
______________________________________________________________________________
Control 30 21.20 10.31
Treatment 33 27.85 14.28
Table 9
Ho4 Encoding (Phonics Points) Independent T-Test Results
Equality of Variance t df Mean Difference Std. Error Difference p
(Sig.)_________________________________________________________________________..144 -2.100 61 –6.65 3.17 .040
Null Hypothesis Five
Among all first-grade students, there is no significant difference in the improvement scores on the DIBELS Oral Reading Fluency subtest, as measured by the pretest and posttest, between those students receiving classroom reading instruction only (control group) and those receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
An independent samples t-test was conducted to test the null hypothesis. Table 10 shows the mean differences and standard deviations for the treatment and control group improvement scores from the pretest to the posttest. An analysis of the data reveals that there was not a significant difference between the improvement scores of the treatment group and the control group (p= .060). Thus, the null hypothesis that there is no significant difference in the improvement scores on the DIBELS Oral Reading Fluency subtest is accepted. Results from this analysis are listed in Table 11.
Table 10
Descriptive Statistics for Ho5 Improvement Scores
______________________________________________________________________________
Group N Mean Improvement Standard Deviation
______________________________________________________________________________
Control 15 19.63 11.87
Treatment 17 25.76 13.34
Table 11
Ho5 DIBELS Oral Reading Fluency Independent T-Test Results
Equality of Variance t df Mean Difference Std. Error Difference p
(Sig.)_________________________________________________________________________..619 -1.92 61 -6.12 3.19 .060
______________________________________________________________________________
Null Hypothesis Six
Among the bottom 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores on the decoding word identification (real word) subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
An independent samples t-test was conducted to test the null hypothesis. Table 12 shows the mean differences and standard deviations of improvement scores in the treatment and control groups from the pretest to the posttest among the bottom 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores. An analysis of the data reveals that there was a significant difference between the improvement scores of students within the bottom 50th percentile in the treatment group as compared to the control group (p= .001). Thus, the null hypothesis that there is no significant difference in the improvement scores on the decoding word identification (real word) subtest is rejected. Results from this analysis are listed in Table 13.
Table 12
Descriptive Statistics for Ho6 (Bottom 50th) Improvement Scores
______________________________________________________________________________
Group N Mean Improvement Standard Deviation
______________________________________________________________________________
Control 15 4.00 5.72
Treatment 17 12.53 7.20
Table 13
Ho6 (Bottom 50th) Decoding Word Identification Independent T-Test Results
Equality of Variance t df Mean Difference Std. Error Difference p
(Sig.)_________________________________________________________________________..268 3.68 30 -8.53 2.32 .001
Null Hypothesis Seven
Among the bottom 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores on the decoding word attack (nonsense word) subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
An independent samples t-test was conducted to test the null hypothesis. Table 14 shows the mean differences and standard deviations of improvement scores in the treatment and control groups from the pretest to the posttest among the bottom 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores. An analysis of the data reveals that there was a significant difference between the improvement scores of students within the bottom 50th percentile in the treatment group and the control group (p= .014). Thus, the null hypothesis that there is no significant difference in the improvement scores on the decoding word attack (nonsense word) subtest is rejected. Results from this analysis are listed in Table 15.
Table 14
Descriptive Statistics for Ho7 (Bottom 50th) Improvement Scores
_____________________________________________________________________________
Group N Mean Improvement Standard Deviation
______________________________________________________________________________
Control 15 15.80 29.84
Treatment 17 47.94 38.28
Table 15
Ho7 (Bottom 50th) Decoding Word Attack Independent T-Test Results
Equality of Variance t df Mean Difference Std. Error Difference p
(Sig.)_________________________________________________________________________..200 -2.62 30 -32.14 12.26 .014
Null Hypothesis Eight
Among the bottom 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores of words spelled correctly on the encoding subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
An independent samples t-test was conducted to test the null hypothesis. Table 16 shows the mean differences and standard deviations of improvement scores in the treatment and control groups from the pretest to the posttest among the bottom 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores. An analysis of the data reveals that there was a significant difference between the improvement scores students within the bottom 50th percentile in the treatment group and the control group (p= .000). Thus, the null hypothesis that there is no significant difference in the improvement scores of words spelled correctly on the encoding subtest is rejected. Results from this analysis are listed in Table 17.
Table 16
Descriptive Statistics for Ho8 (Bottom 50th) Improvement Scores
______________________________________________________________________________
Group N Mean Improvement Standard Deviation
______________________________________________________________________________
Control 15 9.20 5.32
Treatment 17 20.12 6.58
Table 17
Ho8 (Bottom 50th) Encoding (Words Spelled Correctly) Independent T-Test Results
Equality of Variance t df Mean Difference Std. Error Difference p
(Sig.)_________________________________________________________________________..254 -5.12 30 -10.92 2.13 .000
______________________________________________________________________________
Null Hypothesis Nine
Among the bottom 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores of phonics points on the encoding subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
An independent samples t-test was conducted to test the null hypothesis. Table 18 shows the mean differences and standard deviations of improvement scores in the treatment and control groups from the pretest to the posttest among the bottom 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores. An analysis of the data reveals that there was not a significant difference between the improvement scores students within the bottom 50th percentile in the treatment group and the control group (p= .061). Thus, the null hypothesis that there is no significant difference in the improvement scores of the phonics points on the encoding subtest is accepted. Results from this analysis are listed in Table 19.
Table 18
Descriptive Statistics for Ho9 (Bottom 50th) Improvement Scores
______________________________________________________________________________
Group N Mean Improvement Standard Deviation
______________________________________________________________________________
Control 15 21.40 12.38
Treatment 17 30.41 13.65
Table 19
Ho9 (Bottom 50th) Encoding (Phonics Points) Independent T-Test Results
Equality of Variance t df Mean Difference Std. Error Difference p
(Sig.)_________________________________________________________________________..825 -1.95 30 -.9.01 4.63 .061
______________________________________________________________________________
Null Hypothesis Ten
Among the bottom 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores on the DIBELS Oral Reading Fluency subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
An independent samples t-test was conducted to test the null hypothesis. Table 20 shows the mean differences and standard deviations of improvement scores in the treatment and control groups from the pretest to the posttest among the bottom 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores. An analysis of the data reveals that there was not a significant difference between the improvement scores students within the bottom 50th percentile in the treatment group and the control group (p= .173). Thus, the null hypothesis that there is no significant difference in the improvement scores on the DIBELS Oral Reading Fluency subtest is accepted. Results from this analysis are listed in Table 21.
Table 20
Descriptive Statistics for Ho10 (Bottom 50th) Improvement Scores
______________________________________________________________________________
Group N Mean Improvement Standard Deviation
______________________________________________________________________________
Control 15 21.53 11.32
Treatment 17 27.82 13.83
Table 21
Ho10 (Bottom 50th) DIBELS Oral Reading Fluency Independent T-Test Results
Equality of Variance t df Mean Difference Std. Error Difference p
(Sig.)_________________________________________________________________________..711 -1.40 30 -6.29 4.51 .173
______________________________________________________________________________
Null Hypothesis Eleven
Among the top 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores on the decoding word identification (real word) subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
An independent samples t-test was conducted to test the null hypothesis. Table 22 shows the mean differences and standard deviations of improvement scores in the treatment and control groups from the pretest to the posttest among the top 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores. An analysis of the data reveals that there was a significant difference between the improvement scores students within the top 50th percentile in the treatment group and the control group (p= .002). Thus, the null hypothesis that there is no significant difference in the improvement scores on the decoding word identification (real word) subtest is rejected. Results from this analysis are listed in Table 23.
Table 22
Descriptive Statistics for Ho11 (Top 50th) Improvement Scores
______________________________________________________________________________
Group N Mean Improvement Standard Deviation
______________________________________________________________________________
Control 15 .53 8.68
Treatment 16 9.63 5.52
Table 23
Ho11 (Top 50th) Decoding Word Identification Independent T-Test Results
Equality of Variance t df Mean Difference Std. Error Difference p
(Sig.)_________________________________________________________________________..205 -3.50 29 -9.10 2.60 .002
______________________________________________________________________________
Null Hypothesis Twelve
Among the top 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores on the decoding word attack (nonsense word) subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
An independent samples t-test was conducted to test the null hypothesis. Table 24 shows the mean differences and standard deviations of improvement scores in the treatment and control groups from the pretest to the posttest among the top 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores. An analysis of the data reveals that there was not a significant difference between the improvement scores students within the top 50th percentile in the treatment group and the control group (p= .119). Thus, the null hypothesis that there is no significant difference in the improvement scores on the decoding word attack (nonsense word) subtest is accepted. Results from this analysis are listed in Table 25.
Table 24
Descriptive Statistics for Ho12 (Top 50th) Improvement Scores
______________________________________________________________________________
Group N Mean Improvement Standard Deviation
______________________________________________________________________________
Control 15 6.67 11.44
Treatment 16 16.63 21.61
Table 25
Ho12 (Top 50th) Decoding Word Attack Independent T-Test Results
Equality of Variance t df Mean Difference Std. Error Difference p
(Sig.)_________________________________________________________________________..022 -1.62 23.10 -9.96 6.16 .119
______________________________________________________________________________
Null Hypothesis Thirteen
Among the top 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores of words spelled correctly on the encoding subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
An independent samples t-test was conducted to test the null hypothesis. Table 26 shows the mean differences and standard deviations of improvement scores in the treatment and control group from the pretest to the posttest among the top 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores. An analysis of the data reveals that there was not a significant difference between the improvement scores students within the top 50th percentile in the treatment group and the control group (p= .092). Thus, the null hypothesis that there is no significant difference in the improvement scores of words spelled correctly on the encoding subtest is accepted. Results from this analysis are listed in Table 27.
Table 26
Descriptive Statistics for Ho13 (Top 50th) Improvement Scores
______________________________________________________________________________
Group N Mean Improvement Standard Deviation
______________________________________________________________________________
Control 15 14.60 4.76
Treatment 16 18.56 7.59
Table 27
Ho13 (Top 50th) Encoding (Words Spelled Correctly) Independent T-Test Results
Equality of Variance t df Mean Difference Std. Error Difference p
(Sig.)_________________________________________________________________________..048 -1.75 25.44 -3.96 2.26 .092
______________________________________________________________________________
Null Hypothesis Fourteen
Among the top 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores of phonics points on the encoding subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
An independent samples t-test was conducted to test the null hypothesis. Table 28 shows the mean differences and standard deviations of improvement scores in the treatment and control group from the pretest to the posttest among the top 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores. An analysis of the data reveals that there was a significant difference between the improvement scores students within the top 50th percentile in the treatment group and the control group (p= .344). Thus, the null hypothesis that there is no significant difference in the improvement scores of phonics points on the encoding subtest is accepted. Results from this analysis are listed in Table 29.
Table 28
Descriptive Statistics for Ho14 (Top 50th) Improvement Scores
______________________________________________________________________________
Group N Mean Improvement Standard Deviation
______________________________________________________________________________
Control 15 21.00 8.18
Treatment 16 25.13 14.86
Table 29
Ho14 (Top 50th) Encoding (Phonics Points) Independent T-Test Results
Equality of Variance t df Mean Difference Std. Error Difference p
(Sig.)_________________________________________________________________________..049 -.97 23.61 -4.13 4.27 .344
______________________________________________________________________________
Null Hypothesis Fifteen
Among the top 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores, there is no significant difference in the improvement scores on the DIBELS Oral Reading Fluency subtest, as measured by the pretest and posttest, between those first-grade students receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
An independent samples t-test was conducted to test the null hypothesis. Table 30 shows the mean differences and standard deviations of improvement scores in the treatment and control group from the pretest to the posttest among the top 50th percentile of students, relative to their peers, within each BJA first grade class on the Stanford Achievement Test total reading scores. An analysis of the data reveals that there was not a significant difference between the improvement scores students within the top 50th percentile in the treatment group and the control group (p= .154). Thus, the null hypothesis that there is no significant difference in the improvement scores on the DIBELS Oral Reading Fluency subtest is accepted. Results from this analysis are listed in Table 31.
Table 30
Descriptive Statistics for Ho15 (Top 50th) Improvement Scores
______________________________________________________________________________
Group N Mean Improvement Standard Deviation
______________________________________________________________________________
Control 15 17.73 12.48
Treatment 16 24.19 12.08
Table 31
Ho15 (Top 50th) DIBELS Oral Reading Fluency Independent T-Test Results
Equality of Variance t df Mean Difference Std. Error Difference p
(Sig.)_________________________________________________________________________..1.000 -1.46 29 -6.45 4.41 .154
______________________________________________________________________________
A summary of all null hypotheses and their significance is listed in Table 32.
Table 32
Summary of Statistical Significance for Null Hypotheses
Null Hypotheses | Dependent Variable | Results | P value |
Ho1 | Word Identification | Rejected | .000 |
Ho2 | Word Attack | Rejected | .008 |
Ho3 | Encoding (Wds. Sp. Cor.) | Rejected | .000 |
Ho4 | Encoding (Phonics Pts.) | Rejected | .040 |
Ho5 | Oral Reading Fluency | Accepted | .060 |
Ho6 | Word Identification | Rejected | .001 |
Ho7 | Word Attack | Rejected | .014 |
Ho8 | Encoding (Wds. Sp. Cor.) | Rejected | .000 |
Ho9 | Encoding (Phonics Pts.) | Accepted | .061 |
Ho10 | Oral Reading Fluency | Accepted | .173 |
Ho11 | Word Identification | Rejected | .002 |
Ho12 | Word Attack | Accepted | .119 |
Ho13 | Encoding (Wds. Sp. Cor.) | Accepted | .092 |
Ho14 | Encoding (Phonics Pts.) | Accepted | .344 |
Ho15 | Oral Reading Fluency | Accepted | .154 |
SUMMARY, CONCLUSIONS, AND RECOMMENDATIONS
This chapter contains the following topics related directly to the summary, conclusion, and recommendations from this study: (a) restatement of the problem; (b) summary of the literature; (c) discussion of the research questions; (d) summary of the methodology; (e) discussion and summary of null hypotheses results; (f) limitations of the study; (g) implications of the study; and (h) recommendations for further research.
Restatement of the Problem
The purpose of this study was to determine whether and to what extent the decoding, encoding and oral reading fluency skills of first-grade students using the Bob Jones basal reading program were affected depending upon one of two treatments of classroom instruction received: (1) classroom reading program with no supplemental reinforcement, and (2) classroom reading program supplemented with multisensory methods taught by the researcher with additional classroom teacher reinforcement. These students were evaluated using a combination of researcher-created and professionally developed pretests and posttests in order to examine differences in achievement between the two groups in decoding, which was measured by word attack (nonsense words) and word identification (real words) subtests, as well as encoding and oral reading fluency.
Summary of the Literature Review
The review of literature discussed the following elements: critical components of reading acquisition, factors contributing to children’s reading difficulties, and the history and study of multisensory language instruction.
Critical Components of Reading Acquisition
According to the National Reading Panel, there are five critical components of reading acquisition: phonemic awareness, phonics, vocabulary, fluency, and comprehension. Each of these components plays a critical role in the process of learning to read. The following summarizes the professional literature as it relates to each of these critical components.
Phonemic awareness (PA) is described as the ability to manipulate the sounds (phonemes) of oral speech. Understanding of the alphabetic principle (through sound-to-letter correspondence) enables the reader to make sense of the sequence of sounds in written form. According to LPA (2004), the stronger the letter/sound association is, the more proficient reading becomes. The NRP conducted a meta-analysis of 52 studies and concluded, based on the results of these studies that “PA training [for reading teachers] benefits not only word reading but also reading comprehension. PA training contributes to children’s ability to read and spell for months, if not years, after the training has ended” (p. 2-40).
Phonics is another critical component of reading acquisition because it teaches the skill of decoding printed language through letter-sound correspondence (Allor, 2002; Anthony et al., 2006). According to Popp (2004), “rather than ensuring students master all the rules for decoding words, phonics provides children with an awareness of word structures, and this awareness, in turn, allows them to generalize the rules they have mastered to read new words” (p. 51). The NRP conducted a meta-analysis of 38 studies to determine the effectiveness of phonics instruction through treatment and control group comparisons. Results from this major study revealed that phonics instruction is highly effective in the younger grades with a mean effect size for kindergarten (d = 0.56), and first grade (d = 0.54). Interestingly, reading comprehension also significantly improved with phonics instruction (d = 0.51).
The third critical component of reading acquisition is vocabulary instruction. This involves learning the meaning of words such that a person can understand those words in context and is a critical component because without an understanding of words, the reader has no way to make sense of what he is reading. The NRP conducted a meta-analysis of 50 studies to determine the best methods for teaching vocabulary and concluded that both direct and indirect instruction positively contribute to reading comprehension. Direct instruction involves introducing new words before reading through a text, working with these words in different contexts over an extended period of time (White, Graves, & Slater, 1990), and teaching word-learning strategies (Lehr & Osborn, 2005). Indirect instruction involves the learning of vocabulary words through conversation with adults, by being read to (Dickinson & Smith, 1994), and by seeing new words through reading by oneself (Herman et al., 1987).
The fourth component of reading acquisition is reading fluency. According to NIL (2002), fluency is the ability to read texts quickly and accurately by reading phrase by phrase rather than word by word (Hooks & Jones, 2002). There are three primary elements that make up fluency: reading rate, reading accuracy, and reading expression (NRP, 2000; Kuhn & Stahl, 2004). Studies have shown that reading fluency positively affects comprehension (Nation & Snowling, 1997; Wise et al., 2010). Given that reading fluency is so important for comprehension, many of the studies conducted on this critical component have focused on how to improve the skill. The two most notable methods for doing so include guided oral reading and repeated readings. The NRP conducted a meta-analysis on one of these two methods—guided oral reading—to determine to what extent it improves reading fluency. The results revealed a moderate effect size (d = 0.41) on reading achievement. The NRP concluded that guided oral reading practices that include feedback, direct instruction, and positive suggestions regarding rate, expression, and accuracy “helped students across a wide range of grade levels to learn to recognize new words, helped them to read accurately and easily, and helped them to comprehend what they read” (p. 1).
The fifth, and most important, element of reading acquisition is comprehension. According to LPA (2004) comprehension is the connection between the reader’s own background knowledge (or schema) to what is being read. Without comprehension, words are just senseless symbols on a page; thus, comprehension is a critical component, and the ultimate goal of reading, because it enables the reader to make sense of these symbols (Brummit-Yale, 2012) and understand their meaning in context with each other. The NRP conducted a meta-analysis of 204 studies to determine the best methods for teaching reading comprehension. These methods are: comprehension monitoring, cooperative learning, graphic and semantic organizers, questions and answers, question generation, story structure, and story summarization. Although the “question generation” method seems to be the most effective individual method of improving comprehension, including all these strategies is considered the most effective means of doing so (NRP, 2000).
Factors Contributing to Children’s Reading Difficulties
Two primary factors affect a child’s reading abilities: his biological make-up and his environment. These categories are not always independent from one another, however. Environmental factors can play a significant role in the development of a child’s brain, which in turn influences his ability to read. On the other hand, a child’s biological make-up and physical limitations will naturally influence the environment in which he learns to read.
In order to better understand the biological factors underlying reading disabilities, many researchers have conducted studies comparing brain images of those with reading disabilities to those without such disabilities. These studies focus primarily on the differences in brain composition and brain function between these two groups. Studies that look at brain composition typically analyze the symmetry of the brain’s left and right hemispheres (Heim & Keil, 2004), as well as the volume of gray and white mater within specific regions of the brain (Booth & Burman, 2001; Klingberg et al., 2000), while studies on brain function investigate the location and amount of brain activity during cognitive tasks (Shaywitz e al., 2002; Stoodley & Stein, 2013).
Booth and Burman (2001) noted that persons with a reading disability have less gray matter in the area of the brain that aids in word identification. Since gray matter is used for processing information, a lesser amount of it naturally correlates to difficulty with word identification processing, and thus, reduced phonological awareness skills. Researchers have also noted differences between the two groups in the amount of white matter in the area of the brain that correlates written words to spoken words. Klingberg et al., 2000 determined that an increase in white matter has been associated with increased reading skills, and that those with reading disabilities have less white matter in this area of the brain than those who do not struggle with reading. This smaller amount of white matter decreases how quickly information is communicated throughout the brain, thus impacting, and likely reducing, a reader’s processing speed (Booth & Burman, 2001).
Additional research reveals that the brains of persons struggling with certain aspects of reading often have an enlarged right hemisphere. Given that the left hemisphere is the area of the brain primarily involved in reading (Leonard et al., 2001; Stoodley & Stein, 2013; Shaywitz & Shaywitz, 2007), the fact that the right side of the brain is enlarged suggests that this hemisphere is used more often during reading, which makes the entire reading process much less efficient.
The question has been raised over whether these differences in brain composition are a cause of reading difficulties or rather the result of reading difficulties. Brain research on pre-readers at risk for reading disabilities show that the structural abnormalities are already in place prior to reading acquisition (Raschle, 2011). While research has not exhausted this area of study, it does suggest the strong possibility that these differences are the cause rather than the result of reading difficulties.
In addition to a different brain composition, persons with reading difficulties also evidence differences in how their brains function in comparison to persons without reading difficulties. In one of the largest studies ever conducted on this subject, Shaywitz and Shaywitz (2002) examined 144 children by taking brain images of them as they were performing reading-related tasks. Approximately half of these children had previously been diagnosed with a reading disability. The results of the study revealed that the fluent readers tended to have a higher amount of activity in the areas of the brain involved in critical reading skills, while those who struggled showed more activity in areas of the brain that are not as directly involved in the efficient processing of reading skills.
These studies provide convincing evidence that both brain composition and brain function differ in persons with reading difficulties when compared to those who do not struggle with reading. These biological brain characteristics, however, are not the only factors that influence reading abilities. Environmental factors play just as much, if not more, of a significant role in the process of learning to read.
A child’s environment consists primarily of his home life and his school life. Probably the largest variable that influences the child’s learning environment at home is the socioeconomic (SES) status of the household. The reason this plays such a large role is because it is so heavily linked to other factors that influence learning. The following variables are often found in low SES families and have the potential to negatively influence a child’s reading skills, although they certainly do not in every case: single parent households (Entwisle & Alexander, 1996); an increased number of siblings (Downey, 2001); and no college or advanced degree on the part of the mother (Brooks-Gunn, Rouse, & McLanahan, 2007). Another primary factor that influences the child’s home learning environment, particularly as it relates to reading, is the extent to which English is spoken in the home. Children who have English as a second language are often referred to as English Language Learners (ELL). In many cases, these children enter school at a disadvantage over their English-speaking counterparts, given that they are still trying to learn and speak English due to their limited exposure to and practice of the language in the home.
A young child’s school environment also plays a significant role in his learning abilities, and particularly on his ability to read. One of the primary factors that affect the school environment, and thus, the learning environment, is the leadership’s commitment to academic excellence (Leithwood et al., 2004; Wilson 2011). Having a strong and capable administrator who is willing and able to take the necessary steps to enhance and strengthen the school’s learning environment will go a long way towards creating an atmosphere where achievement in excellence is the standard. Other factors that play significant roles in student academic achievement, and thus in reading achievement, are the teachers’ expectations for their students (Muller, et al., 1999), the overall school climate as it relates to orderliness and safety (Lee & Bryk, 1989), and the frequency of student evaluations (Wilson, 2011). The more frequently students are evaluated, the sooner gaps in learning are discovered and able to be remedied. When a teacher expects a child to do well, and the school has provided the necessary structure, assessments and tools to give that child the best fighting chance possible, he is far more likely to succeed than if he were in a school in which the commitment to learning is an afterthought.
Explanation of Multisensory Language Instruction
More than ever before, classroom teachers are faced with an increasing array of reading readiness skills, intellectual abilities and learning styles among the students in their classrooms. As a result, it is becoming necessary to provide differentiated instruction to meet the diverse needs of these learners. Many studies have looked at the effectiveness of using various multisensory methods as an answer to meet these needs.
A multisensory approach to language, and particularly, reading, instruction teaches individual phonics skills and other language skills to the point of mastery in a systematic and cumulative manner. Students must gain mastery over prerequisite skills in order to progress forward to more complex skills. The language skills are taught bi-directionally, which means they are practiced in both decoding (sound-to-letter correspondence) and encoding (letter to sound correspondence) exercises. Reading fluency and comprehension skills are increasingly integrated as the student demonstrates an understanding of letter-sound relationships (IMSLEC, 2013; Wilson, 1989; IDA, 2009).
According to the International Multisensory Structured Language Education Council [IMSLEC] (2013) multisensory instruction includes particular content and principles. The content of multisensory instruction includes phonology, sound-symbol association, syllable instruction, morphology, syntax, and semantics. The principles of multisensory instruction include the simultaneous use of multiple senses that are taught systematically and cumulatively, direct instruction that is taught diagnostically, and synthetic and analytic instruction.
The goal of using multisensory methods is to create and fortify links between the neurological pathways in the brain that may not have a solid connection (IDA, 2009). Studies suggest that this is best done by using multisensory methods integrated with a phonics-based approach to reading. A dissertation study by Stewart (2011) supports the idea that direct phonics taught to first graders using multisensory methods (as occurred in the study treatment group) is superior to using an embedded phonics approach without a kinesthetic-tactile component (the control group). The study showed that the treatment group showed statistically significant improvement over the control group in their oral reading fluency skills following the intervention.
A study by Wilson and O’Connor (1995) examined the impact of multisensory instruction involving a kinesthetic-tactile component tied in with encoding and decoding to determine its effects on student progress in reading and spelling. Most of the students participating in the study had been in special education and approximately 35% had been retained at least one grade. Results from this study revealed significant student gains in word attack and passage comprehension. The findings revealed a positive correlation between multisensory instruction and student spelling and reading achievement.
Multisensory language instruction has most often been reserved for use with students that are considered struggling readers. If multisensory methods help this group of children, this then raises the question as to whether low-average, average, or even above-average readers can be positively impacted by this method by its use in the regular classroom. Scheffel, Shaw, and Shaw (2008) conducted a large study to determine the impact of multisensory reading instruction on “some risk” readers (low readers) and “low risk” readers (average readers). Both the control group and the treatment group contained a mix of both low and average readers. The control group was taught using strictly the classroom reading curriculum while the treatment group received the same classroom instruction supplemented with the Orton-Gillingham program. The study showed more students in the treatment group than in the control group transitioned out of the some-risk category into the low-risk category following the intervention. Although the greatest benefit was to the lowest readers within the treatment group, the study indicated that this method can be helpful to average readers as well. Trepanier (2009) and Negin (2009) also conducted studies to determine if multisensory methods were effective in the reading classroom at large, as opposed to limited to just for use with struggling readers. These two studies compared the effect on various reading skills that multisensory methods used in conjunction with a classroom basal reading program (treatment group) would have, versus the effect on those same skills when using the basal reading curriculum without the multisensory component. Both studies showed that the treatment groups showed greater levels of reading gains over their counterparts in the control group, thus once again evidencing that multisensory methods can be beneficial to all readers—not just those who are struggling.
Summary of Methodology
The purpose of this study was to determine the effects of multisensory instruction correlated with the Bob Jones reading program on students’ decoding, encoding, and oral reading fluency skills. The sample population included 63 first-grade students at BJA, with 33 students in the treatment group and 30 in the control group. The treatment group received supplemental multisensory instruction that correlated with the BJA basal reading program and was delivered by the researcher three times a week for 15 minutes over a period of 12 weeks. Additionally, the classroom teachers of the treatment group reinforced these multisensory methods throughout the week using an implementation checklist provided by the researcher. Multisensory instruction included encoding and decoding activities directly related to the phonics skills used in the basal readers. The control group only received the basal reading instruction with no additional multisensory methods provided by the researcher or classroom teachers. All 63 students were given pretests prior to the start of the study and posttests at the conclusion of the study. These tests were alternate forms of each other and consisted of decoding word identification (real words), decoding word attack (nonsense words), encoding (spelling and phonics points), and oral reading fluency. The researcher created the decoding word identification, decoding word attack, and encoding subtests and use the commercially- available DIBELS test to evaluate oral reading fluency. The decoding word identification, decoding word attack, and oral reading fluency tests were individually administered by two separate evaluators, neither of which the researcher was. The encoding tests were group- administered by each classroom teacher following a scripted format.
Data was analyzed using the SPSS software to analyze and test the null hypotheses. The statistical analysis used was an Independent T-test on all null hypotheses, the significance level of which were set at the p= .05 level of significance.
Discussion of the Research Questions
The statistical analyses for null hypotheses one through five revealed that supplemental multisensory instruction does positively impact overall student performance in decoding, encoding, and oral reading fluency. Results were statistically significant for both word identification and word attack subtests of decoding proficiency. Results were also significant for encoding proficiency including students’ ability to spell words correctly and apply appropriate phonics rules for the spelling of words. Results approached significance in improved oral reading fluency skills. Therefore, it can be concluded that multisensory instruction does positively impact overall student performance in these specific reading skills.
The statistical analyses for null hypotheses six through ten revealed that supplemental multisensory instruction does impact student performance of those within the bottom 50th percentile, in decoding, encoding, and oral reading fluency. Results were statistically significant for both word identification and word attack subtests of decoding proficiency. Results were significant for the “words spelled correctly” skill of the encoding subtest. The students’ abilities to apply appropriate phonics rules to the spelling of words approached significant at .061, suggesting the supplemental multisensory instruction made a positive contribution to students encoding abilities. Although results were not significant in the students’ oral reading fluency skills, the scores favored the treatment group. Therefore, it can be concluded that multisensory instruction does positively impact overall student performance in these specific reading skills.
The statistical analyses for null hypotheses eleven through fifteen revealed that supplemental multisensory instruction does have a moderate impact on student performance, within the top 50th percentile, in decoding, encoding, and oral reading fluency abilities. Results were statistically significant for the decoding word identification subtest. Although the decoding word attack subtest results were not significant, the treatment group performed better than the control group by an average increase of ten words. Students within the treatment group also performed better than the control group students on both parts of the encoding subtest—words spelled correctly and phonics points—suggesting, the supplemental multisensory instruction made a positive contribution to students encoding abilities. Although results were not significant in the students’ oral reading fluency skills, the scores favored the treatment group by an average increase of seven words per minute. Therefore, it can be concluded that multisensory instruction does positively impact overall student performance in these specific reading skills.
Discussion of Null Hypotheses Results
Null Hypotheses One, Six, and Eleven (Word Identification)
There is no significant difference in the improvement scores on the decoding word identification (real word) subtest, as measured by the pretest and posttest, between:
(Ho1) all first-grade students
(Ho6) students among the bottom 50th percentile, relative to their peers within the BJA first grade class on the Stanford Achievement Test total reading scores
(Ho11) students among the top 50th percentile, relative to their peers within the BJA first grade class on the Stanford Achievement Test total reading scores
receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
An analysis of the results revealed a significant difference in favor of the treatment group in all three subgroups included in the three decoding word identification null hypotheses. In null hypothesis one (entire population), the control group improved 2.93 words per minute and the treatment group improved 10.91 words per minute. The mean difference between these two groups, in null hypothesis one, was 7.98 words per minute with a statistical significance of p= .000. In null hypothesis six (bottom 50th percentile), the control group improved 4.00 words per minute and the treatment group improved 12.53 words per minute. The mean difference between the bottom 50th percentile of students within the treatment and control group was 8.53 words per minute with a statistical significance of p= .001. In null hypothesis eleven (top 50th percentile), the control group improved .53 words per minute and the treatment group improved 9.63 words per minute. The mean difference between the top 50th percentile of students within the treatment and control group was 9.10 words per minute in favor of the treatment group with a statistical significance of p= .002.
Figure 1 illustrates the three different groups, and their mean improvement scores results from the treatment provided during the study. Given the difference in sample size between the entire group and its subgroups (bottom and top 50th percentiles) it is difficult to accurately compare the entire group to these subgroups. It is clear that there was a significant increase in the treatment group across all three comparisons.
Figure 1
Decoding Word Identification Mean Improvement Scores by Group
The purpose of this test was to determine the students’ ability to quickly apply knowledge of phonics rules to the decoding of isolated real words. According to a research study conducted by Morris et al (2010) a timed reading of isolated words was statistically significant in providing a reliable indicator of children’s reading abilities. Significance among all three groups was considerable. These results suggest that the integration of multisensory reading techniques improves a child’s ability to quickly decode words, therefore providing more mental capacity for the skill of comprehending the text.
Null Hypotheses Two, Seven, and Twelve (Word Attack)
There is no significant difference in the improvement scores on the decoding word attack (nonsense word) subtest, as measured by the pretest and posttest, between:
(Ho2) all first-grade students
(Ho7) students among the bottom 50th percentile, relative to their peers within the BJA first grade class on the Stanford Achievement Test total reading scores
(Ho12) students among the top 50th percentile, relative to their peers within the BJA first grade class on the Stanford Achievement Test total reading scores
receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
An analysis of the results revealed a significant difference in favor of the treatment group in the entire population and its subsection of the bottom 50th percentile. There was no significant difference found in the subsection of the top 50th percentile, however the improvement scores were still greater in the treatment group. In null hypothesis two (entire population), the two groups decoded nonsense words until a ceiling of five consecutive words were pronounced incorrectly. The control group improved by 12.90 words and the treatment group improved by 33.70 words. The mean difference between these two groups, in null hypothesis one, was 20.80 words with a statistical significance of p= .008. In null hypothesis six (bottom 50th percentile), the control group improved by 15.80 words and the treatment group improved by 47.94 words. The mean difference between the bottom 50th percentile of students within the treatment and control group was 32.14 words with a statistical significance of p= .014. In null hypothesis twelve (top 50th percentile), the control group improved by 6.67 words and the treatment group improved by 9.63 words. The mean difference between the top 50th percentile of students within the treatment and control group was 9.96 words per minute with a significance of p= .119.
Figure 2 illustrates the three different groups, and their mean improvement scores results from the treatment provided during the study. Comparisons between the top and bottom 50th percentile favor the bottom 50th percentile in positive treatment effects. The mean difference between the top and bottom 50th percentile is 22.18 words, indicating the substantial increase that students in the bottom 50th percentile made in their ability to apply phonics rules to unknown words in comparison to students in the top 50th percentile. These results are consistent with the findings of Scheffel, Shaw, and Shaw (2008), who studied the effects of multisensory language instruction on low and average readers. Although Scheffel, Shaw and Shaw (2010) found that both groups benefitted from the instruction, it was the low readers that benefitted the most. The overall effects extended to the entire group as well.
Figure 2
Word Attack Mean Improvement Scores by Group
According to Schrank, Wendling and Woodcock (2008) the ability to translate this knowledge of phonics rules to the reading of nonsense words “indicates the presence of a unique process for recognizing printed forms-that is, assembling the pronunciation of a letter string by applying knowledge of typical correspondences between grapheme units and sounds” (p. 26). Based on these results, it can be concluded that the multisensory language instruction positively affected students’ ability to decode words never seen before through their knowledge of the phonics rules that were taught.
Null Hypotheses Three, Eight, and Thirteen (Encoding, Words Spelled Correctly)
There is no significant difference in the improvement scores of words spelled correctly on the encoding subtest, as measured by the pretest and posttest, between:
(Ho3) all first-grade students
(Ho8) students among the bottom 50th percentile, relative to their peers within the BJA first grade class on the Stanford Achievement Test total reading scores
(Ho13) students among the top 50th percentile, relative to their peers within the BJA first grade class on the Stanford Achievement Test total reading scores
receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
An analysis of the results revealed a significant difference in favor of the treatment group in the entire population and its subsection of the bottom 50th percentile. There was no significant difference found in the subsection of the top 50th percentile, however the improvement scores approached significance in favor of the treatment group. In null hypothesis three, students were scored according to how many words they spelled correctly. Because the treatment included encoding (spelling) instruction as a means of reinforcing and solidifying the phonics concepts, students were evaluated on their ability to correctly spell words which contained all of the phonics rules that were taught during the study. These results revealed that the control group improved their encoding abilities by 11.90 words and the treatment group improved their encoding abilities by 19.36 words. The mean difference between these two groups, in null hypotheses one, was 7.47 words with a statistical significance of p= .000. In null hypothesis eight (bottom 50th percentile), the control group improved their encoding abilities by 9.20 words and the treatment group improved their encoding abilities by 20.12 words. The mean difference between the bottom 50th percentile of students within the treatment and control group was 10.92 words with a statistical significance of p= .000. In null hypothesis thirteen (top 50th percentile), the control group improved in their encoding abilities by 14.60 words and the treatment group improved in their encoding abilities by 18.56 words. The mean difference between the top 50th percentile of students within the treatment and control group was 3.96 words which approached statistical significance at p= .092.
Figure 3 illustrates the three different groups and their mean improvement score results from the treatment provided during the study. Comparisons between the top and bottom 50th percentile continued to favor the bottom 50th percentile in positive treatment effects. The mean difference between the top and bottom 50th percentile was 6.96 words, thereby showing a reduction in the gap of mean differences between students’ understanding of phonics rules in spelling words, as indicated in the null hypotheses evaluation of phonics points, versus the ability to use the right phonics rules to spell a word correctly, as indicated in the null hypotheses evaluation of words spelled correctly. The researcher hypothesized that the reduction in mean differences between the words spelled correctly and the phonics points null hypotheses, of the top and bottom 50th percentile students, could be due to the fact that many spelling rules were taught during the study that may have aided the treatment group in better recognizing which groups of letters should be chosen in order to spell the word.
Figure 3
Encoding (Words Spelled Correctly) Mean Improvement Scores by Group
According to Popp (2004), a productive way to practice phonics skills is through spelling practice because it helps the student recognize the connection between spoken words and their individual phonemes and the graphemes that represent them. These results reveal that the encoding part of the treatment had a positive impact not only in students’ spelling abilities but also contributed to their overall reading abilities. These findings are similar to those conducted by Blachman et al. (2004), who sought to determine effects of encoding and decoding instruction using multisensory techniques on students’ reading and spelling abilities. They found a moderate-to-strong correlation between the intervention and student improvement in real and nonsense word reading, reading rate, passage reading, and spelling. Based on the results of the current study, it can be concluded that encoding instruction does help students’ overall reading and spelling and should be considered an important part of any phonics and reading program.
Null Hypotheses Four, Nine, and Fourteen (Encoding, Phonics Points)
There is no significant difference in the improvement scores of phonics points on the encoding subtest, as measured by the pretest and posttest, between:
(Ho4) all first-grade students
(Ho9) students among the bottom 50th percentile, relative to their peers within the BJA first grade class on the Stanford Achievement Test total reading scores
(Ho14) students among the top 50th percentile, relative to their peers within the BJA first grade class on the Stanford Achievement Test total reading scores
receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
An analysis of the results revealed a significant difference in favor of the treatment group in the entire population and approached significance in its subsection, the bottom 50th percentile. There was no significant difference found in the subsection of the top 50th percentile, however the improvement scores were greater for the treatment group than the control group. In null hypothesis four (entire population), students were scored according to the amount of appropriate phonics rules they used to spell a word. Therefore, students could be awarded phonics points for a word if they chose a correct phonics rule to spell the word even if they did not spell the word correctly. For example, a student could have received 2/2 phonics points for the word “tie,” if he spelled it “tigh.” The word was not spelled correctly, but the student understood that the “igh” can also make the long /i/ sound at the end of a word.
The results of this evaluation, as indicated in figure 4, revealed that the control group improved their encoding abilities by 21.20 phonics points and the treatment group improved their encoding abilities by 27.85 words. The mean difference between these two groups, in null hypothesis four, was 6.65 phonics points with a statistical significance of p= .040. In null hypothesis nine (bottom 50th percentile), the control group improved their encoding abilities by 21.40 phonics points and the treatment group improved their encoding abilities by 30.41 phonics points. The mean difference between the bottom 50th percentile of students within the treatment and control group was 9.01 phonics points approaching statistical significance at p= .061. In null hypothesis fourteen (top 50th percentile), the control group improved in their encoding abilities by 21.00 phonics points and the treatment group improved in their encoding abilities by 25.13 phonics points. The mean difference between the top 50th percentile of students within the treatment and control group was 4.13 phonics points with a statistical significance of p= .344.
Figure 4
Encoding (Phonics Points) Mean Improvement Scores by Group
Because the Bob Jones curriculum includes a separate phonics component that is taught separately from the reading curriculum, both of which were provided for the treatment and control groups, it is evident that the students within all three comparisons are applying appropriate phonics rules to the spelling of words, even if the words are spelled incorrectly. Figure 4 illustrates this fact with the mean differences of 6.65 for null hypothesis four (entire group), 9.01 for null hypothesis nine (bottom 50th percentile), and 4.13 for null hypothesis thirteen (top 50th percentile). Despite the smaller mean differences, a comparison between the bottom and top 50th percentiles revealed that students in the bottom 50th percentile benefitted the most from the multisensory language instruction.
Null Hypotheses Five, Ten, and Fifteen (Oral Reading Fluency)
There is no significant difference in the improvement scores on the DIBELS Oral Reading Fluency subtest, as measured by the pretest and posttest, between:
(Ho5) all first-grade students
(Ho10) students among the bottom 50th percentile, relative to their peers within the BJA first grade class on the Stanford Achievement Test total reading scores
(Ho15) students among the top 50th percentile, relative to their peers within the BJA first grade class on the Stanford Achievement Test total reading scores
receiving classroom reading instruction only (control group) and first-grade students receiving classroom instruction supplemented with multisensory methods taught by the researcher and reinforced by the classroom teacher (treatment group).
An analysis of the results revealed no significant differences in any of the treatment groups for the three null hypotheses, however the improvement scores favored all three treatment groups. In null hypothesis five, students were evaluated in their ability to read connected text within a one-minute timed sample. Three samples were taken, and the average of these samples was recorded for each student. The control group improved 19.63 words per minute and the treatment group improved 25.76 words per minute. The mean difference between these two groups was 6.12 words per minute which approached statistical significance (p= .060). In null hypothesis ten (bottom 50th percentile), the control group improved 21.53 words per minute and the treatment group improved 27.82 words per minute. The mean difference between the bottom 50th percentile of students within the treatment and control group was 6.29 words per minute with a statistical significance of p= .123. In null hypothesis fifteen (top 50th percentile), the control group improved 17.73 words per minute and the treatment group improved 24.19 words per minute. The mean difference between the top 50th percentile of students within the treatment and control group was 6.45 words per minute with a significance of p= .154. In figure 5, the mean score between the three comparisons is almost identical, indicating that the treatment affects were the same.
Figure 5
Oral Reading Fluency Mean Improvement Scores by Group
These results are consistent with the findings of Bitter and White (2011), who studied the effects of multisensory language instruction on over 1,000 students over a four-year period from kindergarten to third grade. Treatment group students statistically outperformed control group students on oral reading fluency each year in first, second, and third grade indicating the positive impact that multisensory instruction has on these skills.
Table 32
Summary of Analysis of Null Hypotheses
Number Statement Result P
______________________________________________________________________________
Ho1 Among all first-grade students, there is no significant Rejected .000 difference in the improvement scores on the decoding
word identification (real word) subtest, as measured by
the pretest and posttest, between those students receiving
classroom reading instruction only (control group) and
those receiving classroom instruction supplemented with
multisensory methods taught by the researcher and
reinforced by the classroom teacher (treatment group).
Ho2 Among all first-grade students, there is no significant Rejected .008 difference in the improvement scores on the improvement
scores on the decoding word attack (nonsense word)
subtest, as measured by the pretest and posttest,
between those students receiving classroom reading
instruction only (control group) and those receiving
classroom instruction supplemented with multisensory
methods taught by the researcher and reinforced by the classroom teacher (treatment group).
Ho3 Among all first-grade students, there is no significant Rejected .000
difference in the improvement scores of words spelled
correctly on the encoding subtest, as measured by the
pretest and posttest, between all first-grade students
receiving classroom reading instruction only (control
group) and first-grade students receiving classroom
instruction supplemented with multisensory methods
taught by the researcher and reinforced by the classroom
teacher (treatment group).
Ho4 Among all first-grade students, there is no significant Rejected .040
difference in the improvement scores of phonics points
on the encoding subtest, as measured by the pretest and
posttest, between those students receiving classroom
reading instruction only (control group) and first grade
students receiving classroom instruction supplemented
with multisensory methods taught by the researcher and
reinforced by the classroom teacher (treatment group).
Ho5 Among all first-grade students, there is no significant Accepted .060
difference in the improvement scores on the DIBELS
Oral Reading Fluency subtest, as measured by the
pretest and posttest, between those students receiving
classroom reading instruction only (control group) and
those receiving classroom instruction supplemented
multisensory methods taught by the researcher and
reinforced by the classroom teacher (treatment group).
Ho6 Among the bottom 50th percentile of students, relative Rejected .001
to their peers, within each BJA first grade class on the
Stanford Achievement Test total reading scores, there is
no significant difference in the improvement scores on
the decoding word identification (real word) subtest, as
measured by the pretest and posttest, between those first
grade students receiving classroom reading instruction
only (control group) and first-grade students receiving
classroom instruction supplemented with multisensory
methods taught by the researcher and reinforced by
the classroom teacher (treatment group).
Ho7 Among the bottom 50th percentile of students, relative to Rejected .014
their peers, within each BJA first grade class on the
Stanford Achievement Test total reading scores, there is
no significant difference in the improvement scores on
the decoding word attack (nonsense word) subtest, as
measured by the pretest and posttest, between those first
grade students receiving classroom reading instruction
only (control group) and first-grade students receiving
classroom instruction supplemented with multisensory
methods by the researcher and reinforced by the
classroom teacher (treatment group).
Ho8 Among the bottom 50th percentile of students, relative Rejected .000
to their peers, within each BJA first grade class on the
Stanford Achievement Test total reading scores, there
is no significant difference in the improvement scores
of words spelled correctly on the encoding subtest, as
measured by the pretest and posttest, between those first
grade students receiving classroom reading instruction
only (control group) and first-grade students receiving
classroom instruction supplemented multisensory
methods taught by the researcher and reinforced by
the classroom teacher (treatment group).
Ho9 Among the bottom 50th percentile of students, relative Accepted .061
to their peers, within each BJA first grade class on the
Stanford Achievement Test total reading scores, there
is no significant difference in the improvement scores
of phonics points on the encoding subtest, as measured
by the pretest and posttest, between those first grade
students receiving classroom reading instruction only
(control group) and first-grade students receiving
classroom instruction supplemented with multisensory
methods taught by the researcher and reinforced
by the classroom teacher (treatment group).
Ho10 Among the bottom 50th percentile of students, relative Accepted .173
to their peers, within each BJA first grade class on the
Stanford Achievement Test total reading scores, there
is no significant difference in the improvement scores
on the DIBELS Oral Reading Fluency subtest, as
measured by the pretest and posttest, between those
first-grade students receiving classroom reading
instruction only (control group) and first-grade students
receiving classroom instruction supplemented
with multisensory methods taught by the researcher
and reinforced by the classroom teacher (treatment
group).
Ho11 Among the top 50th percentile of students, relative to Rejected .002
their peers, within each BJA first grade class on the
Stanford Achievement Test total reading scores, there
is no significant difference in the improvement scores
on the decoding word identification (real word) subtest,
as measured by the pretest and posttest, between those
first-grade students receiving classroom reading
instruction only (control group) and first grade
students receiving classroom instruction supplemented
with multisensory methods taught by the researcher
and reinforced by the classroom teacher (treatment
group).
Ho12 Among the top 50th percentile of students, relative to Accepted .119
their peers, within each BJA first grade class on the
Stanford Achievement Test total reading scores, there
is no significant difference in the improvement scores
on the decoding word attack (nonsense word) subtest,
as measured by the pretest and posttest, between those
first-grade students receiving classroom reading
instruction only (control group) and first-grade students
receiving classroom instruction supplemented with
multisensory methods t taught by the researcher and
reinforced by the classroom teacher (treatment group).
Ho13 Among the top 50th percentile of students, relative to Accepted .092
their peers, within each BJA first grade class on the
Stanford Achievement Test total reading scores, there
is no significant difference in the improvement scores
of words spelled correctly on the encoding subtest, as
measured by the pretest and posttest, between those
first-grade students receiving classroom reading
instruction only (control group) and first-grade students
receiving classroom instruction supplemented
multisensory methods taught by the researcher and
reinforced by the classroom teacher (treatment group).
Ho14 Among the top 50th percentile of students, relative to Accepted .344
their peers, within each BJA first grade class on the
Stanford Achievement Test total reading scores, there
is no significant difference in the improvement scores
of phonics points on the encoding subtest, as measured
by the pretest and posttest, between those first grade
students receiving classroom reading instruction only
(control group) and first-grade students receiving
classroom instruction supplemented with multisensory
methods taught by the researcher and reinforced by
the classroom teacher (treatment group).
Ho15 Among the top 50th percentile of students, relative to their Accepted .154
peers, within each BJA first grade class on the Stanford
Achievement Test total reading scores, there is no
significant difference in the improvement scores on the
DIBELS Oral Reading Fluency subtest, as measured by
the pretest and posttest, between those first-grade students
receiving classroom reading instruction only (control
group) and first-grade students receiving classroom
instruction supplemented with multisensory methods
taught by the researcher and reinforced
by the classroom teacher (treatment group).
Limitations of the Study
There were several limitations of this study that, if they can be eliminated in future studies on this subject, would cause the results to more closely align with the actual impact of the intervention. These limitations were the delayed start of the study, the use of researcher-created assessments, the limited classroom time available for the supplemental multisensory instruction by the researcher, the small sample size that resulted in the groups that were divided between the top and bottom below 50th percentiles, and the use of intact classes.
The original intention with this dissertation study was to have the researcher, from the beginning of the school year, supplement with multisensory methods each phonics skill as it was being taught to both treatment and control groups by their classroom teachers. Because the study was delayed a month, the students had learned quite a few phonics skills without the multisensory method supplementation.
The limited classroom time available to the researcher for providing intervention instruction also potentially limited to the results this study. The researcher was provided 15 minutes, three times a week to conduct her part of the intervention. However, the treatment classroom teachers were given sufficient time to supplement the instruction through additional reinforcement of the multisensory methods by following an implementation checklist developed by the researcher. Due to the time constraints, the extent of multisensory methods that could be used to supplement the phonics skills being taught was reduced, which potentially limited the full impact the treatment could have on the students’ skills.
When assessing potential impact of the intervention between students in the above and below 50th percentile relative to their peers, the number of students in these sample sizes was small. To compute the above and below 50th percentile, each class was divided into half. Students were either placed in the upper half or lower half depending on their total reading scores on the Stanford Achievement Test. This cut the overall sample size in half. A larger sample size could provide a closer representation of the sample mean to the population mew.
Implications for the Study
An analysis of the study results suggests several implications for early elementary educators to consider. First, educators should consider reviewing their school’s phonics program and consider whether specific components of multisensory language instruction could be added to better meet the needs of all learners within the classroom. The systematic and explicit method of teaching letter-sound correspondences, a major component of multisensory instruction, provides young students with a clear understanding of the connection between written language and spoken language. Implementation such an approach, or elements of it, would include ensuring a step-by-step procession from the introduction of isolated sounds that ends with the reading of controlled texts. As sounds are introduced, pictures with associated keywords should be provided for the students. Students learn to associate the name of the letter(s) with the keyword picture and the sound that it makes. As students learn to blend the sounds into words, the sounds should be color coded initially (ie. yellow for consonants, pink for vowels) in order to help the students, develop their phonemic awareness and their understanding of the phoneme-grapheme correspondence. As students practice reading words, they should have opportunity to identify the specific sounds within words and be given a marking system to mark the sounds within the words (i.e. placing a box around welded sounds). Using controlled text (such as a basal reader) to apply these concepts provides further reinforcement for the phonics skills that the students are learning.
Recommendations for Further Research
The alarming statistics provided by the NCES in 2011 revealed that over 33% of our nation’s fourth graders are reading at or below the Basic reading level on the national reading assessment. Given the results of this and other studies presented in this dissertation, there is a strong potential for multisensory language instruction to fill in some of the learning gaps that are creating such a statistic, but there is a need for further research to validate its effectiveness within the regular classroom. Therefore, this study proposes the need for further research in the following areas:
Appendix A
Dissertation Study Plan
Dissertation Study Plan
Classroom Implementation
Magnetic letter boards– these contain magnetic tiles of all of the letters in the alphabet and special sound letters (Ex: ai, sh, ing). The teacher gives the students a word, students repeat the word, tap out the sounds in the word, and pull out the matching letter tiles that go with each sound.
Appendix B
Parent Opt Out form
Request to OPT OUT of Research Study Assessments
Description of the research and your child’s participation
My name is Christina Sprout and I am the reading tutor at Bob Jones Academy. I will be conducting a dissertation research study in several of the first grade classrooms this school year. The purpose of this research is to measure the effects of using multisensory instruction to systematically teach phonics concepts related to the Bob Jones reading curriculum on students’ progress in several reading-related skills.
During the course of the study, I will be going into specified classrooms and teaching the supplemental multisensory instruction three times a week for 15-20 minutes throughout a portion of this school year. All data compiled from the assessments will not mention your child’s name, and all information gathered on your child will be kept confidential.
Potential Benefits
The use of systematic multisensory language instruction as a supplement to reading instruction has been increasingly used for children having difficulty learning to read. The goal of this research is to gauge the extent to which implementing these techniques impacts struggling and non-struggling students’ reading and spelling abilities when they are used in conjunction with the regular classroom reading curriculum.
Voluntary Participation
All first-grade students will be participating in this study in one capacity or another, whether in a treatment group (where multisensory methods will be used) or in a control group (where traditional classroom curriculum will be used without additional multisensory instruction). Use of your child’s assessments will help provide important statistical information. If you wish for your child NOT to be assessed with my study-specific assessments during the course of this study you may do so. To OPT OUT, please complete and return the form below by Monday, October 21; otherwise it will be assumed that you grant permission for your child to be assessed and for his or her results to be included in the statistical analysis I develop from the study. If you have any questions or concerns, please contact me at 370-1800 ext. 6230 or csprout@bobjonesacademy.net
———————————————————————————————————————————————————
OPT-OUT Request Form
To opt your child out from research study assessments, please sign and return this form by Monday, October 21.
I wish to OPT OUT my child, ___________________________, in _____________________‘s class, (Classroom Teacher’s Name) from taking study-specific assessments during the course of the dissertation research study conducted by doctoral candidate Christina Sprout.
Parent Signature ________________________________________ Date__________________
Appendix C
Implementation Checklist
Implementation Checklist
for Classroom Teachers
Monday | Drill sounds (1 min.) _____ | Tap out sounds in words (decoding) (2 min.) _____ | Spelling Words using magnetic letter boards (encoding) (5 min.) _____ |
Tuesday | Drill Sounds (1 min.) _____ | Tap out sounds in words (decoding) (2 min.) _____ | |
Wednesday | Drill Sounds (1 min.) _____ | Tap out sounds in words (decoding) (2 min.) _____ | Encoding Checkup (7 min.) _____ |
Thursday | Drill Sounds (1 min.) _____ | Tap out sounds in words (decoding) (2 min.) _____ | |
Friday | Drill Sounds (1 min.) _____ | Tap out sounds in words (decoding) (2 min.) _____ |
Appendix D
Decoding Word Identification
Pretest and Posttest
Evaluator Forms
Appendix E
Decoding Word Attack
Pretest and Posttest Evaluator Forms
Appendix F
Encoding
Pretest and Posttest Evaluator Forms
Encoding Pretest Evaluator Form, page 1
Encoding Pretest Evaluator Form, page 2
Encoding Post Test Evaluator Form, page 1
Encoding Post Test Evaluator Form, page 2
Appendix G
Decoding Word Identification
Pretest and Posttest
Split-Halves Reliability Test
Decoding Word Identification Pretest
Case Processing Summary | |||
N | % | ||
Cases | Valid | 10 | 100.0 |
Excludeda | 0 | .0 | |
Total | 10 | 100.0 | |
a. Listwise deletion based on all variables in the procedure. |
Reliability Statistics
Total N of Items Correlation Between Forms Spearman-Brown Coefficient Guttman Split-Half Coefficient | 2 .709 .829 .829 .825 |
Inter-Item Correlation Matrix | ||
odd | even | |
odd | 1.000 | .709 |
even | .709 | 1.000 |
Summary Item Statistics | ||||||||
Mean | Minimum | Variance | N of Items | Maximum | Range | Maximum / Minimum | ||
Inter-Item Correlations | Part 1 | .000 | 1.798E+308 | .000 | 1a (odd) | |||
Part 2 | .000 | 1.798E+308 | .000 | 1b (even) | ||||
Both Parts | .709 | .709 | .000 | 2 | .709 | .000 | 1.000 |
Decoding Word Identification- Posttest Case Processing Summary | |||
N | % | ||
Cases | Valid | 10 | 100.0 |
Excludeda | 0 | .0 | |
Total | 10 | 100.0 | |
a. Listwise deletion based on all variables in the procedure. | |||
Reliability Statistics | |||
Total N of Items Correlation Between Forms Spearman-Brown Coefficient Guttman Split-Half Coefficient | 2 .905 .950 .950 .945 |
Summary-Item Statistics | ||||||||
Mean | Minimum | Variance | N of Items | Maximum | Range | Maximum / Minimum | ||
Inter-Item Correlations | Part 1 | .000 | 1.798E+308 | .000 | 1a (odd) | |||
Part 2 | .000 | 1.798E+308 | .000 | 1b (even) | ||||
Both Parts | .905 | .905 | .000 | 2 | .905 | .000 | 1.000 |
Appendix H
Decoding Word Attack
Pretest and Posttest
Split-Halves Reliability Test
Decoding Word Attack Pretest
Case Processing Summary | |||
N | % | ||
Cases | Valid | 10 | 100.0 |
Excludeda | 0 | .0 | |
Total | 10 | 100.0 | |
a. Listwise deletion based on all variables in the procedure. |
Reliability Statistics
Total N of Items Correlation Between Forms Spearman-Brown Coefficient Guttman Split-Half Coefficient | 2 .790 .882 .882 .882 |
Inter-Item Correlation Matrix | ||
odd | even | |
odd | 1.000 | .790 |
even | .790 | 1.000 |
Summary Item Statistics | |||||||||
Mean | Minimum | Variance | N of Items | Maximum | Range | Maximum / Minimum | |||
Inter-Item Correlations | Part 1 | .000 | 1.798E+308 | .000 | 1a (odd) | ||||
Part 2 | .000 | 1.798E+308 | .000 | 1b (even) | |||||
Both Parts | .790 | .790 | .000 | 2 | .790 | .000 | 1.000 | ||
Decoding Word Attack Posttest
Case Processing Summary | |||
N | % | ||
Cases | Valid | 10 | 100.0 |
Excludeda | 0 | .0 | |
Total | 10 | 100.0 | |
a. Listwise deletion based on all variables in the procedure. |
Reliability Statistics
Total N of Items Correlation Between Forms Spearman-Brown Coefficient Guttman Split-Half Coefficient | 2 .731 .845 .845 .845 |
Inter-Item Correlation Matrix | ||
odd | even | |
odd | 1.000 | .731 |
even | .731 | 1.000 |
Summary Item Statistics | ||||||||
Mean | Minimum | Variance | N of Items | Maximum | Range | Maximum / Minimum | ||
Inter-Item Correlations | Part 1 | .000 | 1.798E+308 | .000 | 1a (odd) | |||
Part 2 | .000 | 1.798E+308 | .000 | 1b (even) | ||||
Both Parts | .731 | .731 | .000 | 2 | .731 | .000 | 1.000 |
Appendix I
Encoding
Pretest and Posttest
Split-Halves Reliability Test
Encoding Pretest
Case Processing Summary | |||
N | % | ||
Cases | Valid | 10 | 100.0 |
Excludeda | 0 | .0 | |
Total | 10 | 100.0 | |
a. Listwise deletion based on all variables in the procedure. Reliability Statistics |
Total N of Items Correlation Between Forms Spearman-Brown Coefficient Guttman Split-Half Coefficient | 2 .745 .854 .854 .827 |
Inter-Item Correlation Matrix | ||
odd | even | |
odd | 1.000 | .745 |
even | .745 | 1.000 |
Summary Item Statistics | ||||||||
Mean | Minimum | Variance | N of Items | Maximum | Range | Maximum / Minimum | ||
Inter-Item Correlations | Part 1 | .000 | 1.798E+308 | .000 | 1a (odd) | |||
Part 2 | .000 | 1.798E+308 | .000 | 1b (even) | ||||
Both Parts | .745 | .745 | .000 | 2 | .745 | .000 | 1.000 |
Encoding Posttest
Case Processing Summary | |||
N | % | ||
Cases | Valid | 10 | 100.0 |
Excludeda | 0 | .0 | |
Total | 10 | 100.0 | |
a. Listwise deletion based on all variables in the procedure. |
Reliability Statistics
Total N of Items Correlation Between Forms Spearman-Brown Coefficient Guttman Split-Half Coefficient | 2 .603 .752 .752 .739 |
Inter-Item Correlation Matrix | ||
Odd | even | |
odd | 1.000 | .603 |
even | .603 | 1.000 |
Summary Item Statistics | ||||||||
Mean | Minimum | Variance | N of Items | Maximum | Range | Maximum / Minimum | ||
Inter-Item Correlations | Part 1 | .000 | 1.798E+308 | .000 | 1a (odd) | |||
Part 2 | .000 | 1.798E+308 | .000 | 1b (even) | ||||
Both Parts | .603 | .603 | .000 | 2 | .603 | .000 | 1.000 | |
Appendix J
Decoding Word Identification Pretest and Posttest
Inter-Rater Reliability
Decoding Word Identification Pretest
Case Processing Summary | |||
N | % | ||
Cases | Valid | 10 | 100.0 |
Excludeda | 0 | .0 | |
Total | 10 | 100.0 | |
a. Listwise deletion based on all variables in the procedure. |
Reliability Statistics | |
Cronbach’s Alpha | N of Items |
.980 | 2 |
Intraclass Correlation Coefficient | |||||||
Intraclass Correlationb | 95% Confidence Interval | F Test with True Value 0 | |||||
Lower Bound | Upper Bound | Value | df1 | df2 | Sig | ||
Single Measures | .960a | .856 | .990 | 49.312 | 9 | 9 | .000 |
Average Measures | .980c | .923 | .995 | 49.312 | 9 | 9 | .000 |
Two-way mixed effects model where people effects are random and measures effects are fixed. | |||||||
a. The estimator is the same, whether the interaction effect is present or not. | |||||||
b. Type A intraclass correlation coefficients using an absolute agreement definition. | |||||||
c. This estimate is computed assuming the interaction effect is absent, because it is not estimable otherwise. |
Decoding Word Identification Posttest
Case Processing Summary | |||
N | % | ||
Cases | Valid | 10 | 90.9 |
Excludeda | 1 | 9.1 | |
Total | 11 | 100.0 | |
a. Listwise deletion based on all variables in the procedure. |
Reliability Statistics | |
Cronbach’s Alpha | N of Items |
.996 | 2 |
Intraclass Correlation Coefficient | |||||||
Intraclass Correlationb | 95% Confidence Interval | F Test with True Value 0 | |||||
Lower Bound | Upper Bound | Value | df1 | df2 | Sig | ||
Single Measures | .991a | .952 | .998 | 284.248 | 9 | 9 | .000 |
Average Measures | .995c | .976 | .999 | 284.248 | 9 | 9 | .000 |
Two-way mixed effects model where people effects are random and measures effects are fixed. | |||||||
a. The estimator is the same, whether the interaction effect is present or not. | |||||||
b. Type A intraclass correlation coefficients using an absolute agreement definition. | |||||||
c. This estimate is computed assuming the interaction effect is absent, because it is not estimable otherwise. |
Appendix K
Decoding Word Attack Pretest and Posttest
Inter-Rater Reliability
Decoding Word Attack Pretest
Case Processing Summary | |||
N | % | ||
Cases | Valid | 10 | 100.0 |
Excludeda | 0 | .0 | |
Total | 10 | 100.0 | |
a. Listwise deletion based on all variables in the procedure. |
Reliability Statistics | |
Cronbach’s Alpha | N of Items |
.997 | 2 |
Intraclass Correlation Coefficient | |||||||
Intraclass Correlationb | 95% Confidence Interval | F Test with True Value 0 | |||||
Lower Bound | Upper Bound | Value | df1 | df2 | Sig | ||
Single Measures | .994a | .976 | .998 | 297.552 | 9 | 9 | .000 |
Average Measures | .997c | .988 | .999 | 297.552 | 9 | 9 | .000 |
Two-way mixed effects model where people effects are random and measures effects are fixed. | |||||||
a. The estimator is the same, whether the interaction effect is present or not. | |||||||
b. Type A intraclass correlation coefficients using an absolute agreement definition. | |||||||
c. This estimate is computed assuming the interaction effect is absent, because it is not estimable otherwise. |
Decoding Word Attack Posttest
Case Processing Summary | |||
N | % | ||
Cases | Valid | 10 | 90.9 |
Excludeda | 1 | 9.1 | |
Total | 11 | 100.0 | |
a. Listwise deletion based on all variables in the procedure. |
Reliability Statistics | |
Cronbach’s Alpha | N of Items |
.997 | 2 |
Intraclass Correlation Coefficient | |||||||
Intraclass Correlationb | 95% Confidence Interval | F Test with True Value 0 | |||||
Lower Bound | Upper Bound | Value | df1 | df2 | Sig | ||
Single Measures | .992a | .960 | .998 | 306.905 | 9 | 9 | .000 |
Average Measures | .996c | .980 | .999 | 306.905 | 9 | 9 | .000 |
Two-way mixed effects model where people effects are random and measures effects are fixed. | |||||||
a. The estimator is the same, whether the interaction effect is present or not. | |||||||
b. Type A intraclass correlation coefficients using an absolute agreement definition. | |||||||
c. This estimate is computed assuming the interaction effect is absent, because it is not estimable otherwise. |
Appendix L
Oral Reading Fluency Pretest and Posttest
Inter-Rater Reliability
Oral Reading Fluency Pretest
Case Processing Summary | |||
N | % | ||
Cases | Valid | 10 | 71.4 |
Excludeda | 4 | 28.6 | |
Total | 14 | 100.0 | |
a. Listwise deletion based on all variables in the procedure. |
Reliability Statistics | |
Cronbach’s Alpha | N of Items |
.997 | 2 |
Intraclass Correlation Coefficient | |||||||
Intraclass Correlationb | 95% Confidence Interval | F Test with True Value 0 | |||||
Lower Bound | Upper Bound | Value | df1 | df2 | Sig | ||
Single Measures | .995a | .980 | .999 | 354.067 | 9 | 9 | .000 |
Average Measures | .997c | .990 | .999 | 354.067 | 9 | 9 | .000 |
Two-way mixed effects model where people effects are random and measures effects are fixed. | |||||||
a. The estimator is the same, whether the interaction effect is present or not. | |||||||
b. Type A intraclass correlation coefficients using an absolute agreement definition. | |||||||
c. This estimate is computed assuming the interaction effect is absent, because it is not estimable otherwise. |
Oral Reading Fluency Posttest
Case Processing Summary | |||
N | % | ||
Cases | Valid | 10 | 71.4 |
Excludeda | 4 | 28.6 | |
Total | 14 | 100.0 | |
a. Listwise deletion based on all variables in the procedure. |
Reliability Statistics | |
Cronbach’s Alpha | N of Items |
.999 | 2 |
Intraclass Correlation Coefficient | |||||||
Intraclass Correlationb | 95% Confidence Interval | F Test with True Value 0 | |||||
Lower Bound | Upper Bound | Value | df1 | df2 | Sig | ||
Single Measures | .998a | .993 | 1.000 | 996.400 | 9 | 9 | .000 |
Average Measures | .999c | .996 | 1.000 | 996.400 | 9 | 9 | .000 |
Two-way mixed effects model where people effects are random and measures effects are fixed. | |||||||
a. The estimator is the same, whether the interaction effect is present or not. | |||||||
b. Type A intraclass correlation coefficients using an absolute agreement definition. | |||||||
c. This estimate is computed assuming the interaction effect is absent, because it is not estimable otherwise. |
Appendix M
Script for Encoding Subtest
Script for Encoding Subtest
“I am going to ask you to spell some words. Spell them the best you can. Some of the words will be easy to spell; some may be difficult. I will say each word one time, use it in a sentence, and repeat the word. Listen carefully to each sound in the word. If you don’t know how to spell a word, spell it the best you can and write down all the sounds you hear.
Words for Pretest
Words for Posttest
Appendix N
Directions for Administering
and Scoring the
Decoding Word Attack Subtest
Script for Administering the Decoding Word Attack Subtest
“Look at this word (show student the nonsense word). We call this a nonsense word, or a make-believe word. Watch as I read this word: ‘/m/ /i/ /b/’ (point under each letter as they are sounded out). I can say the sounds in this word: ‘/m/ /i/ /b/’, or I can read the entire word: “mib” (slide finger across the word while reading it).”
“Now it is your turn to read a nonsense word. Try your best to read this word (point to the nonsense word: “tev”) and say any sounds that you may know.”
Correct Response: /t/ /e/ /v/ or “tev”
Incorrect Response: If the child gives incorrect sounds or hesitates for more than three seconds
“Here are some nonsense words (point to student probe). Read the words the best you can. You may begin.”
Scoring for the Decoding Word Attack Subtest
Letter sounds. Students receive full credit if they sound out each individual phoneme within the word or if they read the entire word.
Partially correct words. Students only receive credit for the specific phonemes with each word that were pronounced correctly. Therefore, partial credit can be awarded for each word.
Repeated sounds. Repeated sounds are ignored.
Hesitations. Hesitations of more than three seconds are scored as incorrect. The evaluator may provide the word and encourage the student to read the next word.
Insertions. Insertions are ignored.
Student Response Student Score
Correct letter sound | /m/ /o/ /t/ | 3/3 |
Partially correct word | /m/ /i/ /t/ | 2/3 |
/m/ /o/ /d/ | 2/3 | |
Repeated Sounds | /m/ /o/ /t/ /t/ | 3/3 |
Hesitations of more than 3 seconds | /m/ /o/ (3 sec) Teacher Prompt: /t/, | 2/3 |
Insertions | /m/ /o/ /s/ /t/ | 3/3 |
Appendix O
Pilot Study Analysis for
Decoding Word Identification Subtest
Decoding Word Identification Subtest
T-Test
Group Statistics | |||||
Treatment | N | Mean | Std. Deviation | Std. Error Mean | |
Improvement Score | no treatment | 5 | -2.00 | 1.871 | .837 |
treatment | 5 | 2.40 | 4.037 | 1.806 |
Independent Samples Test | ||||||||||
Levene’s Test for Equality of Variances | t-test for Equality of Means | |||||||||
F | Sig. | t | df | Sig. (2-tailed) | Mean Difference | Std. Error Difference | 95% Confidence Interval of the Difference | |||
Lower | Upper | |||||||||
Improvement Score | Equal variances assumed | 1.116 | .322 | -2.211 | 8 | .058 | -4.400 | 1.990 | -8.989 | .189 |
Equal variances not assumed | -2.211 | 5.642 | .072 | -4.400 | 1.990 | -9.345 | .545 |
Appendix P
Pilot Study Analysis for the
Decoding Word Attack Subtest
Decoding Word Attack Subtest
T-Test
Group Statistics | |||||
Treatment | N | Mean | Std. Deviation | Std. Error Mean | |
Improvement Score | no treatment | 5 | -1.40 | 4.615 | 2.064 |
treatment | 5 | 3.20 | 4.266 | 1.908 |
Independent Samples Test | ||||||||||
Levene’s Test for Equality of Variances | t-test for Equality of Means | |||||||||
F | Sig. | t | df | Sig. (2-tailed) | Mean Difference | Std. Error Difference | 95% Confidence Interval of the Difference | |||
Lower | Upper | |||||||||
Improvement Score | Equal variances assumed | .013 | .912 | –1.637 | 8 | .140 | -4.600 | 2.8110 | -11.081 | 1.881 |
Equal variances not assumed | -1.637 | 7.951 | .141 | -4.600 | 2.8110 | -11.088 | 1.888 |
Appendix Q
Pilot Study Analysis for
Encoding
Subtest
Encoding Subtest- Words Spelled Correctly
T-Test
Group Statistics | |||||
Treatment | N | Mean | Std. Deviation | Std. Error Mean | |
Improvement Scores | no treatment | 5 | 3.00 | 3.937 | 1.761 |
treatment | 5 | 7.00 | 4.637 | 2.074 |
Independent Samples Test | ||||||||||
Levene’s Test for Equality of Variances | t-test for Equality of Means | |||||||||
F | Sig. | t | df | Sig. (2-tailed) | Mean Difference | Std. Error Difference | 95% Confidence Interval of the Difference | |||
Lower | Upper | |||||||||
Improvement Score | Equal variances assumed | .291 | .604 | –1.470 | 8 | .140 | -4.000 | 2.720 | -10.273 | 2.273 |
Equal variances not assumed | -1.470 | 7.795 | .141 | -4.000 | 2.720 | -10.302 | 2.302 |
Encoding Subtest- Phonics Points
T-Test
Group Statistics | |||||
Treatment | N | Mean | Std. Deviation | Std. Error Mean | |
Improvement Scores | no treatment | 5 | 9.20 | 12.071 | 5.398 |
treatment | 5 | 22.80 | 15.336 | 6.859 |
Independent Samples Test | ||||||||||
Levene’s Test for Equality of Variances | t-test for Equality of Means | |||||||||
F | Sig. | t | df | Sig. (2-tailed) | Mean Difference | Std. Error Difference | 95% Confidence Interval of the Difference | |||
Lower | Upper | |||||||||
Improvement Scores | Equal variances assumed | .603 | .406 | -1.558 | 8 | .488 | -158 | -13.600 | -33.727 | 6.527 |
Equal variances not assumed | -1.558 | 7.581 | .488 | -.160 | -13.600 | -33.922 | 7.222 |
Appendix R
Pilot Study Analysis for
Oral Reading Fluency Subtest
Oral Reading Fluency
T-Test
Group Statistics | |||||
Treatment | N | Mean | Std. Deviation | Std. Error Mean | |
Improvement Score | no treatment | 5 | 14.60 | 9.072 | 4.057 |
treatment | 5 | 6.80 | 5.541 | 2.478 |
Independent Samples Test | |||||||||||
Levene’s Test for Equality of Variances | t-test for Equality of Means | ||||||||||
F | Sig. | t | df | Sig. (2-tailed) | Mean Difference | Std. Error Difference | 95% Confidence Interval of the Difference | ||||
Lower | Upper | ||||||||||
Improvement Score | Equal variances assumed | 1.766 | .221 | 1.641 | 8 | .139 | 7.800 | 4.754 | -3.163 | 18.763 | |
Equal variances not assumed | 1.641 | 6.620 | .147 | 7.800 | 4.754 | -3.574 | 19.174 |
Appendix S
Approval for Statistical Procedure