<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">JSS</journal-id><journal-title-group><journal-title>Open Journal of Social Sciences</journal-title></journal-title-group><issn pub-type="epub">2327-5952</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/jss.2024.125029</article-id><article-id pub-id-type="publisher-id">JSS-133646</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Business&amp;Economics</subject><subject> Social Sciences&amp;Humanities</subject></subj-group></article-categories><title-group><article-title>
 
 
  An Exploratory Study of Elementary School Students&amp;#8217; Reading Performance Scores before and after COVID-19
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Timothy</surname><given-names>Goodman</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Patty</surname><given-names>LeBlanc</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>William</surname><given-names>G. LeBlanc</given-names></name><xref ref-type="aff" rid="aff3"><sup>3</sup></xref></contrib></contrib-group><aff id="aff2"><addr-line>College of Education, Southeastern University (Retired), Lakeland, USA</addr-line></aff><aff id="aff1"><addr-line>Marion County Public Schools, Marion, USA</addr-line></aff><aff id="aff3"><addr-line>University of Colorado (Retired), Denver, USA</addr-line></aff><pub-date pub-type="epub"><day>06</day><month>05</month><year>2024</year></pub-date><volume>12</volume><issue>05</issue><fpage>504</fpage><lpage>518</lpage><history><date date-type="received"><day>11,</day>	<month>March</month>	<year>2024</year></date><date date-type="rev-recd"><day>28,</day>	<month>May</month>	<year>2024</year>	</date><date date-type="accepted"><day>31,</day>	<month>May</month>	<year>2024</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  This study explored the reading performance scores of elementary school students in a single Florida school district before and after school closures in spring 2020 due to COVID-19. The nonexperimental study of archival data was designed to explore three subgroups of third-grade students&amp;#8217; &lt;i&gt;i&lt;/i&gt;-Ready reading diagnostic scale scores from five different assessment periods: before school closures in January 2020 and four subsequent assessment periods after face-to-face instruction resumed in fall 2020. The three subgroups included: the initial cohort (&lt;i&gt;N&lt;/i&gt; = 2006), which did not include students in Exceptional Student Education (&lt;i&gt;N&lt;/i&gt; = 580), and students who were designated as English Language Learners (&lt;i&gt;N&lt;/i&gt; = 169). The subgroups did not include students who had been retained at any point in the past. Descriptive statistics were computed for each of the subgroups and reported. The mean scale scores of each subgroup were compared to the 2018-2019 &lt;i&gt;i&lt;/i&gt;-Ready national norms for each of the five assessment periods. The results of the comparisons revealed that each subgroup&amp;#8217;s mean reading scale scores were significantly different from the national norm groups&amp;#8217; mean reading scale scores. The mean reading scores of each subgroup were significantly lower (p &lt; 0.01) than the mean scores of the 2018-2019 national norm groups. Although the students in each of the three subgroups demonstrated small increments of reading progress over time, the rate of progress was not commensurate with the 2018-2019 national norm group&amp;#8217;s rate of progress. This study adds to the body of literature on the influence of COVID-19, school closures, and remote instruction among elementary learners.
 
</p></abstract><kwd-group><kwd>COVID-19</kwd><kwd> Pandemic</kwd><kwd> Reading Performance</kwd><kwd> Reading Achievement</kwd><kwd> Elementary Education</kwd><kwd> Reading Development</kwd><kwd> &lt;i&gt;i&lt;/i&gt;-Ready</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>The onset of the COVID-19 pandemic in the spring of 2020 disrupted educational institutions as they abruptly transitioned from traditional face-to-face (FTF) instruction to online delivery of instruction. Although online instruction existed as an option for students at all levels of education before the global emergency, virtual learning became mandatory in many school districts across the United States during school closures in March 2020  (Sato, 2020) . According to research from  The Department of Education’s Office of Civil Rights (2021) , most educators felt unprepared to provide high-quality instruction in online formats, especially when the transition demanded rapid deployment. Additionally, many families lacked the technical resources to support their children in online environments.</p><p>The research design of this study was a nonexperimental, exploratory study of archival data to examine one research question: What were the reading performance scores of third-grade students before and after the COVID-19 pandemic? The research sample included a single cohort of grade 3 students as they progressed through the fourth grade and the beginning of fifth grade in one school district in central Florida. Reading performance was measured by the students’ scale scores on i-Ready diagnostic tests  (Curriculum Associates, 2019) , which were used by the school district to track reading development among all elementary students in grades 3 - 5 in the district.</p></sec><sec id="s2"><title>2. Brief Overview of Literature</title><p>Researchers have conducted previous studies on the relationships between unscheduled and prolonged interruptions in educational programming and student achievement. For example,  Cooper et al. (1996)  conducted a meta-analytic review of 39 studies on the relationships between summer vacation and math and reading achievement scores from 1906 to 1995. The researchers reported that students from low-income homes demonstrated lower reading skill scores after the summer break; in contrast, students from middle-income families experienced little or no loss in reading skills over the summer. The researchers suggested that this disparity might be attributed to the availability of opportunities and resources for students to practice reading skills during the summer.</p><p>In a more recent study,  Marcotte and Hemelt (2008)  conducted a quantitative study of third-, fifth-, and eighth-grade students to determine whether unscheduled school closures influenced student performance on standardized reading assessments. These researchers found that unscheduled closures before February demonstrated a significant negative effect for third grade reading and math assessments.</p><p> Sandberg Patton and Reschly (2013)  conducted a quantitative study of students’ oral reading fluency (ORF) in grades two through five to determine the influence of summer break on reading growth. The researchers suggested that second- and third-grade students required more help with reading practice when learning to read, while students in later stages of reading development could read independently.</p><p>Immediately after school closures due to COVID-19 in spring 2020,  Dorn et al. (2020)  developed predictive models to predict the differential influences of school closures on learning for minority students and those from low-income homes. These predictions were especially pertinent to the target school district in this study, which is a Title I district. The results of the Dorn et al.’s modeling suggested that high-school students who participated in remote instruction from March 2020 to January 2021 were at-risk for 6 to 7 months of learning loss in mathematics. Minority students and low-income students’ risks for learning loss in mathematics were even greater. The authors suggested that the level of learning loss during remote instruction in the past was related primarily to student disengagement, lack of technology, and lack of internet access.</p><p> Dorn et al. (2020)  also predicted that high-school dropout rates would dramatically increase after school closures based on previous studies of interrupted educational programming. For example, after Hurricane Maria in 2017, 14 to 20% of high-school students never returned to high school  (Declining Enrollment, Shuttered Schools: Puerto Rico’s Education System in Numbers, 2019) . If  Dorn et al.’s (2020)  predictive modeling is found to be accurate in future studies, the influence on the American economy and society could be enormous. The authors offered recommendations to jump-start educational responses to alleviate the deleterious influence of school closures: tutoring programs, summer school, parent education, improvements in online curriculum design and implementation, and professional development for teachers on best practices in remote teaching and learning.</p><p>Each year, Curriculum Associates publishes an annual report entitled “State of Student Learning”. Each annual report describes progress in math and reading of large numbers of students in grades 1 through 8 as measured by i-Ready diagnostic reading and math assessments. The 2022 annual report was of particular interest since it compared reading progress longitudinally and served to assist educators and researchers as they evaluated the influence of the pandemic, school lockdowns, and remote instruction. The results of the longitudinal comparisons in reading performance, typically conducted in May or June of each school year, are depicted in <xref ref-type="fig" rid="fig1">Figure 1</xref> and <xref ref-type="fig" rid="fig2">Figure 2</xref>.</p><p>As indicated in <xref ref-type="fig" rid="fig1">Figure 1</xref> and <xref ref-type="fig" rid="fig2">Figure 2</xref>, the percentages of students who were reading on grade level in Grades 1 and 2 appeared to drop dramatically after the introduction of online instruction in March 2020 and continued after students returned to classroom-based instruction through fall 2022. By third grade, the students’ scores approached historical performance levels by the end of 2021 and 2022, indicating that the students were closing the learning gaps. However, overall percentages of students who were on-level in reading remained relatively consistent to historical scores. These results point directly to reading development theory.</p></sec><sec id="s3"><title>3. Reading Theory and Research</title><p>According to  Chall’s (1995)  and  Chall &amp; Jacobs (2003)  seminal research on reading development, students develop critical reading concepts, skills, and dispositions in an orderly, hierarchical fashion. Skillsets developed in early childhood and the primary grades (kindergarten through second grade) provide the foundation for all future reading development. When the development of the basic skills of reading is interrupted or compromised, especially in early elementary grades, learning gaps can manifest in higher grade levels. Comprehensive research studies substantiate that students who do not learn to read on grade level by grade 3 are likely to continue to need reading support throughout their lives (e.g.,  Aber et al., 2013;   Gersten et al., 2020) . According to  Chall (1995) , critical periods exist during which reading skill development is optimal and maximized; these critical periods build the foundation for continued reading development into adulthood. Theoretically, the possibility of learning loss or reduction in reading performance would be greater during the pandemic for primary-grade students (kindergarten through grade two) who were still learning the basic concepts and skills of reading and who might have difficulty following instructions and responding appropriately in online formats due to undeveloped reading skills and unfamiliarity with keyboards. On the other hand, third-grade readers presumably have already covered and mastered the basics of phonics, decoding, and other elements of reading taught in the primary grades and could be considered independent readers, which would enable them to fully engage in remote instruction.</p><p>This theoretical assumption was confirmed in the 2022 annual report published by Curriculum Associates, which pointed to the challenges and difficulties of teaching the basic skills of reading to young children during remote instruction. The results of extensive analyses of i-Ready data in the 2022 annual publication revealed that the percentages of first-, second-, and third-grade students who were below grade level in phonics increased over time (<xref ref-type="fig" rid="fig3">Figure 3</xref>) during remote instruction due to the pandemic.</p><p>Whether the increases in percentages of below-level students in phonics were directly related to remote instruction is debatable and deserves further investigation. In any case,  Chall’s (1995)  work on reading development over time provides an important foundation for understanding the COVID-19 research and promoting young children’s overall reading development as well as reducing the number of older students who struggle to read.</p><p>Taken as a whole, the preponderance of evidence in the literature substantiates the differential influence of school closures and remote instruction on young students, below-level students, students of color, ELL (English Language Learners) and ESE (Exceptional Student Education) students, homeless students, and students from low-income homes. For these students, research-based interventions must be implemented to reduce the learning gaps found in the current literature. The research on student achievement during the pandemic is growing and should continue for many years to assist future researchers in their efforts to identify and promote the lessons learned during the pandemic.</p></sec><sec id="s4"><title>4. Research Methods and Analyses</title><p>The researchers submitted an official request to the target school district to obtain individual student-level and district-level reading performance data from the district’s database. The resulting dataset included i-Ready composite reading scale scores for each third-grade student in the district for five administrations of i-Ready’s diagnostic assessments before and after school lockdowns and the introduction of online instruction for all students.</p><p>The researchers also requested students’ demographic data to include ESE and ELL designations, and information on whether the students had been retained at any point during their education. For comparison purposes, the 2018-2019 national norms were obtained from the developers of i-Ready at Curriculum Associates.</p><sec id="s4_1"><title>4.1. Research Population and Sample</title><p>In the target school district, approximately 41,000 students were enrolled in kindergarten through Grade 12 during the 2020-2021 school year  (Florida Department of Education, 2021a,   2021b) . The race and ethnic origins of the target district were identified as 48% White, 20% Black or African American, 25% Hispanic, 3% Asian or Pacific Islander, and 5% other. The percentage of households with a computer was 88%, and 81% of the households had broadband internet access. The entire school district was designated as a Title I district. The research population in this study consisted of all third-grade students in the target district during the 2019-2020 academic year. Third-grade students in the target district were chosen for this study since reading performance scale scores were available for all students in grades three through five.</p><p>Demographic information provided by the school district was disaggregated according to the initial cohort, students in Exceptional Student Education (ESE), and students designated as English Language Learners (ELL). Students who had been retained at any point during their education were removed from the entire third-grade sample. In addition, students with missing data were removed from the research sample. The final sample size included 2,006 students in the initial cohort, 580 ESE students, and 169 ELL students. Reading scale scores of each individual student in the study were tracked and compiled as students moved through the fourth grade and the fall of the fifth grade. In other words, the data were composed of individual students’ scaled scores over five different assessment periods.</p></sec><sec id="s4_2"><title>4.2. Instrumentation</title><p>Every elementary student in grades one through five in the target district participated in the i-Ready reading program published by Curriculum Associates and was administered the reading diagnostic tests at the beginning, middle, and end of each academic year. The i-Ready diagnostic tests are computer-based and adaptable to individual student progress; for example, as students progress through instruction in phonics, the online assessment of that skillset decreases in frequency, and comprehension-based assessments increase in frequency.</p><p>Each i-Ready diagnostic assessment provides an overall scale score that represents a comparison of student performance to grade-level norms and grade-level designations for each of the measured stages of reading  (Curriculum Associates, 2019) . For example, a second-grade student might earn a scale score of 432 in the first assessment period, which represents reading at a first-grade level. The same student might test out of the phonological awareness test, perform at first-grade level for phonics, second-grade level for high-frequency words, and first-grade level for vocabulary, literature comprehension, and comprehension of informational text. These assessment results were designed to inform reading instruction by teachers.</p></sec><sec id="s4_3"><title>4.3. Analyses</title><p>After disaggregating the research cohorts’ i-Ready reading datasets based on demographic variables and removing students with missing data, the researchers conducted descriptive and inferential analyses of the i-Ready reading scale scores of the third-grade student subgroups’ scores from five different assessment periods: January 2020 (Grade 3 mid-year assessment before COVID-19 school closures); August 2020 (Grade 4 beginning-of-the-year assessment after schools in the district reopened in August); January 2021 (Grade 4 mid-year assessment period); April 2021 (Grade 4 end-of-the-year assessment period, and August 2021 (the Grade 5 beginning-of-the-year assessment). The inferential analyses included 5 one-sample t-tests of reading scale scores over time to compare to national i-Ready norm scale scores.</p></sec></sec><sec id="s5"><title>5. Results</title><sec id="s5_1"><title>5.1. Descriptive Results</title><p>Preliminary analyses of the research data revealed that the data were normally distributed and that there were no missing data. Cronbach alpha analysis of the student groups revealed a high level of internal consistency in the datasets (α = 0.95). Descriptive statistics were computed to describe the Grade 3 cohorts’ reading performance before and after the school closures (see Tables 1-4 below). The students’ mean scale scores after the January 2020 assessment revealed small increments of reading growth over time after school reopened in August 2020.</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> Descriptive statistics summary table: initial cohort (No ESE or ELL) over time</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Assessment Period/Time</th><th align="center" valign="middle" >Grade Level</th><th align="center" valign="middle" >M</th><th align="center" valign="middle" >SD</th><th align="center" valign="middle" >SEM</th><th align="center" valign="middle" >Min</th><th align="center" valign="middle" >Max</th><th align="center" valign="middle" >Skewness</th><th align="center" valign="middle" >Kurtosis</th></tr></thead><tr><td align="center" valign="middle" >January 2020<sup>a</sup></td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >525.23</td><td align="center" valign="middle" >43.04</td><td align="center" valign="middle" >0.96</td><td align="center" valign="middle" >312.00</td><td align="center" valign="middle" >643.00</td><td align="center" valign="middle" >−0.33</td><td align="center" valign="middle" >0.28</td></tr><tr><td align="center" valign="middle" >August 2020</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >532.76</td><td align="center" valign="middle" >46.16</td><td align="center" valign="middle" >1.03</td><td align="center" valign="middle" >342.00</td><td align="center" valign="middle" >668.00</td><td align="center" valign="middle" >−0.30</td><td align="center" valign="middle" >0.17</td></tr><tr><td align="center" valign="middle" >January 2021</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >545.59</td><td align="center" valign="middle" >47.26</td><td align="center" valign="middle" >1.06</td><td align="center" valign="middle" >298.00</td><td align="center" valign="middle" >683.00</td><td align="center" valign="middle" >−0.47</td><td align="center" valign="middle" >0.72</td></tr><tr><td align="center" valign="middle" >May 2021</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >553.55</td><td align="center" valign="middle" >49.45</td><td align="center" valign="middle" >1.10</td><td align="center" valign="middle" >306.00</td><td align="center" valign="middle" >690.00</td><td align="center" valign="middle" >−0.51</td><td align="center" valign="middle" >0.63</td></tr><tr><td align="center" valign="middle" >August 2021</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >556.35</td><td align="center" valign="middle" >48.40</td><td align="center" valign="middle" >1.08</td><td align="center" valign="middle" >349.00</td><td align="center" valign="middle" >691.00</td><td align="center" valign="middle" >−0.47</td><td align="center" valign="middle" >0.40</td></tr></tbody></table></table-wrap><p>Note. N = 2,006. M = mean; SD = standard deviation; SEM = standard error of measurement; Min = minimum; Max = maximum. <sup>a</sup>These data were the baseline scores for the Grade 3 cohort. Students did not take the May 2020 i-Ready assessment due to school closures, and all the students were promoted to Grade 4 at the end of the 2019-2020 academic year.</p><table-wrap id="table2" ><label><xref ref-type="table" rid="table2">Table 2</xref></label><caption><title> Descriptive statistics summary table: ESE only over time</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Assessment Period/Time</th><th align="center" valign="middle" >Grade Level</th><th align="center" valign="middle" >M</th><th align="center" valign="middle" >SD</th><th align="center" valign="middle" >SEM</th><th align="center" valign="middle" >Min</th><th align="center" valign="middle" >Max</th><th align="center" valign="middle" >Skewness</th><th align="center" valign="middle" >Kurtosis</th></tr></thead><tr><td align="center" valign="middle" >January 2020<sup>a</sup></td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >470.49</td><td align="center" valign="middle" >50.04</td><td align="center" valign="middle" >2.08</td><td align="center" valign="middle" >331.00</td><td align="center" valign="middle" >681.00</td><td align="center" valign="middle" >0.07</td><td align="center" valign="middle" >0.12</td></tr><tr><td align="center" valign="middle" >August 2020</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >475.66</td><td align="center" valign="middle" >52.31</td><td align="center" valign="middle" >2.17</td><td align="center" valign="middle" >333.00</td><td align="center" valign="middle" >688.00</td><td align="center" valign="middle" >0.09</td><td align="center" valign="middle" >0.22</td></tr><tr><td align="center" valign="middle" >January 2021</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >486.78</td><td align="center" valign="middle" >54.24</td><td align="center" valign="middle" >2.25</td><td align="center" valign="middle" >224.00</td><td align="center" valign="middle" >691.00</td><td align="center" valign="middle" >−0.27</td><td align="center" valign="middle" >1.30</td></tr><tr><td align="center" valign="middle" >May 2021</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >495.64</td><td align="center" valign="middle" >55.57</td><td align="center" valign="middle" >2.31</td><td align="center" valign="middle" >304.00</td><td align="center" valign="middle" >709.00</td><td align="center" valign="middle" >−0.12</td><td align="center" valign="middle" >0.11</td></tr><tr><td align="center" valign="middle" >August 2021</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >491.64</td><td align="center" valign="middle" >56.63</td><td align="center" valign="middle" >2.35</td><td align="center" valign="middle" >304.00</td><td align="center" valign="middle" >712.00</td><td align="center" valign="middle" >−0.07</td><td align="center" valign="middle" >0.10</td></tr></tbody></table></table-wrap><p>Note. N = 580 M = mean; SD = standard deviation; SEM = standard error of measurement; Min = minimum; Max = maximum. <sup>a</sup>These data were the baseline scores for the ESE students from the grade 3 cohort. Students did not take the May 2020 i-Ready assessment, and all were promoted to Grade 4.</p><table-wrap id="table3" ><label><xref ref-type="table" rid="table3">Table 3</xref></label><caption><title> Descriptive statistics summary table: ELL only over time</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Assessment Period/Time</th><th align="center" valign="middle" >Grade Level</th><th align="center" valign="middle" >M</th><th align="center" valign="middle" >SD</th><th align="center" valign="middle" >SEM</th><th align="center" valign="middle" >Min</th><th align="center" valign="middle" >Max</th><th align="center" valign="middle" >Skewness</th><th align="center" valign="middle" >Kurtosis</th></tr></thead><tr><td align="center" valign="middle" >January 2020<sup>a</sup></td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >463.46</td><td align="center" valign="middle" >48.89</td><td align="center" valign="middle" >3.76</td><td align="center" valign="middle" >322.00</td><td align="center" valign="middle" >541.00</td><td align="center" valign="middle" >−0.81</td><td align="center" valign="middle" >0.27</td></tr><tr><td align="center" valign="middle" >August 2020</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >477.17</td><td align="center" valign="middle" >52.77</td><td align="center" valign="middle" >4.06</td><td align="center" valign="middle" >312.00</td><td align="center" valign="middle" >592.00</td><td align="center" valign="middle" >−0.83</td><td align="center" valign="middle" >0.71</td></tr><tr><td align="center" valign="middle" >January 2021</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >492.56</td><td align="center" valign="middle" >48.70</td><td align="center" valign="middle" >3.75</td><td align="center" valign="middle" >347.00</td><td align="center" valign="middle" >607.00</td><td align="center" valign="middle" >−0.96</td><td align="center" valign="middle" >0.99</td></tr><tr><td align="center" valign="middle" >May 2021</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >507.39</td><td align="center" valign="middle" >47.81</td><td align="center" valign="middle" >3.68</td><td align="center" valign="middle" >361.00</td><td align="center" valign="middle" >635.00</td><td align="center" valign="middle" >−0.72</td><td align="center" valign="middle" >0.85</td></tr><tr><td align="center" valign="middle" >August 2021</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >506.06</td><td align="center" valign="middle" >44.75</td><td align="center" valign="middle" >3.44</td><td align="center" valign="middle" >340.00</td><td align="center" valign="middle" >587.00</td><td align="center" valign="middle" >−1.06</td><td align="center" valign="middle" >1.66</td></tr></tbody></table></table-wrap><p>Note. N = 169. M = mean; SD = standard deviation; SEM = standard error of measurement; Min = minimum; Max = maximum.</p><table-wrap id="table4" ><label><xref ref-type="table" rid="table4">Table 4</xref></label><caption><title> Comparison of means and standard deviations of three subgroups of students over time</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Assessment Period/Time</th><th align="center" valign="middle" >Grade Level</th><th align="center" valign="middle" >Initial Cohort Mean</th><th align="center" valign="middle" >SD</th><th align="center" valign="middle" >ESE Mean</th><th align="center" valign="middle" >SD</th><th align="center" valign="middle" >ELL Mean</th><th align="center" valign="middle" >SD</th></tr></thead><tr><td align="center" valign="middle" >January 2020<sup>a</sup></td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >525.23</td><td align="center" valign="middle" >43.04</td><td align="center" valign="middle" >470.49</td><td align="center" valign="middle" >50.04</td><td align="center" valign="middle" >463.46</td><td align="center" valign="middle" >48.89</td></tr><tr><td align="center" valign="middle" >August 2020</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >532.76</td><td align="center" valign="middle" >46.16</td><td align="center" valign="middle" >475.66</td><td align="center" valign="middle" >52.31</td><td align="center" valign="middle" >477.17</td><td align="center" valign="middle" >52.77</td></tr><tr><td align="center" valign="middle" >January 2021</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >545.59</td><td align="center" valign="middle" >47.26</td><td align="center" valign="middle" >486.78</td><td align="center" valign="middle" >54.24</td><td align="center" valign="middle" >492.56</td><td align="center" valign="middle" >48.70</td></tr><tr><td align="center" valign="middle" >May 2021</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >553.55</td><td align="center" valign="middle" >49.45</td><td align="center" valign="middle" >495.64</td><td align="center" valign="middle" >55.57</td><td align="center" valign="middle" >507.39</td><td align="center" valign="middle" >47.81</td></tr><tr><td align="center" valign="middle" >August 2021</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >556.35</td><td align="center" valign="middle" >48.40</td><td align="center" valign="middle" >491.64</td><td align="center" valign="middle" >56.63</td><td align="center" valign="middle" >506.06</td><td align="center" valign="middle" >44.75</td></tr></tbody></table></table-wrap><p>Note. SD = Standard Deviation; Initial Cohort N = 2,006; ESE N = 580; ELL N = 169.</p></sec><sec id="s5_2"><title>5.2. Inferential Results</title><p>The researchers compared the research cohorts’ mean reading scale scores to i-Ready’s mean scale scores of the most recent i-Ready national norm group (academic year 2018-2019) for the five assessment periods under study. The results of the t-test comparisons are presented in Tables 5-7 that follow.</p><table-wrap id="table5" ><label><xref ref-type="table" rid="table5">Table 5</xref></label><caption><title> Results of one-sample t-test comparisons of initial cohort’s mean scale scores to i-Ready national mean scale score norms by assessment period</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Assessment Period</th><th align="center" valign="middle" >Cohort M</th><th align="center" valign="middle" >SD</th><th align="center" valign="middle" >National Norm M</th><th align="center" valign="middle" >t</th><th align="center" valign="middle" >p</th><th align="center" valign="middle" >Cohen’s d</th></tr></thead><tr><td align="center" valign="middle" >January 2020</td><td align="center" valign="middle" >525.23</td><td align="center" valign="middle" >43.04</td><td align="center" valign="middle" >552.5</td><td align="center" valign="middle" >−28.37</td><td align="center" valign="middle" >&lt;0.001</td><td align="center" valign="middle" >0.60</td></tr><tr><td align="center" valign="middle" >August 2020</td><td align="center" valign="middle" >532.76</td><td align="center" valign="middle" >46.16</td><td align="center" valign="middle" >557.5</td><td align="center" valign="middle" >−24.00</td><td align="center" valign="middle" >&lt;0.001</td><td align="center" valign="middle" >0.54</td></tr><tr><td align="center" valign="middle" >January 2021</td><td align="center" valign="middle" >545.22</td><td align="center" valign="middle" >47.26</td><td align="center" valign="middle" >590.5</td><td align="center" valign="middle" >−42.91</td><td align="center" valign="middle" >&lt;0.001</td><td align="center" valign="middle" >0.96</td></tr><tr><td align="center" valign="middle" >May 2021</td><td align="center" valign="middle" >553.16</td><td align="center" valign="middle" >49.45</td><td align="center" valign="middle" >616.0</td><td align="center" valign="middle" >−56.91</td><td align="center" valign="middle" >&lt;0.001</td><td align="center" valign="middle" >1.27</td></tr><tr><td align="center" valign="middle" >August 2021</td><td align="center" valign="middle" >556.35</td><td align="center" valign="middle" >48.40</td><td align="center" valign="middle" >616.0</td><td align="center" valign="middle" >−55.19</td><td align="center" valign="middle" >&lt;0.001</td><td align="center" valign="middle" >1.23</td></tr></tbody></table></table-wrap><p>Note. N = 2,006. M = mean; SD = standard deviation; t = t-test; p = probability.</p><table-wrap id="table6" ><label><xref ref-type="table" rid="table6">Table 6</xref></label><caption><title> Results of one-sample t-test comparisons of ESE mean scale scores to i-Ready national mean scale score norms by assessment period</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Assessment Period</th><th align="center" valign="middle" >Cohort M</th><th align="center" valign="middle" >SD</th><th align="center" valign="middle" >National Norm M</th><th align="center" valign="middle" >t</th><th align="center" valign="middle" >p</th></tr></thead><tr><td align="center" valign="middle" >January 2020</td><td align="center" valign="middle" >470.49</td><td align="center" valign="middle" >50.04</td><td align="center" valign="middle" >552.5</td><td align="center" valign="middle" >−39.47</td><td align="center" valign="middle" >&lt;0.001</td></tr><tr><td align="center" valign="middle" >August 2020</td><td align="center" valign="middle" >475.67</td><td align="center" valign="middle" >52.31</td><td align="center" valign="middle" >557.5</td><td align="center" valign="middle" >−37.68</td><td align="center" valign="middle" >&lt;0.001</td></tr><tr><td align="center" valign="middle" >January 2021</td><td align="center" valign="middle" >486.78</td><td align="center" valign="middle" >54.24</td><td align="center" valign="middle" >590.5</td><td align="center" valign="middle" >−42.91</td><td align="center" valign="middle" >&lt;0.001</td></tr><tr><td align="center" valign="middle" >May 2021</td><td align="center" valign="middle" >495.64</td><td align="center" valign="middle" >55.57</td><td align="center" valign="middle" >616.0</td><td align="center" valign="middle" >−56.91</td><td align="center" valign="middle" >&lt;0.001</td></tr><tr><td align="center" valign="middle" >August 2021</td><td align="center" valign="middle" >491.64</td><td align="center" valign="middle" >56.63</td><td align="center" valign="middle" >616.0</td><td align="center" valign="middle" >−55.19</td><td align="center" valign="middle" >&lt;0.001</td></tr></tbody></table></table-wrap><p>Note. N = 580. M = mean; SD = standard deviation; t = t-test; p = probability.</p><table-wrap id="table7" ><label><xref ref-type="table" rid="table7">Table 7</xref></label><caption><title> Results of one-sample t-Test comparisons of ELL mean scale scores to i-Ready national mean scale score norms by assessment period</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Assessment Period</th><th align="center" valign="middle" >Cohort M</th><th align="center" valign="middle" >SD</th><th align="center" valign="middle" >National Norm M</th><th align="center" valign="middle" >t</th><th align="center" valign="middle" >P</th></tr></thead><tr><td align="center" valign="middle" >January 2020</td><td align="center" valign="middle" >463.46</td><td align="center" valign="middle" >48.89</td><td align="center" valign="middle" >552.5</td><td align="center" valign="middle" >−23.67</td><td align="center" valign="middle" >&lt;0.001</td></tr><tr><td align="center" valign="middle" >August 2020</td><td align="center" valign="middle" >477.17</td><td align="center" valign="middle" >52.77</td><td align="center" valign="middle" >557.5</td><td align="center" valign="middle" >−19.79</td><td align="center" valign="middle" >&lt;0.001</td></tr><tr><td align="center" valign="middle" >January 2021</td><td align="center" valign="middle" >492.56</td><td align="center" valign="middle" >48.70</td><td align="center" valign="middle" >590.5</td><td align="center" valign="middle" >−26.14</td><td align="center" valign="middle" >&lt;0.001</td></tr><tr><td align="center" valign="middle" >May 2021</td><td align="center" valign="middle" >507.39</td><td align="center" valign="middle" >47.81</td><td align="center" valign="middle" >616.0</td><td align="center" valign="middle" >−29.53</td><td align="center" valign="middle" >&lt;0.001</td></tr><tr><td align="center" valign="middle" >August 2021</td><td align="center" valign="middle" >506.06</td><td align="center" valign="middle" >44.75</td><td align="center" valign="middle" >616.0</td><td align="center" valign="middle" >−31.94</td><td align="center" valign="middle" >&lt;0.001</td></tr></tbody></table></table-wrap><p>Note. N = 169. M = mean; SD = standard deviation; t = t-test; p = probability.</p><p>The students in each of the subgroups in this study performed significantly lower in reading performance when compared to the 2018-2019 pre-COVID national norm group, which included all three types of students. The differences were observed prior to the pandemic in the January 2020 assessment period, just before the introduction of remote teaching and learning due to COVID-19. In addition, the mean reading scale scores of the subgroups were consistently lower than the 2018-2019 national norm group in each of the five assessment periods. Although the students in this study demonstrated progress over time, the rate of progress was not commensurate with the progress of the 2018-2019 national norm group.</p></sec></sec><sec id="s6"><title>6. Discussion</title><p>Many educational stakeholders were deeply concerned about learning loss when students returned to classrooms in the fall of 2020. In a meta-analysis of the relationships between summer vacation and student achievement in Grades 1 through 8,  Cooper et al. (1996)  found that, on average, readers experienced a loss of 1.5 months in reading skills. However, the third-grade students in the current research study were able to maintain their reading skills during remote instruction and the summer months; in fact, the initial cohort’s mean reading scale score went up slightly from January 2020 to August 2020. Apparently, the three-month period of mandated remote instruction was effective in continuing to develop and maintain reading progress among this group of students. Whether the maintenance of reading skills was related to remote instruction, parental involvement, student maturation, or other factors cannot be known without further study.</p><p>After most students in Florida returned to classroom-based instruction in August 2020, the elementary students in the initial cohort made very small levels of progress in reading performance over time. These results align with the results published in a research report for Curriculum Associates  (Dawson, 2022) , which described small increments of growth in reading from fall 2020 to fall 2021 as measured by percentages of students who were reading on grade level.</p><sec id="s6_1"><title>6.1. National Norm Comparisons</title><p>The differences between reading performance scores among the initial cohort students (no ESE or ELL students) were most apparent when their scores were compared to 2018-2019 (pre-COVID) national i-Ready norms. An examination of the comparisons’ results revealed that the two groups were significantly different across all assessment periods, with medium effect sizes in January 2020 and August 2020, large effect sizes in January 2021, and very large effect sizes in May and August 2021. In other words, as the cohort students progressed through fourth grade, the differences between 2018-2019 pre-COVID national norms grew larger and larger. The scale score differences between the initial cohort’s scores and the 2018-2019 national norms are easily observed in <xref ref-type="table" rid="table8">Table 8</xref>.</p><table-wrap id="table8" ><label><xref ref-type="table" rid="table8">Table 8</xref></label><caption><title> i-Ready scale score differences between means of initial research cohort (no ESE or ELL) and 2018-2019 national norms</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Assessment Period</th><th align="center" valign="middle" >Grade Level</th><th align="center" valign="middle" >Cohort Mean</th><th align="center" valign="middle" >2018-2019 National Mean</th><th align="center" valign="middle" >Point Value Differences*</th></tr></thead><tr><td align="center" valign="middle" >January 2020</td><td align="center" valign="middle" >3</td><td align="center" valign="middle" >525.23</td><td align="center" valign="middle" >552.50</td><td align="center" valign="middle" >27.27</td></tr><tr><td align="center" valign="middle" >August 2020</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >532.76</td><td align="center" valign="middle" >557.50</td><td align="center" valign="middle" >24.74</td></tr><tr><td align="center" valign="middle" >January 2021</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >545.22</td><td align="center" valign="middle" >590.50</td><td align="center" valign="middle" >45.28</td></tr><tr><td align="center" valign="middle" >May 2021</td><td align="center" valign="middle" >4</td><td align="center" valign="middle" >553.16</td><td align="center" valign="middle" >616.00</td><td align="center" valign="middle" >62.84</td></tr><tr><td align="center" valign="middle" >August 2021</td><td align="center" valign="middle" >5</td><td align="center" valign="middle" >556.35</td><td align="center" valign="middle" >616.00</td><td align="center" valign="middle" >59.65</td></tr></tbody></table></table-wrap><p>*These values represent scale score differences.</p><p>Perhaps these scores would be different if the parents or the school district had opted to create opportunities for tutoring or reading camps during the summer of 2020. Unfortunately, many parents were still concerned about the spread of COVID-19 during that summer and might not have participated if the resources had been offered. In any case, the results of the national comparisons point to the need for further investigation into children’s reading development after unexpected and extended changes related to school interruptions coupled with the introduction of exclusively remote instruction, or other factors. Was a critical reading skillset overlooked or missed during a critical period of reading development during remote instruction that influenced a measurable, cumulative decline in reading performance later among cohort students?</p></sec><sec id="s6_2"><title>6.2. Mitigating Factors</title><p>In a qualitative study of middle-school science teachers who delivered instruction remotely during the 2020 school lockdowns,  Ward (2022)  identified mitigating factors that may have influenced the academic performance of students: the initial chaos related to the rapid deployment of remote instruction, the teachers’ adjustment to teaching with technology, and inconsistent access to online curricula and technology tools in impoverished and mountainous areas (pp. 80-81). The teachers in the study reported that absenteeism and inconsistent internet access for both teachers and students had an enormous influence on student performance  (Ward, 2022: pp. 81-82) . One teacher in  Ward’s (2022)  study stated, “Only one-third of the students attended class on a daily basis” (p. 112). In this relatively small district, school and district administrators and the local community valiantly attempted to provide both technical and curricular support to the teachers and students during the unprecedented changes related to the pandemic. However, all the teachers in the study agreed that they were unprepared to transition rapidly to remote instruction and that student engagement with the curricula and with age peers was diminished during remote instruction in the spring of 2020.</p><p>The problem of absenteeism and disengagement in classroom-based instruction has been extensively studied in the past (e.g.,  Marcotte &amp; Hemelt, 2008 ). Educators know that time on task, attention, and focus is critically important to students’ academic success and overall development. Online and hybrid instruction cannot be effective if students do not participate. How can educators ensure that students remain engaged with the material, the instructor, and their peers, just as they would in classroom-based instruction? How can parents ensure that their children are present and engaged during online instruction? Educational stakeholders, including district and school administrators, teachers, students, and parents, could collaborate to conduct a review of recent research studies, technological tools, and instructional strategies related to the problems of absenteeism and student disengagement during remote instruction. The result of the collaboration might lead to the development of consistent school-wide guidelines and expectations for participation in remote instruction. School and district administrators can also assist by providing technological tools, technical support, flexible staffing, and different instructional models.</p><p>As teachers continue to use remote instructional delivery methods, whether via hybrid or exclusively online delivery options, students must be accountable for being present and actively engaged during direct instruction, small group interactions, and student projects. Teachers can acquire and polish their skills and dispositions to make online instruction developmentally appropriate, engaging, and challenging. In addition, teachers can create and share effective online material and ways to assess learning. Schools and districts can make accommodations to teachers’ schedules to promote and provide outstanding and easily accessed professional development to teachers as they continue to develop technical skills and curricular expertise to provide high-quality teaching and learning.</p></sec></sec><sec id="s7"><title>7. Conclusion</title><p>School closures during the Covid-19 pandemic created new opportunities to study the unexpected disruptions in educational programming and virtual instruction. To date, the results of COVID-19 research studies in education tend to vacillate between slight learning losses and catastrophic learning losses. Studies by  Kuhfeld et al. (2020) ,  Kogan and Lavertu (2021) , and  Pier et al. (2021)  provided evidence of differential levels of learning loss in math and reading during the pandemic based on socioeconomic factors and access to technology. However, studies by  Domingue et al. (2021) ,  Gore et al. (2021) ,  Hammerstein et al. (2021) , and  Dawson (2022)  provided evidence of either little or no learning loss in reading and math during the pandemic. In a recent Harvard study of 2.1 million students in grades 3 to 8 across 49 states,  Goldhaber et al. (2022)  concluded that “remote instruction was a primary driver of widening achievement gaps”, especially in high-poverty schools and districts.</p><p>Although most students in Florida and in the target school district returned to classroom-based instruction in August 2020  (Marshall &amp; Bradley-Dorsey, 2020) , the subgroups’ reading progress in this study continued to increase in very small increments, yet commensurate with the district norms from the previous school years. These results may relate to those of  Dawson (2022) , who found that mean reading improvement scores on i-Ready assessments were not dramatically different from mean scores prior to COVID-19 among second- through fourth-grade students who were reading on grade level, regardless of instructional delivery method (in school, mostly in school, mostly remote, or remote only). However, Dawson reported that reading improvement scores declined dramatically among students who were reading two or more grade levels below norms, regardless of instructional delivery methods. Dawson’s results were especially pertinent to the target district because the entire district is designated as a Title I district.</p><p>The results of this study of a single cohort of students who were in third grade in spring 2020 and whose reading scores were followed over time yielded interesting results that may serve to inform and guide educational practice and future research. In many classrooms, the predictions of disastrous learning loss in reading and math after school lockdowns were realized, especially among young children  (Dawson, 2022) , minority students  (Dorn et al., 2020) , and students from low-income homes  (Gore et al., 2021) . Clearly, much work is needed to ensure that all children and young people overcome any losses during the pandemic. The lessons learned during the pandemic can assist educators as they move away from the chaos and uncertainty of the pandemic and move forward into more orderly, planned change and innovation in educational delivery. In addition, future research studies can continue to inform and assist educators as they make the transitions to remote, hybrid, or face-to-face instruction. This study adds to the body of knowledge related to the influence of school closures and remote instruction during school lockdowns and remote instruction.</p></sec><sec id="s8"><title>Conflicts of Interest</title><p>The authors declare no conflicts of interest regarding the publication of this paper.</p></sec><sec id="s9"><title>Cite this paper</title><p>Goodman, T., LeBlanc, P., &amp; LeBlanc, W. G. (2024). An Exploratory Study of Elementary School Students’ Reading Performance Scores before and after COVID-19. Open Journal of Social Sciences, 12, 504-518. https://doi.org/10.4236/jss.2024.125029</p></sec></body><back><ref-list><title>References</title><ref id="scirp.133646-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Aber, J. L., Grannis, K. S., Owen, S., &amp; Sawhill, I. V. (2013). &lt;i&gt;Middle Childhood Success and Economic Mobility. The Social Genome Project.&lt;/i&gt; Brookings Institution EBooks. &lt;br&gt;https://eric.ed.gov/?id=ED541844 </mixed-citation></ref><ref id="scirp.133646-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Chall, J. S. (1995). &lt;i&gt;Stages of &lt;/i&gt;&lt;i&gt;Reading Development&lt;/i&gt;&lt;i&gt; &lt;/i&gt;(2nd ed.). Wadsworth Pub Co.</mixed-citation></ref><ref id="scirp.133646-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Chall, J. S., &amp; Jacobs, V. A. (2003). &lt;i&gt;The &lt;/i&gt;&lt;i&gt;Classic Study &lt;/i&gt;&lt;i&gt;on &lt;/i&gt;&lt;i&gt;Poor Children&amp;#8217;s Fourth&lt;/i&gt;&lt;i&gt;-&lt;/i&gt;&lt;i&gt;Grade Slump&lt;/i&gt;&lt;i&gt;. &lt;/i&gt;American Educator. </mixed-citation></ref><ref id="scirp.133646-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">https://www.aft.org/periodical/american-educator/spring-2003/classic-study-poor-childrens-fourth-grade-slump </mixed-citation></ref><ref id="scirp.133646-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Cooper, H., Nye, B., Charlton, K., Lindsay, J., &amp; Greathouse, S. (1996). The Effects of Summer Vacation on Achievement Test Scores: A Narrative and Meta-Analytic Review. &lt;i&gt;Review&lt;/i&gt;&lt;i&gt; &lt;/i&gt;&lt;i&gt;of Educational Research&lt;/i&gt;&lt;i&gt;, &lt;/i&gt;&lt;i&gt;66&lt;/i&gt;&lt;i&gt;,&lt;/i&gt; 227-268. &lt;br&gt;https://doi.org/10.3102/00346543066003227</mixed-citation></ref><ref id="scirp.133646-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Curriculum Associates&lt;i&gt; &lt;/i&gt;(2019). &lt;i&gt;i-Ready: Proven to &lt;/i&gt;&lt;i&gt;Work&lt;/i&gt;&lt;i&gt; (No. 2019&lt;/i&gt;&lt;i&gt;-&lt;/i&gt;&lt;i&gt;119). &lt;/i&gt;</mixed-citation></ref><ref id="scirp.133646-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Curriculum Associates (2022). &lt;i&gt;The &lt;/i&gt;&lt;i&gt;State &lt;/i&gt;&lt;i&gt;of &lt;/i&gt;&lt;i&gt;Student Learning &lt;/i&gt;&lt;i&gt;in 2022. Curriculum Ass&lt;/i&gt;&lt;i&gt;o&lt;/i&gt;&lt;i&gt;ciates State of Student Learning Annual Report. &lt;/i&gt;&lt;br&gt;https://www.curriculumassociates.com/-/media/mainsite/files/corporate/state-of-student-learning-2022.pdf </mixed-citation></ref><ref id="scirp.133646-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Dawson, M. (2022, February). Student Growth during Covid-19: Grade-Level Readiness Matters. &lt;i&gt;Curriculum Associates: Research and Efficacy&lt;/i&gt;. </mixed-citation></ref><ref id="scirp.133646-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Declining Enrollment, Shuttered Schools: Puerto Rico&amp;#8217;s Education System in Numbers. (2019, December 4). &lt;i&gt;Education Week&lt;/i&gt;. &lt;br&gt;https://www.edweek.org/leadership/declining-enrollment-shuttered-schools-puerto-ricos-education-system-in-numbers </mixed-citation></ref><ref id="scirp.133646-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Domingue, B. W., Hough, H. J., Lang, D., &amp; Yeatman, J. (2021). &lt;i&gt;Changing &lt;/i&gt;&lt;i&gt;Patterns &lt;/i&gt;&lt;i&gt;of &lt;/i&gt;&lt;i&gt;Growth &lt;/i&gt;&lt;i&gt;in &lt;/i&gt;&lt;i&gt;Oral Reading Fluenc&lt;/i&gt;&lt;i&gt;y during the COVID-19 &lt;/i&gt;&lt;i&gt;Pandemic&lt;/i&gt;&lt;i&gt;.&lt;/i&gt; Policy Analysis for California Education. &lt;br&gt;https://files.eric.ed.gov/fulltext/ED612594.pdf </mixed-citation></ref><ref id="scirp.133646-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Dorn, E., Hancock, B., Sarakatsannis, J., &amp; Viruleg, E. (2020). &lt;i&gt;COVID-19 and &lt;/i&gt;&lt;i&gt;Learning Loss&amp;#8212;&lt;/i&gt;&lt;i&gt;Disparities &lt;/i&gt;&lt;i&gt;Grow&lt;/i&gt;&lt;i&gt;, and &lt;/i&gt;&lt;i&gt;Students Need H&lt;/i&gt;&lt;i&gt;elp&lt;/i&gt;&lt;i&gt;.&lt;/i&gt; McKinsey &amp; Company. &lt;br&gt;https://www.mckinsey.com/industries/public-and-social-sector/our-insights/covid-19-and-learning-loss-disparities-grow-and-students-need-help </mixed-citation></ref><ref id="scirp.133646-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Florida Department of Education (2021a). &lt;i&gt;Florida&amp;#8217;s Third Graders Show In-Person I&lt;/i&gt;&lt;i&gt;n&lt;/i&gt;&lt;i&gt;struction Led to Better Learning&lt;/i&gt;. &lt;br&gt;https://www.fldoe.org/newsroom/latest-news/floridas-third-graders-show-in-person-instruction-led-to-better-learning-outcomes.stml </mixed-citation></ref><ref id="scirp.133646-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple"></mixed-citation></ref><ref id="scirp.133646-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Florida Department of Education (2021b). &lt;i&gt;Students&lt;/i&gt;&lt;i&gt;.&lt;/i&gt; PK-12 Public School Data Publications and Reports. &lt;br&gt;https://www.fldoe.org/accountability/data-sys/edu-info-accountability-services/pk-12-public-school-data-pubs-reports/students.stml </mixed-citation></ref><ref id="scirp.133646-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Gersten, H., Haymond, K., Newman-Gonchar, R., Dimino, J., &amp; Jayanthi, M., (2020). Meta-Analysis of the Impact of Reading Interventions for Students in the Primary Grades.&lt;i&gt; Journal of Research on Educational Effectiveness, 13&lt;/i&gt;&lt;i&gt;,&lt;/i&gt;&lt;i&gt; &lt;/i&gt;401-427. &lt;br&gt;https://doi.org/10.1080/19345747.2019.1689591</mixed-citation></ref><ref id="scirp.133646-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">Goldhaber, D., Kane, T., McEachin, A., Morton E., Patterson, T., &amp; Staiger, D. (2022). &lt;i&gt;The Consequences of Remote and Hybrid Instruction &lt;/i&gt;&lt;i&gt;during &lt;/i&gt;&lt;i&gt;the Pandemic.&lt;/i&gt; Center for Education Policy Research, Harvard University. &lt;br&gt;https://doi.org/10.3386/w30010</mixed-citation></ref><ref id="scirp.133646-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">Gore, J., Fray, L., Miller, A., Harris, J., &amp; Taggart, W. (2021). The Impact of COVID-19 on Student Learning in New South Wales Primary Schools: An Empirical Study. &lt;i&gt;The Australian Educational Researcher&lt;/i&gt;&lt;i&gt;, &lt;/i&gt;&lt;i&gt;48&lt;/i&gt;&lt;i&gt;,&lt;/i&gt; 605-637. &lt;br&gt;https://doi.org/10.1007/s13384-021-00436-w</mixed-citation></ref><ref id="scirp.133646-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">Hammerstein, S., K&amp;#246;nig, C., Dreis&amp;#246;rner, T., &amp; Frey, A. (2021). Effects of COVID-19-Related School Closures on Student Achievement&amp;#8212;A Systematic Review.&lt;i&gt; &lt;/i&gt;&lt;i&gt;Frontiers in Psychology, 12&lt;/i&gt;. &lt;br&gt;https://doi.org/10.3389/fpsyg.2021.746289 </mixed-citation></ref><ref id="scirp.133646-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">Kogan, V., &amp; Lavertu, S. (2021). &lt;i&gt;The COVID-19 &lt;/i&gt;&lt;i&gt;Pandemic &lt;/i&gt;&lt;i&gt;and &lt;/i&gt;&lt;i&gt;Student Performance &lt;/i&gt;&lt;i&gt;on Ohio&amp;#8217;s &lt;/i&gt;&lt;i&gt;Third&lt;/i&gt;&lt;i&gt;-&lt;/i&gt;&lt;i&gt;Grade &lt;/i&gt;&lt;i&gt;English &lt;/i&gt;&lt;i&gt;Language Arts Assess&lt;/i&gt;&lt;i&gt;ment&lt;/i&gt;&lt;i&gt;.&lt;/i&gt; Ohio Department of Education.&lt;br&gt;http://glenn.osu.edu/educational-governance/reports/reports-attributes/ODE_ThirdGradeELA_KL_1-27-2021.pdf </mixed-citation></ref><ref id="scirp.133646-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">Kuhfeld, M., Soland, J., Tarasawa, B., Johnson, A., Ruzek, E., &amp; Liu, J. (2020). Projecting the Potential Impact of COVID-19 School Closures on Academic Achievement. &lt;i&gt;Educ&lt;/i&gt;&lt;i&gt;a&lt;/i&gt;&lt;i&gt;tional Researcher&lt;/i&gt;&lt;i&gt;, &lt;/i&gt;&lt;i&gt;49&lt;/i&gt;&lt;i&gt;, &lt;/i&gt;549-565. &lt;br&gt;https://doi.org/10.3102/0013189X20965918</mixed-citation></ref><ref id="scirp.133646-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">Marcotte, D. E., &amp; Hemelt, S. W. (2008). Unscheduled School Closings and Student Performance. &lt;i&gt;Education Finance and Policy&lt;/i&gt;&lt;i&gt;, &lt;/i&gt;&lt;i&gt;3&lt;/i&gt;&lt;i&gt;, &lt;/i&gt;316-338.&lt;br&gt;https://www.econstor.eu/bitstream/10419/34654/1/557545692.pdf&lt;br&gt;https://doi.org/10.1162/edfp.2008.3.3.316</mixed-citation></ref><ref id="scirp.133646-ref22"><label>22</label><mixed-citation publication-type="other" xlink:type="simple">Marshall, D. T., &amp; Bradley-Dorsey, M. (2020). Reopening America&amp;#8217;s Schools: A desCriptive Look at How States and Large School Districts Are Navigating Fall 2020.&lt;i&gt; &lt;/i&gt;&lt;i&gt;Journal of School Choice&lt;/i&gt;&lt;i&gt;, &lt;/i&gt;&lt;i&gt;14&lt;/i&gt;&lt;i&gt;, &lt;/i&gt;534-566. &lt;br&gt;https://doi.org/10.1080/15582159.2020.1822731</mixed-citation></ref><ref id="scirp.133646-ref23"><label>23</label><mixed-citation publication-type="other" xlink:type="simple">Pier, L., Christian, M., Tymesno, H., &amp; Meyer, R. H. (2021). &lt;i&gt;COVID-19 &lt;/i&gt;&lt;i&gt;Impacts &lt;/i&gt;&lt;i&gt;on &lt;/i&gt;&lt;i&gt;St&lt;/i&gt;&lt;i&gt;u&lt;/i&gt;&lt;i&gt;dent Learning&lt;/i&gt;&lt;i&gt;: Evidence from &lt;/i&gt;&lt;i&gt;Interim Assessments &lt;/i&gt;&lt;i&gt;in California&lt;/i&gt;&lt;i&gt;.&lt;/i&gt; Policy Analysis for California Education.&lt;br&gt;https://edpolicyinca.org/publications/COVID-19-impacts-student-learning </mixed-citation></ref><ref id="scirp.133646-ref24"><label>24</label><mixed-citation publication-type="other" xlink:type="simple">Sandberg Patton, K. L., &amp; Reschly, A. L. (2013). Using Curriculum-Based Measurement to Examine Summer Learning Loss. &lt;i&gt;Psychology in the Schools&lt;/i&gt;&lt;i&gt;, &lt;/i&gt;&lt;i&gt;50&lt;/i&gt;&lt;i&gt;,&lt;/i&gt; 738-753. &lt;br&gt;https://doi.org/10.1002/pits.21704</mixed-citation></ref><ref id="scirp.133646-ref25"><label>25</label><mixed-citation publication-type="other" xlink:type="simple">Sato, H. (2020). Educational Responses to the Pandemic in Japan: Primary and Secondary Education Policy Issues. &lt;i&gt;International Studies in Educational Administration&lt;/i&gt;&lt;i&gt;, &lt;/i&gt;&lt;i&gt;48&lt;/i&gt;&lt;i&gt;, &lt;/i&gt;64-69. </mixed-citation></ref><ref id="scirp.133646-ref26"><label>26</label><mixed-citation publication-type="other" xlink:type="simple">The Department of Education&amp;#8217;s Office of Civil Rights (2021). &lt;i&gt;Education in a Pandemic: The Disparate Impacts of COVID-19 on America&amp;#8217;s Students&lt;/i&gt;&lt;i&gt;.&lt;/i&gt; The Department of Education. &lt;br&gt;https://www2.ed.gov/about/offices/list/ocr/docs/20210608-impacts-of-covid19.pdf </mixed-citation></ref><ref id="scirp.133646-ref27"><label>27</label><mixed-citation publication-type="other" xlink:type="simple">Ward, B. S. (2022). &lt;i&gt;A &lt;/i&gt;&lt;i&gt;Qualitative Study &lt;/i&gt;&lt;i&gt;of &lt;/i&gt;&lt;i&gt;Middle School Science Teac&lt;/i&gt;&lt;i&gt;hers&amp;#8217; &lt;/i&gt;&lt;i&gt;Perceptions &lt;/i&gt;&lt;i&gt;of the &lt;/i&gt;&lt;i&gt;Transition &lt;/i&gt;&lt;i&gt;to &lt;/i&gt;&lt;i&gt;Online Instructi&lt;/i&gt;&lt;i&gt;on during the COVID-19 &lt;/i&gt;&lt;i&gt;Pandemic &lt;/i&gt;&lt;i&gt;(Order No. 29063510)&lt;/i&gt;&lt;i&gt;.&lt;/i&gt; PhD Thesis, Southeastern University. &lt;br&gt;https://firescholars.seu.edu/coe/113</mixed-citation></ref></ref-list></back></article>