How Do Students 3rd Grade Reading Levels Relate to their ACT/SAT Performance and Chance of Graduating from High School March 22 2017 Prepared by Pascael Beaudette Kanti Chalasani Sam Rauschenberg Table of Contents Introduction................................................................................................................................................... 1 Overview of Students Included in Analysis.................................................................................................. 2 High School Graduate Rates and 3rd Grade Reading Levels ....................................................................... 4 ACT/SAT Performance and 3rd Grade Reading Levels............................................................................... 7 Summary ..................................................................................................................................................... 10 Acknowledgements..................................................................................................................................... 11 i Introduction Reading proficiency in 3rd grade is an important educational milestone that is often linked to future academic success.1 As summarized by the Get Georgia Reading campaign The end of third grade marks the critical time when children shift from learning to read to reading to learn. Children unable to make this shift face serious barriers for future learning because they can t grasp half of the printed fourth-grade curriculum and beyond including math and science. As a result these children fall even further behind. Children who can t read proficiently by the end of third grade are more likely to experience poor health have discipline problems become teen parents and drop out of high school. As adults they re more likely to spend time in prison struggle with unemployment and face shorter life expectancies.2 With this context in mind this report analyzes the relationship between 3rd grade reading proficiency and several indicators of future academic success the percentage who graduate from high school the percentage who take the ACT or SAT and average ACT and SAT scores. For the first time data from GAAWARDS Georgia s longitudinal education data system has enough history to follow students from 3rd grade through high school graduation. The report examines a cohort of 9th grade students from the 2012-2013 school year who took the reading Criterion-Referenced Competency Test (CRCT) as 3rd graders in 2006-2007 (see Figure 1). Figure 1 Students in Analysis 3rd Grade Reading Test in 2006-2007 Three Performance Levels Exceeds Expectations Meets Expectations Does Not Meet Expectations 9th Grade in 2012-2013 Cohort of Students in Analysis Future Academic Success High School Graduation SAT/ACT Participation SAT/ACT Scores 1 See for example "Learning to Read Reading to Learn Why Third-Grade is a Pivotal Year for Mastering Literacy." 2 Get Georgia Reading. Common Agenda Overview. http //getgeorgiareading.org/common-agenda/common-agendaoverview/ 1 Examining a 9th grade cohort makes the analysis more comparable to four-year graduation rates that are traditionally calculated. For the purposes of this analysis the cohort is divided into three groups based on performance levels on the 3rd grade reading CRCT exceeds expectations meets expectations and does not meet expectations. Overall students who earned higher scores on the 3rd grade reading CRCT had higher high school graduation rates were more likely to take the ACT or SAT and had higher average ACT and SAT scores compared to students in the other performance levels. This pattern holds across race/ethnicities gender poverty English language learner status and students with disabilities. It is important to note that while this report provides general trends in high school outcomes by 3rd grade reading performance it does not establish that 3rd grade reading levels cause higher high school graduation rates or SAT/ACT performance. Many other factors that are not taken into account affect these outcomes. The report begins with an overview of the 9th grade cohort of students being analyzed. The next section presents patterns in high school graduation rates followed by an analysis of ACT and SAT performance. It concludes with a summary of findings. Overview of Students Included in Analysis During the 2012-2013 school year 98 162 9th grader had scores on the 3rd grade reading CRCT in 20062007 representing 75% of the total 9th grade cohort that year.3 Over half of these students scored in the meets expectations category 34% scored in the exceeds expectations category and 11% did not meet expectations.4 Figure 2 3rd Grade Reading Levels of 2012-2013 9th Grade Students DNM 11.5% 98 162 Students Exceeds 34.4% Meets 54.2% 3 Students must be in the 9th grade for the first time during this school year to be included in the cohort. 4 Prior to 2015 the statewide assessments did not have high proficiency standards resulting in about 90% or more students earning meets or exceeds expectations on the 3rd grade reading CRCT. As a result this analysis splits the meets and exceeds groups to show more differentiation in reading level. For more information on Georgia s low proficiency standards on the CRCT relative to other states see this article from Education Next. http //educationnext.org/despite-common-core-states-still-lack-common-standards/ 2 As seen in Table 1 below the percentage of students in each performance category varies by race/ethnicity and other subgroups. Asian (50%) and white students (48%) had much higher rates of students in the exceeds expectations category than students in other race/ethnicity subgroups. Black Hispanic and Pacific Islander students had higher rates of students in the does not meet expectations category (between 17-18%) than students in other race/ethnicity subgroups. Female students had a higher exceeds rate than male students. Economically disadvantaged students (ED) English Language Learners (ELL) and students with disabilities (SWD) had lower exceeds rates than other students.5 ELL (50%) and students with disabilities (41%) had far higher rates of students in the does not meet expectations category than other students. Table 1 Summary Statistics by Demographic Subgroup Group All Students Race/Ethnicity American Indian or Alaskan Native Asian Black Hispanic Pacific Islander Two or More Races White Gender Female Male Other Subgroups Economically Disadvantaged English Language Learners Students with Disabilities 3rd Grade Not Meeting Number % of Total 11 256 11% 25 11% 146 5% 6 324 17% 1 719 17% 13 18% 224 9% 2 805 6% 4 525 9% 6 731 14% 8 922 16% 623 50% 4 078 41% 3rd Grade Meeting Number % of Total 53 187 54% 132 60% 1 319 45% 22 601 62% 6 462 63% 43 59% 1 359 52% 21 271 46% 26 216 53% 26 971 55% 33 625 62% 584 47% 4 976 50% 3rd Grade Exceeding Number % of Total 33 719 34% Total Number 98 162 62 28% 219 1 439 50% 2 904 7 256 20% 36 181 2 078 20% 10 259 17 23% 73 1 009 39% 2 592 21 858 48% 45 934 18 428 37% 49 169 15 291 31% 48 993 11 990 22% 54 537 32 3% 1 239 856 9% 9 910 5 Economically disadvantaged as determined by free/reduced-price lunch. Only students with disabilities who took the CRCT are included in this analysis. 3 High School Graduate Rates and 3rd Grade Reading Levels To assess patterns in high school graduation rates the analysis follows the 9th grade cohort from 20122013 through the 2015-2016 school year. The graduation rate is computed as follows Number of High School Graduates (Number in the 9th Grade Cohort Number of Students Who Transfer out of State Emigrate or Die)6 Nearly 89% of students who scored in the exceeds expectations category in 3rd grade reading graduated high school compared to 78.4% of students in the meets expectations category and 60.5% of students in the does not meet expectations category. Figure 3 2016 High School Graduation Rate by 3rd Grade Reading Level 88.9% 78.4% 60.5% Exceeds Meets DNM 6 As determined by the following withdrawal codes in the last year of enrollment in public school D-death H-attend home study J-transferred out of county K-transferred to a private school N-transferred to a Department of Defense school X-transferred out of state and Z-SB10 transfer to private school. 4 A similar pattern exists by race/ethnicity gender and the other subgroups as well the graduation rates are highest for those who scored in the exceeds expectations category. 7 Black White and Hispanic students in each performance level graduated at nearly the same rates. Asian students graduated at higher rates than other subgroups in each level (Figure 4). While the graduation rate of female students in the exceeds expectations group was only 2.5 points higher than male students the rate in the does not meet expectations group was 10.9 points higher (Figure 5). Economically disadvantaged students English language learners and students with disabilities across all three performance levels graduated at lower rates than all students (Figure 6). In all three performance levels economically disadvantaged students had graduation rates almost ten points lower than students who were not economically disadvantaged (Figure 7). Figure 4 High School Graduation Rate by Race/Ethnicity High School Graduation Rate by Race/Ethnicity by Third Grade Reading Performance All Students Asian Black Hispanic Two or More Races White 60.5 60.9 59.5 59.6 59.3 78.4 88.9 76.1 78.4 90 94.6 88.3 86.3 76.7 75.3 88.3 78.4 89.1 0 20 40 60 80 100 High School Graduation Rate Exceeded Expectations Did Not Meet Expectations Met Expectations 7 When race/ethnicity gender and economically disadvantaged are taken into account simultaneously students in the exceeds expectations category have the highest graduation rates across all combinations with ten or more students. American Indian or Alaskan Native and Pacific Islander subgroups were excluded because there were fewer than ten graduates in one or more performance levels. 5 Figure 5 High School Graduation Rate by Gender High School Graduation Rate by Gender by Third Grade Reading Performance All Students Female Male 88.9 78.4 60.5 90.5 81.9 67 87 74.9 56.1 0 20 40 60 80 100 High School Graduation Rate Exceeded Expectations Did Not Meet Expectations Met Expectations Figure 6 High School Graduation Rate by Other Subgroups High School Graduation Rate by Other Subgroups by Third Grade Reading Performance All Students Economically Disadvantaged English Language Learners SWD 88.9 78.4 60.5 57.6 82 73.6 83.3 64.9 57 72.8 63.2 53.1 0 20 40 60 80 100 High School Graduation Rate Exceeded Expectations Did Not Meet Expectations Met Expectations Figure 7 High School Graduation Rate by 3rd Grade Reading Level and Economically Disadvantaged Status 6 92.7% 82.0% 86.5% 73.6% 71.8% 57.6% Exceeds Meets Not Economically Disadvantaged DNM Economically Disadvantaged ACT/SAT Performance and 3rd Grade Reading Levels For many colleges and universities ACT or SAT scores are required for admission. To assess patterns in performance on the SAT and ACT this analysis follows the 9th grade cohort through the 2015-2016 school year to analyze whether students took either test and the students highest score on each test if taken. When comparing ACT/SAT performance between groups it is important to consider the differences in test participation between groups. The lower participation rates among students may indicate a lack access to the test lower postsecondary expectations or other barriers to taking the test. Nearly 75% of students who scored in the exceeds expectations category took either the SAT or the ACT while only 49% of those who scored in the meets expectations category took either test. This percentage drops to 25% for those who scored in the does not meet category (Figure 8). This ACT/SAT test participation decline by performance level existed in all subgroups (Table 2). 7 Figure 8 ACT/SAT Participation Rate by 3rd Grade Reading Level 74% 49% 25% Exceeds Meets DNM Table 2 Percentage of Students Taking ACT/SAT by Performance Level and Subgroup8 Group All Students Asian Black Hispanic Two or More Races White Female Male Economically Disadvantaged English Language Learners SWD 3rd Grade Not Meeting 3rd Grade Meeting 3rd Grade Exceeding ACT or SAT Test Takers 2 774 88 1 775 341 55 507 1 348 1 426 1 983 116 579 ACT/SAT Participation Rate ACT or SAT Test Takers 25% 25 899 Race/Ethnicity 60% 1 048 28% 11 771 20% 2 710 25% 630 18% 9 660 Gender 30% 14 281 21% 11 618 Other Subgroups 22% 13 843 19% 133 14% 1 229 ACT/SAT Participation Rate 49% 79% 52% 42% 46% 45% 54% 43% 41% 23% 25% ACT or SAT Test Takers 24 902 1 308 5 377 1 356 734 16 071 14 453 10 449 7 064 10 343 ACT/SAT Participation Rate 74% 91% 74% 65% 73% 74% 78% 68% 59% 31% 40% 8 Subgroups with fewer than ten test takers in any performance category are excluded from these figures. 8 Of students who took the SAT or the ACT the average score of those students in the exceeds expectations performance level in 3rd grade is higher than the average score of students who scored in either the meets expectations or the did not meet expectations performance levels. The average ACT score for students in the exceeds expectations performance level was 24 out of 36 which is 5.5 points higher than the average score for students in the meets expectations category and 8.4 points higher than students in the does not meet expectations category. Similarly the average SAT score for students in the exceeds expectations performance level was 1614 out of 2400 compared to 1312 for students in the meets expectations category and 1096 for students in the does not meet expectations category. For both assessments these patterns held across race/ethnicities gender and other subgroups. Figure 9 Average Scores by Subgroup Average Highest ACT Score by Race/Ethnicity by Third Grade Reading Performance Average Highest ACT Score by Other Subgroups by Third Grade Reading Performance Average Highest ACT Score 0 6 12 18 24 30 36 Average Highest ACT Score 0 6 12 18 24 30 36 All Students Asian Black Exceeded Expectations Did Not Meet Expectations Hispanic Two or More Races White Met Expectations Average Highest SAT Score by Race/Ethnicity by Third Grade Reading Performance All Students ED Female Exceeded Expectations Did Not Meet Expectations Male SWD Met Expectations Average Highest SAT Score by Other Sugbroups by Third Grade Reading Performance 500 1 000 1 500 2 000 Average Highest SAT Score 500 1 000 1 500 2 000 Average Highest SAT Score 0 0 All Students Asian Black Exceeded Expectations Did Not Meet Expectations Hispanic Two or More Races White Met Expectations All Students ED Female Exceeded Expectations Did Not Meet Expectations Male SWD Met Expectations 9 Summary Students who earned higher scores on the 3rd grade reading CRCT had higher high school graduation rates were more likely to take the ACT or SAT and had higher average ACT and SAT scores compared to students in the other performance levels. Nearly 9 in 10 students who exceeded expectations on the 3rd grade reading CRCT graduated from high school nine years later. Only 6 in 10 students who did not meet expectations in 3rd grade reading graduated nine years later. Male students who did not meet expectations on the 3rd grade reading CRCT were 11 percentage points less likely to graduate than female students in that performance level. In all three performance levels economically disadvantaged students had graduation rates almost ten points lower than students who were not economically disadvantaged. Three-fourths of students who scored in the exceeds expectations performance level in 3rd grade took either the SAT or ACT in high school. Only one-fourth of students in the does not meet expectations performance level took either test. The average ACT and SAT score of students in the exceeds category in 3rd grade was significantly higher than students in both the meets and does not meet expectations performance levels. The graduation rate ACT/SAT participation rate and ACT/SAT score patterns were consistent regardless of student race/ethnicity gender poverty ELL status and disability status. It is important to note that while this report provides general trends in high school outcomes by 3rd grade reading performance it does not establish that 3rd grade reading levels cause higher high school graduation rates or SAT/ACT performance. Many other factors that are not taken into account affect these outcomes. 10 Acknowledgements The Governor s Office of Student Achievement would like to thank Arianne Weldon Director of Get Georgia Reading for providing ideas and feedback for this report. Data for this project were provided through Georgia s Academic and Workforce Analysis and Research System (GAAWARDS). 11