Yes, DI did it: the impact of Direct Instruction on literacy outcomes for Very Remote Indigenous schools

Noel Pearson

doi:10.1017/jie.2020.20

Authors

Noel Pearson

DOI:

https://doi.org/10.1017/jie.2020.20

Keywords:

Aboriginal and Torres Strait Islander education, direct instruction, literacy outcomes, policy interventions, remote education

Abstract

In the journal article Did DI do it? The impact of a programme designed to improve literacy for Aboriginal and Torres Strait Islander students in remote schools, Guenther and Osborne (2020) compare schoolwide NAPLAN reading scale scores for 25 Very Remote Indigenous schools implementing Direct Instruction through the Flexible Literacy for Remote Primary Schools Program (‘Flexible Literacy’ or ‘the program’) with those for 118 Very Remote Indigenous schools not involved with the program, to assert the program has not improved literacy outcomes. Good to Great Schools Australia (GGSA) undertook an analysis of the same school data for Reading, Writing, Spelling and Grammar and Punctuation scores. Our findings contradict theirs. In all areas, schools participating in the program show significant growth compared with all Australian and all Very Remote Indigenous schools. In Reading, schools involved in the program from 2015 to 2017 averaged 124% growth, while the average growth for comparable ages was 19 and 34% for Australian and Very Remote Indigenous schools, respectively. In Grammar and Punctuation schools involved in the program in the same period grew 180%, whilst growth for Australian schools was 15%, and for Very Remote Indigenous schools, 28%. These contrasting results illustrate the importance of evaluating growth to assess the impact of educational programs, rather than achievement alone, particularly in the case of Very Remote Indigenous schools where achievement levels are far below Australian grade levels. Guenther and Osborne's comparison of achievement across schools rather than measuring growth within schools obscures real gains and is misleading.

Downloads

Download data is not yet available.

References

Adams G and Engelmann S (1996) Research on Direct Instruction: 25 Years Beyond DISTAR Educational Achievement System. Seattle: Educational Achievement Systems.

Australian Council for Educational Research (2013) Evaluation of the Cape York Aboriginal Australian Academy Initiative. Available at https://research.acer.edu.au/cgi/viewcontent.cgi?article=1036&context=indigenous_education (accessed 3 June 2020)

Australian Government (2020) Flexible Literacy for Remote Primary Schools Program – participating schools. Available at https://docs.education.gov.au/node/36591 (accessed 29 May 2020)

Betebenner D (2009) Norm-and criterion-referenced student growth. Educational Measurement: Issues and Practice 28, 42–51. https://doi.org/10.1111/j.1745-3992.2009.00161.x

Buckingham J (2020) A failed attempt to discredit direction instruction. Available at https://fivefromfive.com.au/blog/a-failed-attempt-to-discredit-direct-instruction (accessed 3 June 2020)

Buzick HM and Laitusis CC (2010) Using growth for accountability: measurement challenges for students with disabilities and recommendations for research. Educational Researcher 39, 537–544. https://doi.org/10.3102%2F0013189X10383560

Chandler P (2016) Direct Instruction improving Northern Territory student outcomes. Available at http://newsroom.nt.gov.au/mediaRelease/20871 (accessed 29 May 2020)

Chang HN and Romero M (2008) Present, engaged, and accounted for: The critical importance of addressing chronic absence in the early grades. Available at http://www.nccp.org/publications/pdf/text_837.pdf (accessed 9 June 2020)

Chrysanthos N (2020) $30m literacy program fails to boost results for remote Indigenous kids. Available at https://www.smh.com.au/education/30m-literacy-program-fails-to-boost-results-for-remote-indigenous-kids-20200410-p54iwf.html (accessed 29 May 2020)

Commonwealth of Australia (2013) Grant agreement in relation to Flexible Literacy for Remote Primary Schools Programme. Available at https://www.aph.gov.au/~/media/Committees/eet_ctte/estimates/supp_1415/Education/Answers/ED0582_15_AttachmentA.pdf (accessed 29 May 2020)

Duncan C (2020) Literacy program fails to deliver for Indigenous children. Available at https://nit.com.au/literacy-program-fails-to-deliver-for-indigenous-children/ (accessed 29 May 2020)

Gonski D, Terrey A, Boston K, Gould V, Johnson W, O'Brien L, Perry L and Roberts M (2018) Through Growth to Achievement: The Report of the Review to Achieve Educational Excellence in Australian Schools. Canberra: Commonwealth of Australia.

Good to Great Schools Australia (2014) Effective Instruction The Keystone to School Reform. Cairns: Good to Great Schools Australia.

Good to Great Schools Australia (2017a) Implementation Report: Learning from the First Two Years of the Literacy for Remote Primary Schools Program 2015–2017. Available at https://goodtogreatschools.org.au/wp-content/uploads/2017/03/Good-to-Great-Schools-Australia-Effective-Instruction-20140306.pdf (accessed 29 May 2020)

Good to Great Schools Australia (2017b) The Independent Review into Regional, Rural and Remote Education—Submission. Available at https://goodtogreatschools.org.au/wp-content/uploads/2017/10/GGSA-Submission-to-IRRR-Review-V1.0-20171016.pdf (accessed 3 June 2020)

Good to Great Schools Australia (2019) Guiding School Transformation. Available at https://goodtogreatschools.org.au/wp-content/uploads/2020/06/Guiding-school-transformation-V1.0-20190822.pdf (accessed 3 June 2020)

Goss P (2018) Closing the gap in Indigenous literacy and numeracy? Not remotely—or in cities. Available at https://theconversation.com/closing-the-gap-in-indigenous-literacy-and-numeracy-not-remotely-or-in-cities-88704 (accessed 29 May 2020)

Goss P and Sonnemann J (2018) Measuring Student Progress: A State-by-State Report Card. Grattan Institute. Available at https://grattan.edu.au/wp-content/uploads/2018/10/Mapping_Student_Progress.pdf (accessed 3 June 2020).

Gottfried, MA (2010) Evaluating the relationship between student attendance and achievement in urban elementary and middle schools: an instrumental variables approach. American Educational Research Journal 47, 434–465. https://doi.org/10.3102%2F0002831209350494

Grossen B (2013) Evaluation of the Academic Progress of Children Served by the Cape York Aboriginal Australian Academy. Available at https://goodtogreatschools.org.au/wp-content/uploads/2017/08/CYAAA-Grossen-2013-Evaluation-of-CYAAA-students-academic-progress-v1.0-20130718.pdf (accessed 3 June 2020)

Guenther J and Osborne S (2020) Did DI Do It? The impact of a programme designed to improve literacy for Aboriginal and Torres Strait Islander students in remote schools. The Australian Journal of Indigenous Education 49, 1–8. https://doi.org/10.1017/jie.2019.28

Guenther J, Disbray S and Osborne S (2016) Red dirt education: a compilation of learnings from the Remote Education Systems project. Available at https://www.nintione.com.au/resources/rao/red-dirt-education-a-compilation-of-learnings-from-the-remote-education-systems-project/ (accessed 3 June 2020)

Halsey J (2018) Independent Review into Regional Rural and Remote Education—Final Report. Available at https://docs.education.gov.au/system/files/doc/other/01218_independent_review_accessible.pdf (accessed 3 June 2020)

Hattie J (2009) Visible Learning. A Synthesis of Over 800 Meta-Analyses Relating to Achievement. New York: Routledge.

Hollingsworth J and Ybarra S (2013) Explicit Direct Instruction for English Learners. California: Dataworks Educational Research.

Little G (2020) Direct instruction ‘Flexible Literacy’ program a costly failure: researchers. Available at https://educationhq.com/news/direct-instruction-flexible-literacy-program-a-costly-failure-researchers-76001/ (accessed 29 May 2020)

Neal D and Schanzenbach DW (2010). Left behind by design: proficiency counts and test-based accountability. The Review of Economics and Statistics 92, 263–283. https://doi.org/10.1162/rest.2010.12318

Reynolds D, Sammons P, De Fraine B, Van Damme J, Townsend T, Teddlie C and Stringfield S (2014) Educational effectiveness research (EER): a state-of-the-art review. School Effectiveness and School Improvement 25, 197–230. https://doi.org/10.1080/09243453.2014.885450

Rosenshine B and Stevens R (1986) Five meanings of direct instruction. In Wittrock M (ed), Handbook of Research on Teaching. New York: Macmillan, pp. 59–73.

Sanchez M, London R and Castrechini S (2015) The dynamics of chronic absence and student achievement. Education Policy Analysis Archives 24, 1–27. https://www.redalyc.org/articulo.oa?id=275043450098

Stockard J, Wood TW, Rasplica Khoury C and Coughlin C (2020) All Students Can Succeed: A Half Century of Research on the Effectiveness of Direct Instruction. Lanham, MD. Lexington Books.