Evidence-based practice

Evidence-based practice is the idea that occupational practices ought to be based on scientific evidence. The movement towards evidence-based practices attempts to encourage and, in some instances, require professionals and other decision-makers to pay more attention to evidence to inform their decision-making. The goal of evidence-based practice is to eliminate unsound or outdated practices in favor of more-effective ones by shifting the basis for decision making from tradition, intuition, and unsystematic experience to firmly grounded scientific research. The proposal has been controversial, with some arguing that results may not specialize to individuals as well as traditional practices.

Evidence-based practices have been gaining ground since the formal introduction of evidence-based medicine in 1992 and have spread to the allied health professions, education, management, law, public policy, architecture, and other fields. In light of studies showing problems in scientific research (such as the replication crisis), there is also a movement to apply evidence-based practices in scientific research itself. Research into the evidence-based practice of science is called metascience.

An individual or organisation is justified in claiming that a specific practice is evidence-based if, and only if, three conditions are met. First, the individual or organisation possesses comparative evidence about the effects of the specific practice in comparison to the effects of at least one alternative practice. Second, the specific practice is supported by this evidence according to at least one of the individual's or organisation's preferences in the given practice area. Third, the individual or organisation can provide a sound account for this support by explaining the evidence and preferences that lay the foundation for the claim.

History

For most of history, professions have based their practices on expertise derived from experience passed down in the form of tradition. Many of these practices have not been justified by evidence, which has sometimes enabled quackery and poor performance. Even when overt quackery is not present, the quality and efficiency of tradition-based practices may not be optimal. As the scientific method has become increasingly recognized as a sound means to evaluate practices, evidence-based practices have become increasingly adopted.

Medicine

One of the earliest proponents of evidence-based practice was Archie Cochrane, an epidemiologist who authored the book Effectiveness and Efficiency: Random Reflections on Health Services in 1972. Cochrane's book argued for the importance of properly testing health care strategies, and was foundational to the evidence-based practice of medicine. Cochrane suggested that because resources would always be limited, they should be used to provide forms of health care which had been shown in properly designed evaluations to be effective. Cochrane maintained that the most reliable evidence was that which came from randomised controlled trials.

The term "evidence-based medicine" was introduced by Gordon Guyatt in 1990 in an unpublished program description, and the term was later first published in 1992. This marked the first evidence-based practice to be formally established. Some early experiments in evidence-based medicine involved testing primitive medical techniques such as bloodletting, and studying the effectiveness of modern and accepted treatments. There has been a push for evidence-based practices in medicine by insurance providers, which have sometimes refused coverage of practices lacking systematic evidence of usefulness. It is now expected by most clients that medical professionals should make decisions based on evidence, and stay informed about the most up-to-date information. Since the widespread adoption of evidence-based practices in medicine, the use of evidence-based practices has rapidly spread to other fields.

Education

More recently, there has been a push for evidence-based education. The use of evidence-based learning techniques such as spaced repetition can improve students' rate of learning. Some commentators^[who?] have suggested that the lack of any substantial progress in the field of education is attributable to practice resting in the unconnected and noncumulative experience of thousands of individual teachers, each re-inventing the wheel and failing to learn from hard scientific evidence about 'what works'. Opponents of this view argue that it is hard to assess teaching methods because it depends on a host of factors, not least those to do with the style, personality and beliefs of the teacher and the needs of the particular children. Others argue the teacher experience could be combined with research evidence, but without the latter being treated as a privileged source. This is in line with a school of thought suggesting that evidence-based practice has limitations and a better alternative is to use Evidence-informed Practice (EIP). This process includes quantitative evidence, does not include non-scientific prejudices, but includes qualitative factors such as clinical experience and the discernment of practitioners and clients.

Versus tradition

Evidence-based practice is a philosophical approach that is in opposition to tradition. Some degree of reliance on "the way it was always done" can be found in almost every profession, even when those practices are contradicted by new and better information.

Some critics argue that since research is conducted on a population level, results may not generalise to each individual within the population. Therefore, evidence-based practices may fail to provide the best solution for each individual, and traditional practices may better accommodate individual differences. In response, researchers have made an effort to test whether particular practices work better for different subcultures, personality types etc. Some authors have redefined evidence-based practice to include practice that incorporates common wisdom, tradition, and personal values alongside practices based on evidence.

Evaluating evidence

Hierarchy of evidence in medicine.

Evaluating scientific research is extremely complex. The process can be greatly simplified with the use of a heuristic that ranks the relative strengths of results obtained from scientific research, which is called a hierarchy of evidence. The design of the study and the endpoints measured (such as survival or quality of life) affect the strength of the evidence. Typically, systematic reviews and meta-analysis rank at the top of the hierarchy while randomized controlled trials rank above observational studies, and expert opinion and case reports rank at the bottom. There is broad agreement on the relative strength of the different types of studies, but there is no single, universally-accepted hierarchy of evidence. More than 80 different hierarchies have been proposed for assessing medical evidence.

Applications

Medicine

Evidence-based medicine is an approach to medical practice intended to optimize decision-making by emphasizing the use of evidence from well-designed and well-conducted research. Although all medicine based on science has some degree of empirical support, evidence-based medicine goes further, classifying evidence by its epistemologic strength and requiring that only the strongest types (coming from meta-analyses, systematic reviews, and randomized controlled trials) can yield strong recommendations; weaker types (such as from case-control studies) can yield only weak recommendations. The term was originally used to describe an approach to teaching the practice of medicine and improving decisions by individual physicians about individual patients. Use of the term rapidly expanded to include a previously described approach that emphasized the use of evidence in the design of guidelines and policies that apply to groups of patients and populations ("evidence-based practice policies").

Whether applied to medical education, decisions about individuals, guidelines and policies applied to populations, or administration of health services in general, evidence-based medicine advocates that to the greatest extent possible, decisions and policies should be based on evidence, not just the beliefs of practitioners, experts, or administrators. It thus tries to ensure that a clinician's opinion, which may be limited by knowledge gaps or biases, is supplemented with all available knowledge from the scientific literature so that best practice can be determined and applied. It promotes the use of formal, explicit methods to analyze evidence and makes it available to decision makers. It promotes programs to teach the methods to medical students, practitioners, and policymakers.

A process has been specified that provides a standardised route for those seeking to produce evidence of the effectiveness of interventions. Originally developed to establish processes for the production of evidence in the housing sector, the standard is general in nature and is applicable across a variety of practice areas and potential outcomes of interest.

Mental health

To improve the dissemination of evidence-based practices, the Association for Behavioral and Cognitive Therapies (ABCT) and the Society of Clinical Child and Adolescent Psychology (SCCAP, Division 53 of the American Psychological Association) maintain updated information on their websites on evidence-based practices in psychology for practitioners and the general public. An evidence-based practice consensus statement was developed at a summit on mental healthcare in 2018. As of June 23, 2019, this statement has been endorsed by 36 organizations.

Metascience

There has since been a movement for the use of evidence-based practice in conducting scientific research in an attempt to address the replication crisis and other major issues affecting scientific research. The application of evidence-based practices to research itself is called metascience, which seeks to increase the quality of scientific research while reducing waste. It is also known as "research on research" and "the science of science", as it uses research methods to study how research is done and where improvements can be made. The five main areas of research in metascience are methodology, reporting, reproducibility, evaluation, and incentives. Metascience has produced a number of reforms in science such as the use of study pre-registration and the implementation of reporting guidelines with the goal of bettering scientific research practices.

Education

Evidence-based education (EBE), also known as evidence-based interventions, is a model in which policy-makers and educators use empirical evidence to make informed decisions about education interventions (policies, practices, and programs). In other words, decisions are based on scientific evidence rather than opinion.

EBE has gained attention since English author David H. Hargreaves suggested in 1996 that education would be more effective if teaching, like medicine, was a "research-based profession".

Since 2000, studies in Australia, England, Scotland and the US have supported the use of research to improve educational practices in teaching reading.

In 1997, the National Institute of Child Health and Human Development convened a national panel to assess the effectiveness of different approaches used to teach children to read. The resulting National Reading Panel examined quantitative research studies on many areas of reading instruction, including phonics and whole language. In 2000 it published a report entitled Teaching Children to Read: An Evidence-based Assessment of the Scientific Research Literature on Reading and its Implications for Reading Instruction that provided a comprehensive review of what was known about best practices in reading instruction in the U.S.

This occurred around the same time as such international studies as the Programme for International Student Assessment in 2000 and the Progress in International Reading Literacy Study in 2001.

Subsequently, evidence-based practice in education (also known as Scientifically based research), came into prominence in the U.S. under the No child left behind act of 2001, replace in 2015 by the Every Student Succeeds Act.

In 2002 the U.S. Department of Education founded the Institute of Education Sciences to provide scientific evidence to guide education practice and policy .

English author Ben Goldacre advocated in 2013 for systemic change and more randomized controlled trials to assess the effects of educational interventions. In 2014 the National Foundation for Educational Research, Berkshire, England published a report entitled Using Evidence in the Classroom: What Works and Why. In 2014 the British Educational Research Association and the Royal Society of Arts advocated for a closer working partnership between teacher-researchers and the wider academic research community.

Reviews of existing research on education

The following websites offer free analysis and information on education research:

• The Best Evidence Encyclopedia is a free website created by the Johns Hopkins University School of Education's Center for Data-Driven Reform in Education (established in 2004) and is funded by the Institute of Education Sciences, U.S. Department of Education. It gives educators and researchers reviews about the strength of the evidence supporting a variety of English programs available for students in grades K–12. The reviews cover programs in areas such as Mathematics, Reading, Writing, Science, Comprehensive school reform, and Early childhood Education; and include such topics as the effectiveness of technology and struggling readers.
• The Education Endowment Foundation was established in 2011 by The Sutton Trust, as a lead charity in partnership with Impetus Trust, together being the government-designated What Works Centre for UK Education.
• Evidence for the Every Student Succeeds Act began in 2017 and is produced by the Center for Research and Reform in Education at Johns Hopkins University School of Education. It offers free up-to-date information on current PK-12 programs in reading, writing, math, science, and others that meet the standards of the Every Student Succeeds Act (the United States K–12 public education policy signed by President Obama in 2015). It also provides information on programs that do meet the Every Student Succeeds Act standards as well as those that do not.
• What Works Clearinghouse, established in 2002, evaluates numerous educational programs, in twelve categories, by the quality and quantity of the evidence, and the effectiveness. It is operated by the federal National Center for Education Evaluation, and Regional Assistance, part of the Institute of Education Sciences
• Social programs that work is administered by Arnold Ventures LLC's Evidence-Based Policy team. The team is composed of the former leadership of the Coalition for Evidence-Based Policy, a nonprofit, nonpartisan organization advocating the use of well-conducted randomized controlled trials (RCTs) in policy decisions. It offers information on twelve types of social programs including education.

A variety of other organizations offer information on research and education.

See also

• Evidence-based assessment
• Evidence-based conservation
• Evidence-based dentistry
• Evidence-based design
• Evidence-based education
• Evidence-based legislation
• Evidence-based library and information practice
• Evidence-based management
• Evidence-based medical ethics
• Evidence-based medicine
• Evidence-based nursing
• Evidence-based pharmacy in developing countries
• Evidence-based philanthropy—effective altruism
• Evidence-based policing
• Evidence-based policy
• Evidence-based research—metascience
• Evidence-based scheduling
• Evidence-based toxicology
• Impact evaluation

References

1. Leach, Matthew J. (2006). "Evidence-based practice: A framework for clinical practice and research design". International Journal of Nursing Practice. 12 (5): 248–251. doi:10.1111/j.1440-172X.2006.00587.x. ISSN 1440-172X. PMID 16942511. S2CID 37311515.
2. For example: Trinder, L. and Reynolds, S. (eds) (2000) Evidence-Based Practice: A Critical Appraisal. Oxford, Blackwell Science.
3. Li, Rita Yi Man; Chau, Kwong Wing; Zeng, Frankie Fanjie (2019). "Ranking of Risks for Existing and New Building Works". Sustainability. 11 (10): 2863. doi:10.3390/su11102863.
4. Gade, Christian (2023). "When is it justified to claim that a practice or policy is evidence-based? Reflections on evidence and preferences". Evidence & Policy. 20 (2): 244–253. doi:10.1332/174426421X16905606522863.  This article incorporates text available under the CC BY 4.0 license.
5. Bourgault, Annette M.; Upvall, Michele J. (2019). "De-implementation of tradition-based practices in critical care: A qualitative study". International Journal of Nursing Practice. 25 (2): e12723. doi:10.1111/ijn.12723. PMID 30656794.
6. Cochrane, A.L. (1972). Effectiveness and Efficiency. Random Reflections on Health Services. London: Nuffield Provincial Hospitals Trust. ISBN 978-0900574177. OCLC 741462.
7. Cochrane Collaboration (2003) http://www.cochrane.org/about-us/history/archie-cochrane Archived 2021-02-24 at the Wayback Machine
8. "Development of evidence-based medicine explored in oral history video". American Medical Association. 27 January 2014. Retrieved 2020-12-23.
9. Sackett, D L; Rosenberg, W M (November 1995). "The need for evidence-based medicine". Journal of the Royal Society of Medicine. 88 (11): 620–624. doi:10.1177/014107689508801105. ISSN 0141-0768. PMC 1295384. PMID 8544145.
10. Evidence-Based Medicine Working Group (1992-11-04). "Evidence-based medicine. A new approach to teaching the practice of medicine". JAMA. 268 (17): 2420–2425. doi:10.1001/jama.1992.03490170092032. ISSN 0098-7484. PMID 1404801.
11. "A Brief History of Evidence-based Practice". Evidence Based Practice in Optometry. University of New South Wales. Retrieved 24 June 2019.
12. Hammersley, M. (2013) The Myth of Research-Based Policy and Practice. London: Sage.
13. Thomas, G. and Pring, R. (eds.) (2004). Evidence-based Practice in Education. Open University Press.
14. Nevo, Isaac; Slonim-Nevo, Vered (September 1, 2011). "The Myth of Evidence-Based Practice: Towards Evidence-Informed Practice". The British Journal of Social Work. 41 (6): 1176–1197. doi:10.1093/bjsw/bcq149 – via Silverchair.
15. "Working in Health Promoting Ways". Tasmanian Department of Health. 25 May 2022.
16. "Evidence-based Practice vs. Evidence-informed Practice: What's the Difference?".
17. Buysse, V.; Wesley, P.W. (2006). "Evidence-based practice: How did it emerge and what does it really mean for the early childhood field?". Zero to Three. 27 (2): 50–55. ISSN 0736-8038.
18. de Groot, M.; van der Wouden, J. M.; van Hell, E. A.; Nieweg, M. B. (31 July 2013). "Evidence-based practice for individuals or groups: let's make a difference". Perspectives on Medical Education. 2 (4): 216–221. doi:10.1007/s40037-013-0071-2. PMC 3792230. PMID 24101580.
19. Siegfried T (2017-11-13). "Philosophical critique exposes flaws in medical evidence hierarchies". Science News. Retrieved 2018-05-16.
20. Evidence-Based Medicine Working Group (November 1992). "Evidence-based medicine. A new approach to teaching the practice of medicine". JAMA. 268 (17): 2420–25. CiteSeerX 10.1.1.684.3783. doi:10.1001/JAMA.1992.03490170092032. PMID 1404801.
21. Eddy DM (1990). "Practice Policies – Where Do They Come from?". Journal of the American Medical Association. 263 (9): 1265, 1269, 1272, 1275. doi:10.1001/jama.263.9.1265. PMID 2304243.
22. Vine, Jim (2016), Standard for Producing Evidence – Effectiveness of Interventions – Part 1: Specification (StEv2-1), HACT, Standards of Evidence, ISBN 978-1-911056-01-0
23. "SCCAP Division 53 – The Society for Child Clinical and Adolescent Psychology".
24. Rathi, Akshat (22 October 2015). "Most science research findings are false. Here's how we can change that". Quartz. Retrieved 13 June 2019.
25. Ioannidis, John P. A.; Fanelli, Daniele; Dunne, Debbie Drake; Goodman, Steven N. (2 October 2015). "Meta-research: Evaluation and Improvement of Research Methods and Practices". PLOS Biology. 13 (10): e1002264. doi:10.1371/journal.pbio.1002264. ISSN 1544-9173. PMC 4592065. PMID 26431313.
26. Ioannidis, John P. A.; Fanelli, Daniele; Dunne, Debbie Drake; Goodman, Steven N. (2015-10-02). "Meta-research: Evaluation and Improvement of Research Methods and Practices". PLOS Biology. 13 (10): –1002264. doi:10.1371/journal.pbio.1002264. ISSN 1545-7885. PMC 4592065. PMID 26431313.
27. Trinder, L. and Reynolds, S. (eds) (2000) Evidence-Based Practice: A critical appraisal, Oxford, Blackwell Science.
28. "Knowledge creation as an approach to facilitating evidence informed practice: Examining ways to measure the success of using this method with early years practitioners in Camden (London)".
29. "Teaching Reading" (PDF). Australian Government Department of Education, Science and Training.
30. "Independent review of the teaching of early reading, 2006" (PDF). Archived from the original (PDF) on 2010-05-12. Retrieved 2020-07-31.
31. Johnston, Rhona S; Watson, Joyce E, Insight 17 - A seven year study of the effects of synthetic phonics teaching on reading and spelling attainment, IAC:ASU Schools, ISSN 1478-6796, archived from the original on 2017-01-14
32. "National Reading Panel (NRP) – Publications and Materials – Summary Report". National Institute of Child Health and Human Development. (2000). Report of the National Reading Panel. Teaching children to read: An evidence-based assessment of the scientific research literature on reading and its implications for reading instruction (NIH Publication No. 00-4769). Washington, DC: U.S. Government Printing Office. 2000. Archived from the original on 2010-06-10.
33. "National Reading Panel (NRP) – Publications and Materials – Reports of the Subgroups". National Institute of Child Health and Human Development. (2000). Report of the National Reading Panel. Teaching children to read: an evidence-based assessment of the scientific research literature on reading and its implications for reading instruction: Reports of the subgroups (NIH Publication No. 00-4754). Washington, DC: U.S. Government Printing Office. 2000. Archived from the original on 2010-06-11.
34. "Teacher's Guide, Put Reading First - K-3, NICHD, [e-mail]" (PDF).
35. "Building Evidence into Education". gov.uk.
36. "Home". NFER.
37. "Using Evidence in the Classroom: What Works and Why, Nelson, J. and O'Beirne, C. (2014). Slough: NFER. ISBN 978-1-910008-07-2" (PDF).
38. "The role of research in teacher education: reviewing the evidence-BERA-RSA, January 2014" (PDF).
39. "Research and Teacher Education". www.bera.ac.uk.
40. "Best Evidence Encyclopedia". Best Evidence Encyclopedia.
41. "Loading..." educationendowmentfoundation.org.
42. "Evidence for ESSA".
43. "Center for Research and Reform in Education". 11 January 2024.
44. "Every Student Succeeds Act (ESSA) | U.S. Department of Education". www.ed.gov.
45. "WWC | Find What Works!". ies.ed.gov.
46. http://toptierevidence.org/ Social programs that work

External links

Wikimedia Commons has media related to Evidence-based practices.

• "Development of evidence-based medicine explored in oral history video, AMA, JAN 27, 2014". 27 January 2014.