In developing evidence-based clinical practice guidelines, the process of reviewing the scientific literature to find evidence-based answers to specific clinical questions is challenging. Many times the specific clinical issue of interest may not have been studied extensively in well-designed studies of the type that can adequately determine if a clinical method is effective. At other times, even when well-designed studies have been done on a particular clinical topic, the study findings themselves seldom present totally straightforward and unambiguous answers to the clinical questions of interest.

Careful analysis of the studies and considerable judgment are always needed when using the findings of research studies to help in making informed clinical decisions and developing clinical practice guidelines. For most clinical topics, it is exceptional to find studies that evaluate exactly the clinical situations and types of subjects that are of interest. Therefore, it is almost always necessary to generalize to some extent in terms of the subject characteristics (such as age or IQ) and the clinical setting or the type of assessment or intervention method used. The research studies reviewed for this guideline were no exception.

In using research evidence to help make clinical decisions, the two primary considerations are the quality of the evidence and its clinical applicability to the question of interest.

Primary Considerations in Using Research Evidence

• The

• The

The overall usefulness of a study's findings to clinical decision-making relates both to confidence in the results (based on the quality and amount of scientific evidence) and the similarity of the study's subjects, clinical methods, and setting to the question of interest (that is, its applicability).

Considerations about quality of studies

The considerations about using scientific evidence as the basis for clinical decisions apply to all the recommendations in this guideline. For some of the clinical questions of interest, several studies were found that met criteria for adequate evidence about efficacy. For other questions of interest, few or no studies were found that met such criteria.

There are also numerous articles in the scientific literature that did not meet criteria for adequate evidence about efficacy, yet still contained valuable information that may be useful in clinical practice. These articles include case reports, case series (sometimes using pre and post-test designs), and other descriptive studies, as well as articles that primarily discuss theory or opinion.

Relatively rigorous criteria were used for selecting studies that would provide adequate evidence about efficacy. The findings of these studies were used as the primary basis for developing guideline recommendations. In many cases, information from the articles and studies not meeting these evidence criteria was also reviewed by the panel, but information from these sources was not considered evidence about efficacy and was not given as much weight in making guideline recommendations.

Considerations about applicability of studies

Of particular concern for this guideline was finding high-quality scientific studies that focused on children under the age of 3 years. For some topics, studies were found that evaluated only children within the guideline's target population (children from birth to 3 years of age), but for other topics, the only studies found evaluated groups that included somewhat older children (over age 3).

As noted above, the inclusion of children over age 3 does not affect the quality of the study or bias the results, but it may make the study's findings somewhat less applicable to the guideline topic. Ratings of applicability for this guideline are described in Appendix A, Table A-6.

Applicability was taken into account when making guideline recommendations and more weight was given to findings from high-quality studies that focused on children under 3 years old. However, when there were few good studies found that focused on children in the target age group, then the panel thought it important to generalize from evidence found in good studies of somewhat older children.

Judging the quality and applicability of the evidence when making guideline recommendations

Given the considerations above, the panel needed to carefully evaluate the quality and applicability of the scientific evidence that was used as the basis for these guideline recommendations. Similar limitations and considerations apply to all evidence-based practice guidelines. The strength of evidence ratings are a reflection of both the amount and quality of the scientific evidence found and its applicability to the guideline topic.

Additional information about reviewing and rating the evidence used to develop the guideline recommendations can be found in the methodology tables in Appendix A.

It is intended that this DOH Clinical Practice Guideline for developmental disabilities in children from birth to age 3 be a dynamic document that is updated periodically as new scientific information becomes available. This guideline reflects the state of knowledge at the time of publication, but, given the inevitable evolution of scientific information and technology, it is the intention of the DOH that periodic review, updating, and revision will be incorporated into an ongoing guideline development process.