Introduction to Health Services Research and Evaluation 



 
 November 22, 2009

 
Course Syllabus


 

Course Description

Introduces basic methods for undertaking research and program evaluation within health services organizations and systems, and reviews major completed studies. Topics include the relationship between health services research (HSR) and health care policy and management; the multidisciplinary philosophy of HSR; research design, including experimental and quasi-experimental approaches; issues of reliability, validity, and measurement; survey research techniques; use of existing data systems; basic cost benefit and effectiveness analysis; and measurement of quality of care. Students critique published HSR studies and develop a design for a research or evaluation project.


Course Objectives

Upon completion of this course, you will be able to:

  • Critique published health services research and health program evaluations
  • Develop a design for a research or evaluation project.
  • Describe the relationship between health services research and program evaluation
  • Identify differences between basic and policy-relevant health services research projects and program evaluation
  • Develop a conceptual framework for a study, showing the hypothesized causal variables and the expected outcomes
  • Identify different types of study design, including observational, pre-experimental and experimental designs, and their inherent threats to internal and external validity
  • Describe the basic issues related to measurement of variables
  • Identify problems with measurement reliability and validity
  • Identify aspects of quality of care and its measurement as they relate to health services research projects
  • Discuss how survey research is used in health services research and evaluation, in terms of choice of sampling techniques, determination of sample size, and approaches to writing survey questions
  • Demonstrate knowledge of the basic concepts of cost benefit and cost-effectiveness analysis
  • Utilize secondary data and existing information sources in research projects

Course Topics

The course covers the following topics:

  • The relationship between health services research and health care policy
  • The multi-disciplinary philosophy of health services research
  • Research design, including experimental and quasi-experimental approaches
  • Issues of reliability, validity, and measurement
  • Survey research techniques
  • Use of existing data systems
  • Basic cost benefit and effectiveness analysis
  • Measurement of "quality of care"

Course Format

The course contains 15 lectures, seven individual exercises, four laboratory group sessions, and four interactive LiveTalk sessions with the TAs and instructors.

Class participants will be assigned to a laboratory group based on time zone. These groups will work together to answer a set of questions using the Wiki tool. 


Course Materials

All required readings for the course are available via the Welch Medical Library E-Reserves System. Instructions on how to access course readings are provided on individual lecture pages.

Lab Session Participation

Many of the lectures have associated group exercises (labs). These exercises are an integral part of the course experience. Participation in lab groups is required. The goals of the lab experience are as follows:

  • To provide "hands-on" experience in selected methodologic areas relevant to HSRE
  • To allow for discussion and debate on selected research and evaluation topics
  • To answer questions that may arise from lecture or required reading material
  • To offer advice and clarification regarding the mid-term and final assignment
  • Logistics of Lab Sessions

    1. Students will be assigned to lab groups of five to six people, grouped by time zone. You will work with the same group throughout the course.
    2. There are four labs, each associated with a particular lecture. The lab assignment will be available the same time the lecture is available.
    3. Members of each group will work together to complete the lab assignment. Please use the Wiki Projects tool under the Communication Center tab. Reference material on how to use the Wiki are in the Online Library and on the Wiki Projects page.
    4. Once finished, each group will click on "Mark as Finished" button for the completed Wiki project designated for that lab. (Please see the schedule for the due dates.)
    5. A model solution will be posted at about 5 p.m. EST on the due date. While there is no definitive solution to the lab exercises, this model solution will work through the lab exercise and present one possible solution and suggestions regarding key decisions made in designing the solution.
    6. Comments on each group's solutions will be posted the following day. These comments will include constructive feedback that highlight areas where the group's solution was "on target" as well as aspects that missed the mark or that might be inappropriate or unworkable. The comments will also suggest alternative ways in which the group could have proceeded or issues that were not addressed by the group's solution.
    7. Students should read through all the solutions and TA comments posted for the lab. If students have questions regarding alternative approaches, specific details of a solution, or comments made by the TA or faculty member(s), they are encouraged to post the questions on the BBS (in a thread designated for lab questions) by noon on Thursday. The TA and instructor will review the questions and compose answers that will be posted by Friday at 5 p.m.
 

LiveTalk Session Participation

There will be four LiveTalk sessions during the course. We expect that each student will participate in all LiveTalk sessions by doing the following:

  • Attending each LiveTalk session or listening to the archived LiveTalk (for those who cannot attend at the scheduled time)
  • Posting a question on the BBS 24 hours prior to at least one of the LiveTalks (not including the first LiveTalk which is just an introduction to the course). The question should be related to the lectures or readings that have been covered up to that point
  • For the second LiveTalk session we will complete a sample midterm assignment. Each lab group will be assigned a section of the sample paper to review and briefly present. More information on this assignment will be given closer to the LiveTalk date.

Grading Policy

Grades in this course are determined in the following way:

  • Mid-term paper (35%)
    • Students will write a 4-5 page article review
  • Lab session and LiveTalk participation (15%)
    • For details, please read the section of this syllabus entitled "Lab Session Participation" and "LiveTalk Participation" 
  • Final paper (50%)
    • Students will write a 15-20 page paper based on a basic program evaluation proposal

Contact Information

Ann Skinner, MSW
Senior Scientist
Department of Health Policy and Management
Faculty of Health Services Research
Office phone: 410-614-4022
Email: askinner@jhsph.edu

Lok Wong, Lead TA
Department of Health Policy and Management
Email: lokwong@jhsph.edu

Sarika Rane, TA
Department of Health Policy and Management
Email: srane@jhsph.edu
 


Help

Concerns
Contact
Concerns about course topics and assignments
Technical concerns about the functionality and operation of course Web pages (before emailing, please make sure that you can replicate the problem)
  • DEHelp, the central help system for all tech support inquiries related to DED courses

Technical help on weekends
  • JHSPH User Support: 410-955-3781
Concerns about your Internet connection
  • Your Internet service provider (e.g., AT&T, Erols, etc.)
Concerns about your personal software
  • Your software vendor


Ethical Conduct

The academic ethics code, as discussed in the Policy and Procedure Memorandum for Students, March 31, 2002, will be adhered to in this class.


Disability Support Services

If you are a student with a documented disability who requires an academic accommodation, please contact Betty H. Addison in the Office of Career Services and Disability Support: dss@jhsph.edu, 410-955-3034, or Room E-1140.


 

© 2009 The Johns Hopkins University. All rights reserved.
Copyright to this collective work of materials is owned by The Johns Hopkins University.
Copyright to individual contributions may be retained by contributing authors.