Radiography Advisory Meeting Minutes

Nov. 16, 2023, 4 p.m.

Meeting place

Microsoft Teams

Facilitator

Janelle Murphy, LLCC Radiography Program Director

Attendees

Members in attendance

Janelle Murphy, LLCC RAD Program Director; Andy Harmon, LLCC RAD Faculty and Clinical Coordinator; Michelle Bullock, LLCC RAD Lab Instructor starting spring 2024; Karina Moore, LLCC Health Professions Recruiter; Dr. Curt Settlemoir, Central Illinois Radiologic Associates, Medical Advisor; Sherri McLaughlin, Jacksonville High School Guidance Counselor Lance Malloy, Springfield Memorial Health Outpatient Services Manager; Rebecca Weakley, Memorial Cares, CI; Josh Risse, Springfield Memorial, CI; Sasha Schaive, Springfield Memorial, CI; Erin Martincic, Springfield Memorial, CI; Angie Smith, Orthopedic Center, CI; Doug Ferrill, Taylorville Memorial Health, Radiology Manager; Branzley Cantrill, Taylorville Memorial, CI; Cheyenne Rachall, St. John’s Hospital, CI; Jane Johnson,  Hillsboro Hospital, CI; Charity Mizera, Springfield Clinic, Radiology Operations Manager; Brooklyn Loos, Springfield Clinic, Radiology Operations Manager; Michael Wempen, Springfield Clinic, CI; Kyla Whitehead, Imaging Supervisor, Jacksonville Memorial Health; Kayla Kloppe, Jacksonville Memorial Hospital, CI; Shannon Meier, St. Francis Hospital, CI; Allison Vaira, LLCC RAD 2nd year student

Members absent

Dr. Jason Dockter, LLCC Vice-President of Academic Services; Karen Sanders, LLCC Foundation, Executive Director; Dr. Cynthia Maskey, LLCC Dean of Health Professions; Fabiola Gonzalez, LLCC Student Success Coach; Marjorie King, Director of Imaging, Springfield Memorial Hospital; Kurt Brauer, Springfield Memorial Hospital, Inpatient Imaging Manager; Brandon Richardson, Director of Imaging, St. John’s Hospital; Edith Dagen, Director of Imaging, Hillsboro Area Hospital; Jen Lewis, St. Francis Hospital, Imaging Manager; Brenda Bale, Springfield Clinic, Director of Imaging

Guests

N/A

Agenda

  1. Introductions
  2. Overview of current students
  3. Program effectiveness data
  4. Employer and graduate survey results
  5. Assessment data 2022-2023, completed cycle 2, June 2022-May 2023
  6. Annual review of program mission statement
  7. Program site updates
  8. Contributions
  9. Open forum

Minutes

1. Introductions

  • Everyone was introduced by name and relationship/role to the program.

2. Overview of current students

  • (Janelle) There are currently 16 first year students and 15 second year students.

  • Second Years, Class of 2024

    • The second year class had 1 student drop for personal reasons. This makes the anticipated JRCERT completion rate 15/15 or 100%.

    • Current clinical sites: Springfield Memorial (6), St. John’s (5), Jacksonville Memorial (2), St. Francis (1), and Taylorville Memorial (1). All 2nd year students rotate through Springfield Clinic, 2-weeks at main campus and 2- weeks at ortho in the 800 Building.

  • First Years, Class of 2025

    • We have retained all 16 students.

    • Current clinical sites: Springfield Memorial (6), St. John’s (5), Jacksonville Memorial (2), St. Francis (1), Hillsboro (1), and Taylorville Memorial (1). All 2nd year students rotate through Springfield Clinic, 2-weeks at main campus and 2-weeks at ortho in the 800 Building.

  • The application period is currently open for the class that will start in June 2024. Any student who meets the program’s admission requirements can apply until Friday, January 26, 2024, by 5:00 pm.

3. Program effectiveness data

  • (Janelle) The LLCC Radiography program is accredited by the Joint Review Committee on Education in Radiologic Technology (JRCERT). The program is required to complete an Annual Report for the JRCERT as an aspect of maintaining accreditation. The 2022 Annual Report was completed and submitted in October 2023. There are 3 pieces of information that are required as data indicating our program’s effectiveness; Credentialing Exam Pass Rate, Program Completion Rate, and Job Placement Rate. This information, as well as almost anything else you’d like to know about our program, can be found on LLCC’s radiography webpage. The data submitted is as follows:
    • ARRT Credentialing Exam Pass Rate – The 5-year average for graduates passing the ARRT exam on the 1st attempt is 95%. In the 5-year average (2019-2023), there were three students who did not pass on the 1st attempt. Two of those graduates did successfully pass on later attempts, but unfortunately, one graduate did not pass by the third and final attempt. The ARRT changed the cut score on the registry exam this year and had indicated that they expected more students to fail due to this change. Admittedly, the program was taken aback to have two graduates fail on their 1 st attempt after this change was made. This surprise was mainly due to the fact that the LLCC graduates have scored higher on the ARRT registry exam than the national average of all programs in the U.S. since 2015. Janelle shared a slide showing the ARRT’s National Comparison Report that validates this information. (Note that 2015-2016 data isn’t included on the slide because of changes in the ARRT’s reporting system that started effective 2017). The program won’t know if this statistic changed with the 2023 ARRT results until the end of this year since the ARRT doesn’t post this information until all programs have graduated their students for the year. The JRCERT requires that the exam pass rate include data for only those passing on the first attempt. The LLCC 5-year average for this is 95%. But our data would reflect a 98% if the data asked for all successful test-takers. Additional information regarding the exam pass rate included a slide indicating 2022 ARRT exam pass rate information for other Illinois community colleges as compared with LLCC. View Credentialing Examination Rate information in the LLCC Radiography Program Effectiveness Data document.
    • Job Placement Rate - The 5-year average for the program’s job placement rate for those graduates seeking active employment within 12 months is 100%. The employers who hired our Class of 2023 graduates were as follows: 5 hired by Springfield Memorial (2 in Imaging and 3 in CT), 7 were hired by St. John’s Hospital (5 in Imaging and 2 in Cath Lab), 1 was hired by OCI, and 1 was hired by Springfield Clinic. View the Job Placement Rate information in the LLCC Radiography Program Effectiveness Data document.
    • Program Completion Rate (Attrition) – Per JRCERT requirements, the completion rate is reported annually and not as a 5-year average. The benchmark set by the program is a 75% completion rate and the completion rate for 2023 is 100%. The Class of 2023 started with 16 students, and of those, two dropped for personal reasons. The information regarding Program Effectiveness Data was well received by the attendees and there were no additional comments brought forth for discussion. View the Program Completion Rate information in the LLCC Radiography Program Effectiveness Data document.

4. Employer and graduate survey results

Employer survey results

(Janelle) The program waits six months post-graduation to send surveys to the employers that we know hired our graduates. Based on the results, we appear to be fulfilling our mission of producing competent entry-level radiographers. All sent surveys were completed for a 100% response. One graduate is no longer employed in imaging and therefore was not surveyed. View the radiography employer survey of graduated students on the LLCC Radiography Surveys webpage.

OPTIONAL RESPONSES:
  • Question – Please list any topic(s) you believe should be emphasized more in the program that would help us achieve our goals and make graduates even more knowledgeable about radiography, more empathetic towards patients, or better communicators and problem solvers.
    • There is very little exposure to cath lab during the 2-year program. Development of critical thinking is probably the biggest opportunity. With more interactions with texting, the art of conversation is disappearing. Oral communication skills are not as strong as they once were.
    • Critical thinking and oral communication.
    • Communication/ability to speak with patients in a knowledgeable manner.
    • Comfort level in surgery and use of c-arms.
  • Question – Please feel free to comment on their overall professionalism.
    • This graduate has really struggled with attendance which has hurt his/her orientation significantly. We are working through issues impacting attendance.
  • Question – Please feel free to comment on their attitude and self-confidence.
    • Very positive just struggling with confidence.
  • Question – Please feel free to comment on how well the program accomplishes its mission.
    • Cath Lab is very different from main radiology, so a new grad has a lot to learn when they come directly from the Radiography Program.
Graduate survey results

(Janelle) The program waits six months post-graduation to send surveys to the graduates who were actively seeking employment. All 14 of the graduates responded to the survey. There are several questions on the survey specific to post-graduate employment. The information gathered from those questions indicates that all 14 of the students’ submitting surveys were employed within six months of graduation and all but 1 of them had a job before they graduated. The graduates work in a multitude of locations and often in more than one specific area of the department. Nine graduates are employed in General Radiography, three in CT, and two in cath lab. Eleven of the graduates’ work in the hospital setting, one in an OP facility, one in physicians office, and one does not currently work in imaging. Eleven of them are employed full-time, one is part-time, one is PRN, and one is not employed in imaging. When asked about the length of the orientation process at their place of employment three of them indicated they did not receive an orientation, two of them indicated a 1-2-week orientation, six indicated a 3-6-week orientation, and three indicated they had a 7–12-week orientation. View the radiography graduate survey on the LLCC Radiography Surveys webpage.

OPTIONAL RESPONSES:
  • Were you employed in any capacity in Radiology Technology within six months of graduation?
    • Yes
    • Yes, at HSHS St. John's Hospital
    • HSHS St Francis and HSHS St. Johns
    • Yes, June 11th HSHS St. Johns
    • Springfield Clinic
  • Please feel free to comment on how long it took you to find employment after you graduated.
    • I had a job ready when I graduated.
    • I got a job the December before we graduated
  • In what specialty have you been employed in since your graduation?
    • CT
    • At St Francis I do both XR and Ct
    • Orthopedics
  • For your first Radiologic Technology job after graduation, how long was the orientation in the imaging department that was provided by your employer?
    • 7-12 weeks
    • I did not receive an orientation period since I had been previously employed at the hospital prior to graduation as a tech assistant.
    • I got about a ½ day.
  • Based on your classes and clinical experience in the program, how well did the program prepare you to perform radiographic and fluoroscopic procedures?
    • Excellent
    • GOOD
    • Best program I have ever been a part of!
  • Based on your experiences since graduation, how would you rate the amount of clinical time you had as a student?
    • Good. Towards the end of our second year, I felt like it was a little redundant and felt like I could do it on my own.
  • How would you rate your satisfaction with the quality of education you received in the Associate Degree Radiography Program?
    • Too much outpatient clinic stuff.
  • Please provide any topics that should have been emphasized more that would have helped you become even more knowledgeable and skilled in radiography, more empathetic towards patients, a better communicator, or a more effective problem solver:
    • Equipment when grabbing patients from their rooms.

The information regarding the employer and graduate surveys was well received by the attendees and there were no additional comments brought forth for discussion.

5. Assessment data 2022-2023, completed cycle 2, June 2022-May 2023

(Janelle & Andy) The June 2022-May 2023 Assessment Plan was presented to everyone. This plan marks the 2nd cycle of a 3-year cycle of assessment. The measurement tools used to correlate the data are various questions on Clinical Evaluations, Clinical Final exams, written papers, oral presentations, exam competencies, E*Value time tracking, E*Value procedures tracking reports, skills labs, and embedded test questions. The attendees were provided a copy of the assessment plan attached to the invitation to the advisory meeting and were asked to review it in advance of the meeting. Of the 32 benchmarks assessed, 13 of them were not met so the meeting’s assessment discussion was focused on those benchmarks. Janelle explained that the program made a change to their assessment benchmarks to include “all students” instead of the previous format of “80% of students will ….” This change in format is more aligned with JRCERT recommended assessment.

  1. PLO #2, Students will develop competency in the clinical environment. RAD 200, CLO 4
    1. Benchmark - Students will receive a HESI score of 750 (Recommended performance) or higher on the Procedures component of the exam.
    2. Analysis - 14 students took the HESI mid-curricular exam, and 13 scored above 750 on the Procedures portion of the exam. The one student who failed to meet the standard scored a 743, which is also extremely close. This result is very similar to the previous cycle, although the average score for all students dropped slightly to 978.6. Instructor will continue with Canvas review quizzes and will also use data from this cycle to build additional review activities focused on the types of questions most frequently missed on these quizzes.
    3. Cycle 1: 12/13 scored +750, Cycle 2: 13/14 scored +750
  2. PLO #2, Students will develop competency in the clinical environment. RAD 102, CLO 5
    1. Benchmark Students will receive a passing score (P) on patient transfer skill testing on the first attempt.
    2. Analysis - 16 students were evaluated on both wheelchair and stretcher transfer skills, with 10 succeeding on the first attempt, or 62.5% of students. While this result does show a noticeable improvement from the previous cycle (44% passed on 1st attempt), it still falls well short of the benchmark. Again, wheelchair transfers were more problematic than stretcher transfers. Instructor will keep the additional class time and opportunity for students to practice with a “dry run” before the skills test, but it is felt that the lack of a grade combined with the opportunity for a 2nd attempt makes this objective very low stakes for the students. In the next cycle, a grading scheme will be devised to give students a greater incentive to perform these skills effectively on the first attempt.
    3. Cycle 1: 44% Pass, Cycle 2: 62.5% Pass
  3. PLO #2, Students will develop competency in the clinical environment. RAD 125, CLO 5
    1. Benchmark - Students will receive a grade of >80% on clinical final exam questions related to patient dose with technical factor changes.
    2. Analysis - 13 of the 15 students scored 100% on the clinical final exam questions related to patient dose. Of the two students not scoring >80%, one missed one question for a 75% and the other missed 2 questions for a 50%. Of the 4 questions related to patient dose, only 3 of them were missed and only by one student each. Will look at ensuring review of how changes to kVp, mA, and time affect patient dose in course lecture and final exam review. For the next cycle, the benchmark will be >75% to correlate with the only 4 questions.
    3. Cycle 1: All students 80% or higher. Cycle 2: 13 of 15 students 80% or higher.
  4. PLO #3, Students will develop critical thinking skills. RAD 221, CLO 5
    1. Benchmark - Students will score > 80% on questions related to assessment of images with internal devices.
    2. Analysis - 14 students answered test questions related to internal devices, with 4 students scoring below 80% on these items, which does not meet the benchmark. The overall average was also 80%, which is lower than the previous cycle. The material is currently taught as a group activity in class, but in cycle 3 an additional individual assignment will also be given to the students to complete for a grade prior to the exam.
    3. Cycle 1: 89.6%, Cycle 2: 80%
  5. PLO #3, Students will develop critical thinking skills. RAD 103, CLO 3
    1. Benchmark - Average score of > 80% on test questions related to image evaluation and corrective steps.
    2. Analysis - 16 students answered test questions requiring them to evaluate radiographic images and provide correct steps. 11 students scored above 80% on these items. This result does not meet the benchmark but does show improvement from the previous cycle where only 8 students scored >80%. Additionally, the average score across all students increased from 75.6% to 82.1%. It is still felt that the best way to reach the remaining students is to provide graded image critique assignments with instructor feedback prior to the exam.
    3. Cycle 1: 8/16 +80%, Cycle 2: 11/16 +80%
  6. PLO #3, Students will develop critical thinking skills. RAD 111, CLO 2
    1. Benchmark - Students will score > 80% on imaging factors and their related image quality factor.
    2. Analysis - Of the 15 students completing the assignment, 6 of them did score > 80%. Of the 6, the scores ranged from 50% - 79%. All 14 questions related to analyzing EI or S numbers and making appropriate technical factor changes. The questions missed the most related to EI or S number changes requiring a doubling or halving of technique. The difference from the previous class is that this became an assignment in Canvas rather than an assignment completed during class. Plan to develop this assignment more into a group discussion with more practice prior to the actual assignment.
    3. Cycle 1: All students scored > 80% Cycle 2: 9 of 15 scored > 80%
  7. PLO #4, Students will develop communication skills. RAD 102, CLO 6
    1. Benchmark - Students will score > 80% on test questions related to medical terminology.
    2. Analysis - 13 of 16 students that answered medical terminology test questions scored >80% on those items. The three students that did score lower all missed the cut off by one question, and the overall average score was 89.2%. While this shows improvement from the previous cycle (85.2%), a few students are still not grasping this essential information. Worksheets were provided for practice outside of class, but open book/open notes assignments aren’t ideal for this subject matter since it’s mostly about memorizing definitions. Will plan for an additional graded quiz before the 1st exam to gauge students’ preparation and provide additional review.
    3. Cycle 1: 11/16 +80%, Cycle 2: 13/16 +80%
  8. PLO #4, Students will develop communication skills. RAD 104, CLO 1
    1. Benchmark - Students will score 90% or higher on verbal fluoro explanation checkoff form.
    2. Analysis - 16 students were evaluated for their ability to verbally explain and describe fluoroscopic procedures, with 14/16 scoring 90% or higher. This does not meet the benchmark and it is felt that the lower result compared to the previous cycle is partially due to a more consistent application of the scoring rubric. The areas of most confusion for the 2 students were the types of contrast used for certain exams and the patient communication during a barium enema. These areas will be reviewed and in future cycles a grade will be attached to this checkoff activity.
    3. Cycle 1: 93.6% avg, Cycle 2: 14/16 +90%
  9. PLO #4, Students will develop communication skills. RAD 220, CLO 2
    1. Benchmark - Students will score 80% or higher on oral presentation part of rubric.
    2. Analysis - 14 students presented their electronic research posters orally to the class, with all but one scoring 80% or higher on this section of the rubric. This result is the same as the previous cycle, when 1 student failed to score 80% or higher, and does not meet the benchmark. The low-scoring student was extremely nervous during the presentation, so in the next cycle the instructor will make every effort to provide a relaxed environment for the students.
    3. Cycle 1: 11/12 +80%, Cycle 2: 13/14 +80%
  10. PLO #4, Students will develop communication skills. RAD 105, CLO 2
    1. Benchmark - Students will respond accurately >90% of the time to positioning questions related to imaging during the lab comp.
    2. Analysis - 16 students responded to 145 verbal questions during lab comps with an overall accuracy of 90.7%. While this does represent a substantial increase compared to the previous cycle result of 67.1%, 9 of the 16 students failed to reach the 90% threshold, so the benchmark was not met. The lecture instructor and lab instructor did work to create some questions prior to each comp, but only a couple of those were routinely reinforced during lab practice in each section. In cycle 3, the reinforcement will be improved, and instructors will make sure that each student is asked 3 questions during each comp to avoid variation in sample size.
    3. Cycle 1: 67.1%, Cycle 2: 90.7%
  11. PLO #4, Students will develop communication skills. RAD 103, CLO 5
    1. Benchmark - Students will score 80% or higher on the patient intake portion of lab comps.
    2. Analysis - 13 of 16 students scored 80% or higher on the patient intake portion of lab comps, which does not meet the benchmark. This is a mixed result compared to the previous cycle where 5 students scored below 80% but the overall average was slightly higher (86.7% for cycle 1 compared to 83.75% for cycle 2). The main area of difficulty during the intake continues to be the patient history, so this aspect will be emphasized during lecture and lab practice in future cycles.
    3. Cycle 1: 11/16 +80%, Cycle 2: 13/16 +80%
  12. PLO #5, Students will exemplify professionalism. RAD 295, CLO 1
    1. Benchmark - Students will score >85% on their written resume.
    2. Analysis - 13 out of 14 students met the benchmark with a final score of 87% or higher. One student scored 84%. Eight students received a 93% or higher, or an A. The other 6 students received Bs. This semester, the students made appointments with LLCC Career Services instead of the Writing Center, which seemed a better fit for the assignment. The student who did not meet the benchmark scored only a 75 on the rough draft and failed to make all the suggested edits on the final copy. Will continue with this assignment as it is and allow collaboration with Career Services to become more familiar with both parties.
    3. Cycle 1: +91% Cycle 2: +84%
  13. PLO #5, Students will exemplify professionalism. RAD 221, CLO 3
    1. Benchmark - Students will score >80% on written paper outlining best practices for patient care of diverse populations.
    2. Analysis - 14 students completed written papers describing best practices when caring for patients from an underrepresented population, with an average score of 87%. 13/14 students scored at or above 80%, with the lowest scoring student receiving 76% which failed to meet the benchmark. The LLCC Writing Center did give a presentation to the class on paraphrasing and summarizing, but the students still struggled with APA formatting and proper citation usage. Unfortunately, the LLCC Library was unable to get additional resources posted for the students, but the instructor will make sure those are provided in the next cycle, in addition to devoting part of a class period to discussing common citation errors.
    3. Cycle 1: 90.7%, Cycle 2: 87%

Janelle asked for any additional comments and suggestions and stressed the value of input from the committee on assessment. The group was comfortable with the information that was provided to them. No additional comments were expressed at this time. They were asked to continue to think about the program’s assessment measures and to provide ideas and feedback to Janelle or Andy at any time.

6. Annual review of mission statement

(Janelle) All attendees were provided a copy of the current program’s Mission Statement and asked to review it. There were no recommendations for change brought forth.

7. Program site updates

(Janelle & Andy) The program is looking to expand to a 1st and 2nd year cohort of 20 students each with an anticipated start in June 2025. This expansion is tentative based on the completion of the remodel of Logan Hall and the installation of a new radiographic unit in the trauma simulation classroom that is a part of the remodel. Janelle shared a blueprint of the current classroom and the trauma room that would be located across the hall. In the current classroom, the x-ray table is too close to the wall and there isn’t enough room for more students in lab to see what is happening as the lab instructor is teaching and demonstrating at the table. The room is currently pretty full of desks for 16 students along with the space that table and digital equipment takes up. Having an x-ray unit in the trauma sim room will give the program much needed space to expand and it will be ideal to have two separate spaces that can be used for teaching. The RAD program, which always accepts a full cohort each year, has the smallest amount of space of any program in HLPR. The group discussed the issues with finding clinical site capacity and the program plans to expand using Springfield Clinic’s main campus, ortho, and the primary care clinic on Wabash. Three students will be assigned to the clinic and will rotate among those 3 facilities. A 6th student will be added to St. John’s and an additional clinical rotation through HSHS Priority Care on MacArthur will be added.

8. Contributions

  • Thank you! LLCC provided funds to the program to purchase a used digital x-ray unit which has been an incredible addition to the program’s inventory. The program was also awarded a flexible skeleton via an LLCC L.E.A.G.U.E. grant which has helped with positioning instruction. Lastly, Janelle and Andy acknowledged Lindsay White for her dedication the last 3 years as the program’s lab instructor. Lindsay did an awesome job for the program and is loved by the students. We wish her all the best in her new job closer to home! Michelle Bullock, who was in attendance at the meeting, will replace Lindsay as the lab instructor starting with the spring semester.
  • Wish list! While things are looking up for our future, these following items were on last year’s wish list and so our on there again this year. The program really needs a new x-ray unit with an overhead tube that will allow for practice of cross-table lateral exams as well as trauma imaging. This will also allow for better student visualization during lab procedures. Our other item is hopes of a larger classroom. This will be accomplished if the new trauma room has a new x-ray unit and then the current x-ray unit would be removed from L1116 and traded in on the new unit. Removing the current unit will create needed space in the current classroom.

10. Open forum

  • All attendees were asked for any additional comments or points of discussion. No other issues were brought forth. Thank you to all for your continued support!
  • The Advisory Committee meeting concluded at 5 p.m.