DRAFT: This module has unpublished changes.

Written Communication Team Updates

 

2019-2020

 

March 30, 2020 - Scoring fodler shared with evaluators - to be returned Friday, April 17th.

 

March 25, 2020 - email with normed materials from fall scoring as refresher of rubric, artifact types, etc.  

 

January, 2020 - Collection of artifacts from fall semester began.

 

Nov, 2019 - Instructor reports drafted.

 

Oct, 2019 - Nov, 2019 - Data analysis and draft of summary report.  Draft emailed to Team Lead from IERP on 11/8/2019.  Recommendations from Team Lead to IERP on 11/11/2019.  Second draft of summary report completed 11/11/2019.

 

Sept 6, 2019 - Oct 8, 2019 - Scoring Window

Office 365 shared folder with assigned artifacts, resources, rubric, and scoring sheet made available to each rater.

 

Sept 3, 2019 - Norming Session #2 - 2 pm - CARE - Members present: E. Niemi, T. Williams, E. Miller, N. Schurr, K. Lamb, E. Miller, C. Gordon, K. Strode, A. Roper

General reminders of rubric use. Came to concensus on norming artifact scores for use during scoring.  Determined window of scoring due to high volume of artifacts - 36 sections of courses, 12 unique courses, 603 unique artifacts, all academic divisions represented, both general education courses and major courses represented.  Evaluators will have no more than 20 artifacts to score.

 

 Context & PurpCont DevelGenre & Disc ConvSrcs & EvidContr of Synt & Mech
ENGL1010_norm122222
ENGL1020_norm121212
POLS1030_norm111111

 

 

Sept 3, 2019 - Norming Session #1- 11 am - CARE - Members present:  E. Niemi, T. Williams, L. Matravers, E. Miller

Discussed general reminders of rubric use and determined scores on the 3 norming articles. 

 

 

 

Aug 20, 2019 - 11 am- CARE - Plenary Session - planning meeting for fall scoring. Finalized evaluators. Will send poll for norming session(s).

 

2018-19

Mar 26, 2019 - noon - Continued Rubric Review

Attending team members: E. Niemi, T. Williams. N. Pitts, K. Lamb, N. Schurr, A. Roper, C. Gordon, K. Strode

Team members continued the review of the final 2 areas of the rubric.  Edits to both areas were discussed with a final agreement on clarifying the expected level of integration for performance levels 2 and 3 of Sources & Evidence.  Another edit was made to performance level 1 of Control of Syntax & Mechanics in which the clarifying language was adjusted to read "major erros that may alter meaning or obstruct flow or tone."

 

Written Communication Rubric v.2019

 

Team members were reminded to recruit instructors for the submission of artifacts from fall 2018 or spring 2019.  The form to agree to contribute artifacts will be distributed to team members and is located here.  This form also allows instructors to identify the primary type of writing assignment and which parts of the rubric to be evaluated using the assignment.  Members were also reminded that the team will have a plenary session in August for organizational purposes.

 

 

Mar 21, 2019 - noon - Rubric Review

Attending team members:  E. Niemi, T. Williams, N. Pitts, K. Lamb, N. Schurr, A. Roper, C. Gordon, K. Strode, L. Matravers

Team members reviewed the artifacts with the greatest discrepancies among reviewers, primarily the ENGL1020 artifact, and discussed whether additional clarifying language was needed in certain areas of the rubric in order for consistent evaluation among all scorers.  A change was made in the area of Context and Purpose on benchmark level - word "negligible" changed to "minimal" for consistency.  Team members felt that negligible indicated below level 1 performance and wanted consistent language across the descriptors for the level.  Another change was made in Genre and Disciplinary Conventions in Milestone 2 where the word "unsophisticated" was replaced with "emerging".  Team members agreed that the term unsophisticated implied a performance level lower than Milestone 2 and preffered the term emerging at this level.

Members also discussed whether gathering from contributing instructors the type of paper would assist in evaluating for purpose appropriately.  The contributors form will now ask for a classification of the paper in the assignment as either research, reflection/response/narrative, or argumentative/persuasive.  The contributors will also be able to mark which criteria of the rubric the assignment assesses so if there were no sources required, the instructor can indicate that the assignment should not be evaluated for Sources & Evidence.  Due to time contraints, members will each review Sources & Evidence and Control of Syntax & Mechanics criteria for clarity and bring any suggestions to next meeting (tenatively Tues, Mar 26th).

 

 WC Rubric Evaluation sp2019.pdf

 

 

Feb 21, 2019 - noon - Deploy Rubric Evaluation/Norming

 

 

Jan 31, 2019 - noon - Timeline Planning/Final Recruitment

 

 

 

Sept 11 and Sept 13, 2018 - 1 pm - Recruitment and Organizational Meetings

 

Attending team members discussed recruitment of team members as well as viability of scoring and potential timeline.  Gathering interested faculty members is mot critical and proving most difficult.

 

 

Aug 21, 2018 - 11 am - Plenary Session - (joint session with Information Literacy)

Team members discussed the plan for scoring and/or a second review year given the disengagement of previous Team Leads during 2017-18 review year. A plan was devised to quickly review results from 2016-17 scoring year, evaluate any need to make changes to rubric, recruit potential scoring and contributing members, norm the rubric, and score artifacts within the fall and spring semesters.  IERP developed a Memorandum of Understanding form for potential contributors in an attempt to gather pre- and post-evaluation information as well as provide the potential for "closing the loop" with contributing instructors.

 

 

 

DRAFT: This module has unpublished changes.