2016-38: Add Data Fields to Support Multiple Measures for Assessment Placement

Problem / Issue

In support of AB743, which calls for an assessment system to include multiple measures for placement, and SB1456, which calls for the gathering of multiple measures data, the Common Assessment Initiative (CAI) requested the development and implementation of a series of new data field questions to collect self-reported, high school transcript data in support of assessment placement for the CCCAssess program. The questions and downloadable data fields will be added to the Education page of the Standard Application only. Collecting transcript data at the time of the application for admission facilitates a solution to a very difficult task of obtaining good data otherwise. We believe we can streamline and limit the questions to just those students who need placement. 

Steering Committee Response: The CCCApply Steering Committee, as well as representatives of the CCC Chancellor's Office, approved this development with the stipulation that the implementation be optional for the colleges that choose to participate. The CCCAssess pilot program includes 59 California Community Colleges who will begin testing the new common assessment platform on September 20, 2016.  

NOTE:  Adoption and implementation of these questions is 100% OPTIONAL. If your college would like to "Opt-In" to participate, please contact John Hadad, Product Manager, CCCAssess, jhadad@ccctechcenter.org.  

Testing in Pilot Environment: Colleges that choose to implement these questions can preview the UI (user interface) and test the download client changes in the Pilot environment for 30 days prior to the September 20, 2016 release. Colleges must "opt-in" in order to participate. Please contact Patty Donohue, Product Manager, pdonohue@ccctechcenter.org, or John Hadad, CAI Product Manager, jhadad@ccctechcenter.org.

Approved Solution

This change request pertains to the CCCApply Standard Application only.

Implementation will be OPTIONAL; participating colleges must "opt-in" by contacting the CCCApply project team.

Add new OPTIONAL section to the Education page of the Standard Appliication called, "High School Transcript Information", which will include a series of 7 new downloadable data field questions, asking a specific sub-set of qualifying students* to self-report GPA and highest English and Math courses taken and corresponding grades, if they are in 12th grade or have completed high school within 10 years of the RDD (start of the term).

The section should display between the "Last HS Attended" and "College Education" sections of the Education page only if the student meets the conditional criteria. See "Conditions for Data Collection" requirements specified below. The data fields will be downloadable through the Download Client,and available in the Student Profile Service (Portal internal use), Application Rules, and the Report Center.  

7/12/16: Steering convened a special meeting to discuss concerns brought up during approval process. Conditions for approval include making this implementation 100% optional (opt-in requirement) and limiting the data collection to students who are in 12th grade or have completed high school within 10 years of the RDD. Other changes include: minor changes to the question text, and response options, adding options for "None of the Above" to course and grade responses,, and the addition of a disclaimer to the section stating that the collection of this data will not be used to determine student admission eligibility.  

Colleges that choose to pilot these questions will provide feedback to stakeholders to gauge efficacy and help determine if changes are necessary to implementation or technical requirements.  

User Stories

• As a college transfer counselor, I need to collect specific high school transcript information from students who have graduated from high school, or equivalent, or are still in high school and have passed the 11th grade, in the United States, for the purposes of assessing testing placement for the CCCAssess program (a project of the CCC Technology Center).
• As a college assessment placement counselor, I need to ensure that self-reported, student "High School Transcript Information" is available in the Download Client so it can be imported to the CCC Report Center for research and analysis.
• As a CCC researcher, I need to be able to run reports on the "High School Transcript Information" data in the CCC Report Center and set up application rules in the Administrator.
• As a product manager/program manager of the Common Assessment Initiative (CAI), I need to ensure the "High School Transcript Information data is available to be added to the Student Services Portal (SSP) Student Profile Service.

Requirements Summary

Mock-Ups

Logic Flowchart

All Questions (Do Not Appear Onscreen at the same time)

NOTE- The mock-up screenshot is not an accurate representation of the layout; questions do not appear on screen at the same time for all use cases. Missing from the image below is the disclaimer that the information will not be used in the determination of admission eligibility. Please note - this disclaimer has been added to the specifications.

Technical Specifications 

General Requirements

• The technical specifications below pertain to the CCCApply Standard Application only. 
• The technical specifications below are for OPTIONAL adoption and implementation. Colleges must "Opt-In" to participate.
• If a college chooses to adopt and implement, display of questions and logic must be turned on manually by the developers.
• College control of the display of questions is not included in this change request.

Conditions for New High School Transcript Information Section

1. Add new section to the Education page in the Standard Applicationn for: "High School Transcript Information" between the Last High School Attended section and the College Education Level section and display "question" depending on conditional criteria detailed below, otherwise do not display section..
   
   
   1. Condition 1: Concurrent Enrollment User has Completed 11th Grade 
      Display "High School Transcript Information" section with new Yes/No boolean question, "Have you completed the 11th grade?" and require a response ONLY IF:
      
      High School Education Level = "Will be enrolled in high school (or lower grade) and college at the same time"
      AND
      High school Country = United States
      
       
   2. Condition 2: US High School Graduates or Equivalent
      Display "High School Transcript Information" section with Question #1: Grade Point Average (and DO NOT display boolean 11th grade question above) ONLY IF: 
      
      High School Education Level is one of the following:

• • • Received high school diploma from US high school
    • Passed a high school equivalency test
    • Received a Certificate of California High School Proficiency;

AND

       High School Completion Date is < 10 years from the RDD (High school completion date or equivalent is less than 10 years prior to the day before the start of the Term).

AND

High School Country <hs_country> is “United States”

THEN,  display new "High School Transcript Information" section with Questions #1, #2, and #4 always. 

ELSE, DO NOT DISPLAY NEW SECTION or any section questions.

2.  Add onscreen Disclaimer text under the "High School Transcript Information" section heading above the first question (either 11th grade question or GPA) to read as follows:

"College staff use this information to provide guidance. Your responses will not affect your admission to college."
 

Add new boolean question: "Have you completed the 11th grade?

1. Data Field: <completed_eleventh_grade>
2. Question Text:  "Have you completed the 11th grade?"
3. Condition:  ONLY display this question IF 1) High School Education Level = "attending high school (or lower grade) and college at the same time" AND 2) "hs_country = United States", ELSE do not display this question before displaying Question #1: Grade Point Average. 
4. Format/Length:  Boolean
5. Type: Downloadable data field 
6. Response Options:  Yes or No
7. Data Field Values:  True or False
8. Error Validation:  Required response, else error message, "You must indicate if you have completed 11th grade or not."

Display Logic:  

• If response is "Yes" then, display Questions #1: Grade Point Average, Question #2, and Question #4.
• If response is "No" then, DO NOT display any subsequent questions in High school Transcript Information section and skip to "College Education Level" section.

NOTES:  This question is being added to differentiate between the users who should see and answer Question #1: Grade Point Average, and those who should not. If the user should not answer Question #1, then DO NOT DISPLAY any of the High School Transcript section questions to them.

Display new Y/N boolean question to ensure the concurrent enrollee has completed 11th grade, which is the earliest grade of completion requirement for displaying the new High School Transcript information section.  

Mock Screenshot:

Question #1:  Grade Point Average

1.  Add new downloadable data field and onscreen question #1: Grade Point Average" to High School Transcript Information section.

2.  Display If user meets criteria for either condition outlined in High School Transcript Information section above.

a. Data element name:  grade_point_average

b. Conditions: Display If student meets either condition listed above for the High School Transcript Information section and require a response. (see conditions above). 

c. Format Type/Length:  Varchar 5 

c. Values:  text input

d. Question Text:  "What was your unweighted high school GPA (grade point average)? Please enter a value between 0.00 and 4.00. If unsure, please estimate."

e. Additional text:  "If you are still in high school, enter your cumulative unweighted GPA as of the end of 11th grade."

f. Help Pop-Up Text: Add one new Help Pop-Up Text Box to this question. There are two (2) hyperlinks that trigger the same Help Pop-Up Box.

1. 1.  Hyperlink under:  "unweighted high school GPA" in the onscreen question text;
   2.  Hyperlink under:  "cumulative unweighted GPA" in the Additional text. 
   3. Text:  

High School Transcript: Grade Point Average

You may want to refer to your high school transcript to answer this question. 

Cumulative GPA: This is the running total of your GPA that includes all of your high school coursework. 

Unweighted GPA: Typically, transcripts will show both a weighted and unweighted GPA. The unweighted GPA has a maximum value of 4.0 and does not assign extra points or “weight” to classes that are more difficult such as AP or Honors classes.

 
g. Hover Help: Add English hover help to the <grade_point_average> input text field with the following text:

"Enter a numeric value between 0.00 and 4.00 that indicates your unweighted or cumulative unweighted high school grade point average." 

h. Field Error Validation:

1. Client side validation:  

• • • Must be a numeric value between 0.00 - 4.00, else error message, "You must enter a value between 0.00 and 4.00. If you are unsure, please estimate."

2. Server validation: 

• • • Must be a numeric value between 0.00-4.00. Ensure highest number entered is 4.00.
       

i.  Page Error Validation:

Per Steering meeting 7/12: get rid of any unnecessary error messages and just force with masking. 

• • Must not be 0.00 or higher than 4.00, use masking to enforce correct response. else error message, "You must enter a value between 0.00 and 4.00. Please try again." 

Screenshot:

NOTE- due to the time crunch getting the required changes made to this specification and with the developer, we haven't had a chance to get a better screenshot produced with all the changes on it. Missing from the image below is the disclaimer that the information will not be used in the determination of admission eligibility. Please note - this disclaimer has been added to the specifications.
 

Question #2:  Highest English Course

Data Field:  highest_english_course

Condition:  Always display If user meets either condition for High School Transcript Information listed above.

Question Text:  "What was the highest English course you took in high school?

Data values/Response Options: 

1 = 12th grade Advanced Placement (AP) English Composition or Literature
2 = 12th grade Honors English Composition or Literature
3 = 12th grade English Composition or Literature
4 = 11th grade Advanced Placement (AP) English Composition or Literature
5 = 11th grade Honors English Composition or Literature
6 = 11th grade English Composition or Literature
7 = 10th grade (or lower) English Composition or Literature
0 = None of the Above / Don’t Know 

Field Error Validation: n/a
Page Error Validation:  Required response if displayed on screen, else error message, "You must select the highest English course you took in high school or choose "None of the Above / Don't Know" from the response options." 

Branching Logic: If the student selects  "None of the Above / Don't Know" then  DO NOT show the question #3 "What grade did you receive?" Otherwise display question #3. 

Question #3:  Highest English Grade

Data Field:  highest_english_grade

Question Text: "What grade did you receive?"

Condition: 

• Display and require a response if the student selects any response OTHER THAN  "None of the Above / Don't Know" in question #2, 
• Therefore, DO NOT Display If student selects "None of the Above / Don't Know" in Question #2.  Skip to question #4.

Data Values/Response Options:

⎯ A

⎯ A-

⎯ B+

⎯ B

⎯ B-

⎯ C+

⎯ C

⎯ C-

⎯ P

⎯ D

⎯ F

⎯ NP

⎯ ON (Other Non-Passing Grade)

⎯ X = (None of the Above / Don't Know)

Page Error Validations: Required response, IF "Highest English Course Taken" is NOT "None of the Above / Don't Know", else error message, "You must select the grade you received for the highest English course taken in high school."

DISPLAY Logic:

• Always display question #4 IF the student meets criteria for either of the two conditions in "High School Transcript Information" section listed above, 
  
  

Question #4: Highest Math Course Taken

Data Field:  highest_math_course_taken

Condition: Always Display and require a response IF criteria is met for either condition listed in "High School Transcript Information" section above. 

Question Text:  "What was the highest math course you took in high school? 

Values/Response Options:

Page error validation:  Required response, else error message, "You must select the highest math course you took in high school."

Branching Logic:

• ONLY display Question #5, "What grade did you receive?" IF user selects any response OTHER THAN "None of the Above / Don't Know" in Question #4.
• If the student selects "None of the Above / Don't Know" in question #4 THEN - DO NOT DISPLAY questions #5, #6, or #7;

Question #5: Highest Math Taken Grade

"What grade did you receive?"

Data Field: highest_math_taken_grade 

Question Text:  "What grade did you receive?"

Condition: 

• Display and require a response if response to Question #4 is NOT "None of the Above / Don't Know" 
• DO NOT Display questions #5, or #6, or #7 if student selects "None of the Above / Don''t Know" in Question #4

Data Values/Response Options:

A

A-

B+

B

B-

C+

C

C-

D

F

P

NP

ON -(Other Non-Passing Grade)

X = (None of the Above / Don't Know)

Page Error Validation:  Required response, else error message, "You must select the grade you received for the highest math class taken in high school."

Branch Logic: 

• IF user selects = D, F, NP, or ON,  THEN display question #6 and require a response.  
• Else, if user selects any response higher than a P, C-, or better, DO NOT DISPLAY questions #6 or #7.

• DO NOT DISPLAY

  • If the student selects (response option) grade = A, A-, B+, B, B-, C+, C, C-, or P, THEN DO NOT display question #6 or #7.

Question #6. Highest Math Course Passed

Data Field:  highest_math_course_passed

Question Text:  "What was the highest math course that you passed with a Pass or C- or better grade in high school?"

Condition:

• Only Display and require a response if student selects response options: "D, F,  NP, or ON" in question #5. 

Data Values/Response Options:

Page error validation:  Required response, else error message, "You must select the highest math course you passed with a C- or better grade in high school?"

Question #7. Highest Math Passed Grade

Data Field:  highest_math_passed_grade

Condition: Only Display and require a response if question #6 is displayed . 

Question Text:  “What grade did you receive?”

Data Values/Response Options:

A

A-

B+

B

B-

C+

C

C-

P

X = None of the Above / Don't Know

Page Error Validation:  Required response if Question #6 is displayed,else error message, "You must select the grade you received for the highest math course you passed with a C- or better grade in high school."

Review Application Page: If college opts to implement, add "High School Transcript Information" section and all questions to the Review Application page.

The labels on the Review Application page should read:

Completed 11th Grade?
Grade Point Average
Highest English Course Taken
Highest English Course Grade
Highest Math Course Taken
Highest Math Course Taken Grade
Highest Math Course Passed
Highest Math Course Passed Grade 

Submitted Applications View PDF Page: If College opts to implement, add new data fields to the "Submitted Application PDF" for the Standard Application only.

The labels on the Submitted Application PDF page should read:

Completed 11th Grade?
Grade Point Average
Highest English Course Taken
Highest English Course Grade
Highest Math Course Taken
Highest Math Course Taken Grade
Highest Math Course Passed
Highest Math Course Passed Grade 

Download Client: Add all new data fields to Download Client.

Profile Service: Ensure all new data fields are available to the Student Profile Service (What does that look like as far as requirements?)

Data Dictionary: Update Specs: The Standard Application Data Dictionary will be updated to include a summary of the section and specific data field specifications

Supporting Documentation

DO NOT USE THIS DOCUMENT: This is the original set of questions I received from the CAI team on June 16, 2016. Don't go by this - questions and conditions have changed.