Review Objectives of DW Advisory Group

• Presenter: Mark Cohen

• Informing the business requirements for how colleges connect to the Data Warehouse including the data accessed that support reporting, analysis, and research

• Providing guidance to ensure that the CCC Data project is developed in a manner consistent with the needs of the CCC IRPE community

CCC Data FY20/21 Roadmap Review

• Presenter: Mark Cohen

FY20/21 CCC Data Objectives:

• New Data sources to Data Lake & Data Warehouse

• Update CCC Data access controls per revised CCCCO policies

• Focus on Maintenance & Operations

  • Updates to DL/DW data sources as necessary

  • Upgrade DW Report Server

  • Technical Debt

  • Enhanced Security

CCC Data Platform in Production:

Open

CCC Data FY20/21 Release Overview:

Open

CCC Data 1.4.1 Release

• CCC Access to Data Warehouse Report Server with access to:

  • CCC Apply Standard Application (including Non-Credit)

  • CCC Apply International Application

  • CCC Apply Fee Waiver

  • Multiple Measure Placement Service

  • LGBTQ Data & Support

• Production: August 27th, 2020

CCC Data 2.0.0 Release

• Direct (ODBC/JDBC) access to DW to include CCC access to:

  • CCC Apply Standard Application (including Non-Credit)

  • CCC Apply International Application

  • CCC Apply College Promise

  • Multiple Measure Placement Service

• Pilot: October 10th, 2020

• Production: January 2020

CCC Data 2.1.0 Release

• New data sources in Data Warehouse Report Server (DWRS) and direct Data Warehouse access:

  • Canvas (as opted-in to by individual colleges)

  • MyPath

  • COCI

• New data sources in DL & made available to CCCCO:

  • Nova

  • Launchboard

• DWRS CVC-OEI enrollment report 

• Pilot: FY20/21 Q3

• Production: FY20/21 Q3

CCC Data 2.2.0 Release

• Jaspersoft 7.X upgrade

• C-ID data in Data Warehouse Report Server and direct Data Warehouse access

• SSO support and password reset for DWRS

• Technical debt which may include:

  • Support for development, testing and staging environments

  • Pipeline refactoring to AWS recommendations

• Pilot: FY20/21 Q3

• Production: FY20/21 Q3

CCC Data 2.3.0 Release

• New data sources in Data Lake

  • 2-3 data sources to be identified (may include SCFF, EDD)

• New data sources in Data Warehouse

  • 2-3 data sources to be identified (may include SCFF, EDD, or select MIS tables)

• Update authorization and authentication structures as necessary per CCCCO requirements

• Updates to reflect changes in data sources as necessary

• Pilot: FY20/21 Q4

• Production: FY20/21 Q4

Prioritizing Potential Data Sources:

• Continuing conversation with CO in terms of prioritizing data sources to be added to the Data Lake and Data Warehouse in this fiscal year.

CCC Data FY20/21 Roadmap:

Status of CCC Data 2.0.0 Piloting activities

• Presenter: Mark Cohen

• We have been working with a number of colleges in pilot testing of the CCC Data 2.0 release, with both district and colleges complete a round of testing

• One tester reported a couple of possible issues which our team is currently working to replicate and resolve.

• Another college completed testing and did not report any issues.

• Overall the pilot testing has been looking really good and we expect to release direct DW access to production in January.

Questions and Feedback

1. Terrence Willett: I'm curious about assist.org and if there were any discussions of integration those back end data?

   • Mark Cohen: Currently not tied to the Data Lake or Data Warehouse.

   • Alex Jackl: Clear Use Case where it would be useful to have it connected, but we haven’t discussed it and do not have any clarifying or directional statements about it. Will make a note and bring it up next time discussing internally at the Chancellor’s office.

Date Issue/Question Raised: Dec 14, 2020

Dustin Tamashiro: For the CCC Data 2.0 release in January, how is that going to be announced to colleges?

Date Resolved/Answered: Dec 14, 2020

Mark Cohen: Prior to release we will announce to the community. We have two main communication paths right now.

1. Messaging via email list of all IRPE leads, provided by RP group

2. Contact points via User base, 80-90 colleges currently live on the Data Warehouse report server

Alex Jackl: Will also be coordinating w the Chancellor’s office communication office and with Vice Chancellor Gomez to coordinate how we get the data out, what we announce. what sequence, through what vehicle. Working on Communication plan, will be in coordination w CCCCO and CCCTC.

Recommendation by Dulce Delgadillo: Disseminate these processes to include communication to district/college IT departments

Date Issue/Question Raised: Dec 14, 2020

Dustin Tamashiro: 2.2 is the release date, Q3 or Q4?

Date Resolved/Answered: Dec 14, 2020

Mark Cohen: Intent to release in Q3

Date Issue/Question Raised: Dec 14, 2020

Craig Hayward: Mark, did you cover what "pipeline refactoring" entails?

• Pipeline refactoring, scope under CCC Data 2.2.0 Release

Date Resolved/Answered: Dec 14, 2020

Mark Cohen: Pipeline refactoring is optimization to some of the data pipelines that we are using to connect data sources to the Data Lake. There are some technologies that we were using that Amazon is phasing out and is recommending to help develop best practices around leveraging different technology there. That's something that our development team has been working with AWS on identifying those best practices and we are reserving time in our schedule in the 2.2 release so that we can complete this work. This should not impact users in the data warehouse, as it modifies how we are connecting to the data sources from the data sources in the Data Lake.

Date Issue/Question Raised: Sep 14, 2020

What do analytics indicate about CO MIS usage with regard to the data mart?

• Alex Jackl will work with Todd Hoig to get answer to this question, will share response w Mark and Advisory group.

• Per Alex, CO has been running some page web page analytics against people accessing data mart and so we might have some data from that.

• Alex will share responses with Mark so that he can share with Advisory group.

Date Resolved/Answered:

Owner: Alex Jackl

Date Issue/Question Raised: Oct 12, 2020

Should vision for success and student equity measurements metrics to be included?

• Manos Stefanakos will look into it and report back to the group on whether it's something that will be published again, or what the formula is in terms of how it is produced

Date Resolved/Answered:

Owner: Manos Stefanakos

Date Action Item Raised: Oct 12, 2020

Date Action Item Resolved:

Date Action Item Raised: Nov 9, 2020

Date Action Item Resolved: Dec 14, 2020

Completed in December meeting.