Informing the business requirements for how colleges connect to the Data Warehouse including the data accessed that support reporting, analysis, and research
Providing guidance to ensure that the CCC Data project is developed in a manner consistent with the needs of the CCC IRPE community
2
CCC Data FY20/21 Roadmap Review
Presenter: Mark Cohen
FY20/21 CCC Data Objectives:
New Data sources to Data Lake & Data Warehouse
Update CCC Data access controls per revised CCCCO policies
Focus on Maintenance & Operations
Updates to DL/DW data sources as necessary
Upgrade DW Report Server
Technical Debt
Enhanced Security
CCC Data Platform in Production:
CCC Data FY20/21 Release Overview:
CCC Data 1.4.1 Release
CCC Access to Data Warehouse Report Server with access to:
CCC Apply Standard Application (including Non-Credit)
CCC Apply International Application
CCC Apply Fee Waiver
Multiple Measure Placement Service
LGBTQ Data & Support
Production: August 27th, 2020
CCC Data 2.0.0 Release
Direct (ODBC/JDBC) access to DW to include CCC access to:
CCC Apply Standard Application (including Non-Credit)
CCC Apply International Application
CCC Apply College Promise
Multiple Measure Placement Service
Pilot: October 10th, 2020
Production: January 2020
CCC Data 2.1.0 Release
New data sources in Data Warehouse Report Server (DWRS) and direct Data Warehouse access:
Canvas (as opted-in to by individual colleges)
MyPath
COCI
New data sources in DL & made available to CCCCO:
Nova
Launchboard
DWRS CVC-OEI enrollment report
Pilot: FY20/21 Q3
Production: FY20/21 Q3
CCC Data 2.2.0 Release
Jaspersoft 7.X upgrade
C-ID data in Data Warehouse Report Server and direct Data Warehouse access
SSO support and password reset for DWRS
Technical debt which may include:
Support for development, testing and staging environments
Pipeline refactoring to AWS recommendations
Pilot: FY20/21 Q3
Production: FY20/21 Q3
CCC Data 2.3.0 Release
New data sources in Data Lake
2-3 data sources to be identified (may include SCFF, EDD)
New data sources in Data Warehouse
2-3 data sources to be identified (may include SCFF, EDD, or select MIS tables)
Update authorization and authentication structures as necessary per CCCCO requirements
Updates to reflect changes in data sources as necessary
Pilot: FY20/21 Q4
Production: FY20/21 Q4
Prioritizing Potential Data Sources:
Continuing conversation with CO in terms of looking how we may be able to bring in some of the prioritized data sources
CCC Data FY20/21 Roadmap:
3
Status of CCC Data 2.0.0 Piloting activities
Presenter: Mark Cohen
We've been working with a number of colleges on testing We've recently had both a district and a college complete a round of testing
There were a couple of possible issues or questions identified that our team is currently working through
With one of our testers they didn't find a any issues with with some rigorous testing, other college did find a couple of areas where where they encountered some consistencies
Our QA team is currently digging into that
Overall the pilot testing has been looking really good
4
Questions and Feedback
Terrence Willett: I'm curious about assist.org and if there were any discussions of integration those back end data?
Mark Cohen: Currently not tied to the Data Lake or Data Warehouse.
Alex Jackl: Clear Use Case where it would be useful to have it connect4ed, but we haven’t discussed it and do not have any clarifying or directional statements about it. Will make a note and bring it up next time discussing internally at the Chancellor’s office.
Issues/Questions Resolved
Issue/Question
Resolution/Answer
1
Date Issue/Question Raised:
Dustin Tamashiro: For the CCC Data 2.0 release in January, how is that going to be announced to colleges?
Date Resolved/Answered:
Mark Cohen: Prior to release we will announce to the community. We have two main communication paths right now.
Messaging via email list of all IRPE leads, provided by RP group
Contact points via User base, 80-90 colleges currently live on the Data Warehouse report server
Alex Jackl: Will also be coordinating w the Chancellor’s office communication office and with Vice Chancellor Gomez to coordinate how we get the data out, what we announce. what sequence, through what vehicle. Working on Communication plan, will be in coordination w CCCCO and CCCTC.
Recommendation by Dulce Delgadillo: Disseminate these processes to district/college IT departments
2
Date Issue/Question Raised:
Dustin Tamashiro: 2.2 is the release date, Q3 or Q4?
Date Resolved/Answered:
Mark Cohen: Intent to release Q3 as well
3
Date Issue/Question Raised:
Craig Hayward: Mark, did you cover what "pipeline refactoring" entails?
Pipeline refactoring, scope under CCC Data 2.2.0 Release
Date Resolved/Answered:
Mark Cohen: Pipeline refactoring is optimization to some of the data pipelines that we are using to connect data sources to the Data Lake. There are some technologies that we were using that Amazon is phasing out and is recommending to help develop best practices around leveraging different technology there. That's something that our development team has been working with AWS on identifying those best practices and we are reserving some time in our schedule in that release so that we can do some of that we work. It’s something that shouldn't impact the users in the data warehouse at all. Just changing how we're connecting to the data sources from the data sources in the Data Lake.
Issues/Questions Needing Resolution
Issue/Question
Resolution/Answer
1
Date Issue/Question Raised:
What do analytics indicate about CO MIS usage with regard to the data mart?
Alex Jackl will work with Todd Hoig to get answer to this question, will share response w Mark and Advisory group.
Per Alex, CO has been running some page web page analytics against people accessing data mart and so we might have some data from that.
Alex will share responses with Mark so that he can share with Advisory group.
Date Resolved/Answered:
Owner: Alex Jackl
2
Date Issue/Question Raised:
Should vision for success and student equity measurements metrics to be included?
Manos Stefanakos will look into it and report back to the group on whether it's something that will be published again, or what the formula is in terms of how it is produced
Date Resolved/Answered:
Owner: Manos Stefanakos
Action Items/Next Steps
Item
Notes
Date Action Item Raised:
Date Action Item Resolved:
Mark Cohen In addition to documentation, look into creating a Webinar for the group
Date Action Item Raised:
Date Action Item Resolved:
Mark Cohen Prepare a deeper dive into the development priorities for this year and how they intersect with the Advisory Group
