Alex Jackl, Barney Gomez, Bridget Herin, Craig Hayward, Crystal Hernandez, Denise Inciong, Dulce Delgadillo, Dustin Tamashiro, Elaine Kuo, Jake Kevari, Jenni Allen, Manos Stefanakos, Mark Cohen, Steve Klein, Terrence Willett
Agenda
Item
Notes
1
Review Objectives of DW Advisory Group
Presenter: Mark Cohen
Informing the business requirements for how colleges connect to the Data Warehouse including the data accessed that support reporting, analysis, and research
Providing guidance to ensure that the CCC Data project is developed in a manner consistent with the needs of the CCC IRPE community
2
CCC Data FY20/21 Roadmap Review
Presenter: Mark Cohen
FY20/21 CCC Data Objectives:
New Data sources to Data Lake & Data Warehouse
Update CCC Data access controls per revised CCCCO policies
Focus on Maintenance & Operations
Updates to DL/DW data sources as necessary
Upgrade DW Report Server
Technical Debt
Enhanced Security
CCC Data Platform in Production:
CCC Data FY20/21 Release Overview:
CCC Data 1.4.1 Release
CCC Access to Data Warehouse Report Server with access to:
CCC Apply Standard Application (including Non-Credit)
CCC Apply International Application
CCC Apply Fee Waiver
Multiple Measure Placement Service
LGBTQ Data & Support
Production: August 27th, 2020
CCC Data 2.0.0 Release
Direct (ODBC/JDBC) access to DW to include CCC access to:
CCC Apply Standard Application (including Non-Credit)
CCC Apply International Application
CCC Apply College Promise
Multiple Measure Placement Service
Pilot: October 10th, 2020
Production: January 2020
CCC Data 2.1.0 Release
New data sources in Data Warehouse Report Server (DWRS) and direct Data Warehouse access:
Canvas (as opted-in to by individual colleges)
MyPath
COCI
New data sources in DL & made available to CCCCO:
Nova
Launchboard
DWRS CVC-OEI enrollment report
Pilot: FY20/21 Q3
Production: FY20/21 Q3
CCC Data 2.2.0 Release
Jaspersoft 7.X upgrade
C-ID data in Data Warehouse Report Server and direct Data Warehouse access
SSO support and password reset for DWRS
Technical debt which may include:
Support for development, testing and staging environments
Pipeline refactoring to AWS recommendations
Pilot: FY20/21 Q3
Production: FY20/21 Q3
CCC Data 2.3.0 Release
New data sources in Data Lake
2-3 data sources to be identified (may include SCFF, EDD)
New data sources in Data Warehouse
2-3 data sources to be identified (may include SCFF, EDD, or select MIS tables)
Update authorization and authentication structures as necessary per CCCCO requirements
Updates to reflect changes in data sources as necessary
Pilot: FY20/21 Q4
Production: FY20/21 Q4
Prioritizing Potential Data Sources:
Continuing conversation with CO in terms of prioritizing data sources to be added to the Data Lake and Data Warehouse in this fiscal year.
CCC Data FY20/21 Roadmap:
3
Status of CCC Data 2.0.0 Piloting activities
Presenter: Mark Cohen
We have been working with a number of colleges in pilot testing of the CCC Data 2.0 release, with both district and colleges complete a round of testing
One tester reported a couple of possible issues which our team is currently working to replicate and resolve.
Another college completed testing and did not report any issues.
Overall the pilot testing has been looking really good and we expect to release direct DW access to production in January.
4
Questions and Feedback
Terrence Willett: I'm curious about assist.org and if there were any discussions of integration those back end data?
Mark Cohen: Currently not tied to the Data Lake or Data Warehouse.
Alex Jackl: Clear Use Case where it would be useful to have it connected, but we haven’t discussed it and do not have any clarifying or directional statements about it. Will make a note and bring it up next time discussing internally at the Chancellor’s office.
Issues/Questions Resolved
Issue/Question
Resolution/Answer
1
Date Issue/Question Raised:
Dustin Tamashiro: For the CCC Data 2.0 release in January, how is that going to be announced to colleges?
Date Resolved/Answered:
Mark Cohen: Prior to release we will announce to the community. We have two main communication paths right now.
Messaging via email list of all IRPE leads, provided by RP group
Contact points via User base, 80-90 colleges currently live on the Data Warehouse report server
Alex Jackl: Will also be coordinating w the Chancellor’s office communication office and with Vice Chancellor Gomez to coordinate how we get the data out, what we announce. what sequence, through what vehicle. Working on Communication plan, will be in coordination w CCCCO and CCCTC.
Recommendation by Dulce Delgadillo: Disseminate these processes to include communication to district/college IT departments
2
Date Issue/Question Raised:
Dustin Tamashiro: 2.2 is the release date, Q3 or Q4?
Date Resolved/Answered:
Mark Cohen: Intent to release in Q3
3
Date Issue/Question Raised:
Craig Hayward: Mark, did you cover what "pipeline refactoring" entails?
Pipeline refactoring, scope under CCC Data 2.2.0 Release
Date Resolved/Answered:
Mark Cohen: Pipeline refactoring is optimization to some of the data pipelines that we are using to connect data sources to the Data Lake. There are some technologies that we were using that Amazon is phasing out and is recommending to help develop best practices around leveraging different technology there. That's something that our development team has been working with AWS on identifying those best practices and we are reserving time in our schedule in the 2.2 release so that we can complete this work. This should not impact users in the data warehouse, as it modifies how we are connecting to the data sources from the data sources in the Data Lake.
Issues/Questions Needing Resolution
Issue/Question
Resolution/Answer
1
Date Issue/Question Raised:
What do analytics indicate about CO MIS usage with regard to the data mart?
Alex Jackl will work with Todd Hoig to get answer to this question, will share response w Mark and Advisory group.
Per Alex, CO has been running some page web page analytics against people accessing data mart and so we might have some data from that.
Alex will share responses with Mark so that he can share with Advisory group.
Date Resolved/Answered:
Owner: Alex Jackl
2
Date Issue/Question Raised:
Should vision for success and student equity measurements metrics to be included?
Manos Stefanakos will look into it and report back to the group on whether it's something that will be published again, or what the formula is in terms of how it is produced
Date Resolved/Answered:
Owner: Manos Stefanakos
Action Items/Next Steps
Item
Notes
Date Action Item Raised:
Date Action Item Resolved:
Mark Cohen In addition to documentation, look into creating a Webinar for the group
Date Action Item Raised:
Date Action Item Resolved:
Mark Cohen Prepare a deeper dive into the development priorities for this year and how they intersect with the Advisory Group