Versions Compared

Old Version 1

changes.mady.by.user Former user

Saved on

compared with

New Version Current

changes.mady.by.user Former user

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Page Properties

Meeting Date:

Purpose:

Data Warehouse Advisory Group

Zoom Recording:

https://zoom.us/rec/share/w2IMbLrsaOo2zYfr7Ohawyw-9z5zkz5WEt2wNe6F23ppsEFEAC-Lg2LGXHmLXt1o.pBlGKStdvLkR6Rly 

Access Passcode: 0n$$fljU

Participants:

Alex Jackl, Barney Gomez, Bridget Herin, Craig Hayward, Crystal Hernandez, Denise Inciong, Dulce Delgadillo, Dustin Tamashiro, Elaine Kuo, Jake Kevari, Jenni Allen, Manos Stefanakos, Mark Cohen, Steve Klein, Terrence Willett

Agenda

ItemPresenter

Notes

1

Review Objectives of DW Advisory Group

  • Presenter: Mark Cohen

  • Informing the business requirements for how colleges connect to the Data Warehouse including the data accessed that support reporting, analysis, and research

CCC Data update

Mark Cohen

Data Warehouse Report Server

  • 95 colleges live with Data Warehouse report server

  • Outreach continues to bring remaining colleges onboardProviding guidance to ensure that the CCC Data project is developed in a manner consistent with the needs of the CCC IRPE community

2

CCC Data FY20/21 Roadmap Review

  • Presenter: Mark Cohen

FY20/21 CCC Data Objectives:

  • New Data sources to Data Lake & Data Warehouse

  • Update CCC Data access controls per revised CCCCO policies

  • Focus on Maintenance & Operations

    • Updates to DL/DW data sources as necessary

    • Upgrade DW Report Server

    • Technical Debt

    • Enhanced Security

CCC Data Platform in Production:

Image Added

CCC Data FY20/21 Release Overview:

Image Added

CCC Data 1.4.1 Release

  • CCC Access to Data Warehouse Report Server with access to:

    • CCC Apply Standard Application (including Non-Credit)

    • CCC Apply International Application

    • CCC Apply Fee Waiver

    • Multiple Measure Placement Service

    • LGBTQ Data & Support

  • Production: August 27th, 2020

CCC Data 2.0.0 Release

  • Provides direct Direct (ODBC/JDBC) access to the Data Warehouse

  • Deployed to Pilot 10/2/20

  • 6 Pilot Participants

    • Team/Enabling Services working w Phase 1 Pilot Colleges (2) to setup VPN  site to site connection so that the pilot testing can commence

      • 1 college configured with VPN

      • 1 college expected to be configured this week.

    • Engagement starting w Phase 2 Pilot Colleges (4)

  • To be deployed to production in Decemberto DW to include CCC access to:

    • CCC Apply Standard Application (including Non-Credit)

    • CCC Apply International Application

    • CCC Apply College Promise

    • Multiple Measure Placement Service

  • Pilot: October 10th, 2020

  • Production: January 2020

CCC Data 2.1.0 Release

  • New data sources in DW segmented by MIS code & made available to CCC’s through DW Data Warehouse Report Server (DWRS) and direct  DW direct Data Warehouse access, including:

    • Canvas (as opted-in to by individual colleges)

    • MyPath

    • COCI

    • C-ID

  • New data sources in DL & made available to CCCCO:

    • Nova

    • Launchboard

  • DWRS CVC-OEI enrollment report 

Development work has begun

  • Pilot Q2

  • Production Q3

2

Review roadmap for CCC Data for the remainder of the fiscal year

  • Pilot: FY20/21 Q3

  • Production: FY20/21 Q3

CCC Data 2.2.0 Release

  • Jaspersoft 7.X upgrade

  • C-ID data in Data Warehouse Report Server and direct Data Warehouse access

  • SSO support and password reset for DWRS

  • Technical debt which may include:

    • Support for development, testing and staging environments

    • Pipeline refactoring to AWS recommendations

  • Pilot: FY20/21 Q3

  • Production: FY20/21 Q3

CCC Data 2.3.0 Release

  • New data sources in Data Lake

    • 2-3 data sources to be identified (may include SCFF, EDD)

  • New data sources in Data Warehouse

    • 2-3 data sources to be identified (may include SCFF, EDD, or select MIS tables)

  • Update authorization and authentication structures as necessary per CCCCO requirements

  • Updates to reflect changes in data sources as necessary

  • Pilot: FY20/21 Q4

  • Production: FY20/21 Q4

Prioritizing Potential Data Sources:

Image Added

  • Continuing conversation with CO in terms of prioritizing data sources to be added to the Data Lake and Data Warehouse in this fiscal year.

CCC Data FY20/21 Roadmap:

Image Added

3

Status of CCC Data 2.0.0 Piloting activities

  • Presenter: Mark Cohen

  • We have been working with a number of colleges in pilot testing of the CCC Data 2.0 release, with both district and colleges complete a round of testing

  • One tester reported a couple of possible issues which our team is currently working to replicate and resolve.

  • Another college completed testing and did not report any issues.

  • Overall the pilot testing has been looking really good and we expect to release direct DW access to production in January.

4

Questions and Feedback

  1. Terrence Willett: I'm curious about assist.org and if there were any discussions of integration those back end data?

    • Mark Cohen: Currently not tied to the Data Lake or Data Warehouse.

    • Alex Jackl: Clear Use Case where it would be useful to have it connected, but we haven’t discussed it and do not have any clarifying or directional statements about it. Will make a note and bring it up next time discussing internally at the Chancellor’s office.

Issues/Questions Resolved

1

Issue/Question

Resolution/Answer

1

Date Issue/Question Raised:

Dustin Tamashiro: For the CCC Data 2.0 release in January, how is that going to be announced to colleges?

Date Resolved/Answered:

Mark Cohen: Prior to release we will announce to the community. We have two main communication paths right now.

  1. Messaging via email list of all IRPE leads, provided by RP group

  2. Contact points via User base, 80-90 colleges currently live on the Data Warehouse report server

Alex Jackl: Will also be coordinating w the Chancellor’s office communication office and with Vice Chancellor Gomez to coordinate how we get the data out, what we announce. what sequence, through what vehicle. Working on Communication plan, will be in coordination w CCCCO and CCCTC.

Recommendation by Dulce Delgadillo: Disseminate these processes to include communication to district/college IT departments

2

Date Issue/Question Raised:

Dustin Tamashiro: 2.2 is the release date, Q3 or Q4?

Date Resolved/Answered

:

Mark Cohen: Intent to release in Q3

3

Date Issue/Question Raised:

Craig Hayward: Mark, did you cover what "pipeline refactoring" entails?

  • Pipeline refactoring, scope under CCC Data 2.2.0 Release

Date Resolved/Answered:

Mark Cohen: Pipeline refactoring is optimization to some of the data pipelines that we are using to connect data sources to the Data Lake. There are some technologies that we were using that Amazon is phasing out and is recommending to help develop best practices around leveraging different technology there. That's something that our development team has been working with AWS on identifying those best practices and we are reserving time in our schedule in the 2.2 release so that we can complete this work. This should not impact users in the data warehouse, as it modifies how we are connecting to the data sources from the data sources in the Data Lake.

Issues/Questions Needing Resolution

Resolved/Answered

Issue/Question

Resolution/Answer

1

Date

Owner

1

Issue/Question Raised:

What do analytics indicate about CO MIS usage with regard to the data mart?

  • Alex Jackl will work with Todd Hoig to get answer to this question, will share response w Mark and Advisory group.

  • Per Alex, CO has been running some page web page analytics against people accessing data mart and so we might have some data from that.

  • Alex will share responses with Mark so that he can share with Advisory group.

Date Resolved/Answered:

Owner: Alex Jackl

2

Date Issue/Question Raised:

Should vision for success and student equity measurements metrics to be included?

  • Manos Stefanakos will look into it and report back to the group on whether it's something that will be published again, or what the formula is in terms of how it is produced

Date Resolved/Answered:

Owner: Manos Stefanakos

Action Items/Next Steps

Item

NotesOwner

Date Action Item Raised:

Date Action Item Resolved:

  •  Mark Cohen In addition to documentation, look into creating a Webinar for the group

Mark CohenDate Action Item Raised:

Date Action Item Resolved:

  •  Mark Cohen Prepare a deeper dive into the development priorities for this year and how they intersect with the Advisory Group

Mark CohenCompleted in December meeting.