2 | Update on status of vision for success and student equity measurements metrics | | Student Equity and Achievement/Vision for Success Metrics View file |
---|
name | Student Equity and Achievement Metrics.pptx |
---|
|
Student Equity and Achievement Background: Student Equity and Achievement (SEA) SEA Reporting Requirements Executive Summary (Includes goals identified, activities to achieve those goals) Budget Information
SEA Sample Report from NOVA Set of demographic groups Four categories of metrics they can select from (Access, Readiness, Retention, Can select what is the goal, what is the gap seeking to close Report is in table format, comes out of NOVA where reporting is done Accompanied by planning information that is free form text fields, to support report table
What are the SEA Metrics Colleges have to select at least 5 different groups of traditionally underrepresented students and select a metric for each (from Student Success Metrics list) in the following categories: Access, Readiness, Retention, Completion
What are the SEA Metics - Examples Percentage of students who enroll after applying (Access, SEA) In parenthesis you can see SEA metrics Analogous component that comes from the other two sets of metrics being evaluated
Data Lake/Data Warehouse Inclusion The NOVA annual reporting includes both metrics as well as planning and activity information that is provided in the form of text The metrics are generally student counts/ratios, often disaggregated by subgroups of students, e.g., by race, gender, LGBTQ, veteran, and economically disadvantaged status The numbers behind these already exist in MIS data, as student counts and demographic flags on individual student records The text fields could be brought in to provide additional insight
Suggestions for SEA Metrics While, ideally, one would be able to recreate the NOVA report using MIS data, because of timing, and other reasons, it is suggested that the NOVA SEA report be brought in, as it might be impossible to recreate the numbers from existing MIS data.
Questions/Concerns Virginia Moran: Concern. “In the past SCA was pre populated with MIS data and then we would just respond. So, but in the future. You're saying enable us to change what was reported in state MIS?” Manos Stefanakos: “It looked like in NOVA you were able to make changes. I could be wrong about that.” Elaine Kuo: “we just input the data we receive the data file. We then and then we enter it into Nova. There was no additional manipulation, there will be some drop downs that would occur, but I don't remember us doing any manipulation” Virginia Moran: “Elaine when you entered in like your goals, but the actual baseline data. Wasn't that pre populated?” Elaine Kuo: “Yeah, there was no manipulation and then depending on what boxes you collect check that would also create other drop downs was my recollection, but there was no additional sort of like analysis of the data or inputting of the data.” Manos Stefanakos: “Okay, and I apologize that might have to do with the fact that I don't actually have an account to be able to do that work. So we're only able to see from help and other things, how that looks and so, okay” Craig Hayward: “That I can think of that may go to this, which is, I think it was possible to add a group that was not included in the derived in the data that was sent to the colleges so that may be the piece that you know can't be replicated or picked up kind of automatically from MIS” Virginia Moran: “So I agree, those kinds of things would be helpful for those of us who don't have a good handle on foster kids, for example, or who have issues with how economically disadvantaged is collected on the campus to kind of clean some of those things up. But in the future. I, I guess I hesitate to allow colleges to submit anything different from what's already pre populated via state MIS, I would prefer they clean up state MIS” Manos Stefanakos: “Absolutely agree. So if that's the case, then it sort of alters my suggestion. If it is based on completely on MIS data. Um, I don't know that we need to sort of re-import it as it comes out of Nova. The only suggestion that I would have is that it's if possible that a similar view as to that reporting table be available maybe as part of the reporting or in a table that has saved somewhere, either in Data Lake or Data Warehouse. Mark and Steve I'll let you guys really respond to that let me know what you think.”
Manos Stefanakos: “Mark, Steve. Any thoughts on maybe saving sort of the, the analogous data that would sort of populate this report other than Jasper reports or someplace else?” Mark Cohen: “I mean it sounds. It sounds like it would it would make you know it would make sense to add this as a data source that will be available, you know, trough the Jasper reporting and direct access. You know I know when we talked about it before it was, you know, there was a question as to whether this was a one off or or ongoing it how frequently updated are the data sources that make up the report?” Virginia Moran: “I believe its annual because there's most of the indicators are lagging indicators. The only thing that we do locally, at least for VVC is term the persistence one. But we are required report annually on this thing and I don't think they updated any more frequently than that, honestly, they can't even the term data. Yeah.” This is something that should be on Data Source prioritization list
Dulce Delgadillo (She/her): “Are we saying that this data set would only have desegregation for metrics that are associated with student equity? Versus all of the other initiatives so SSM and we look at adult ed because some of those are also presented in a desegregated method. So I'm just a little curious on you know if the overlap. And when we say looking at SEA metrics are we saying that we are going to produce that the database would be able to produce a report that would list all of the SEA metrics with the desegregation that is intended that the state has told us to look at, because that also shifts right?” Manos Stefanakos: You'll see a little bit in the next section, we're talking about the success metrics, it absolutely captures the point you're making that similar metrics are looked at in a variety of different ways for different reasons. So, most of the students success metrics are represented in the list of the SEA metrics, you're just looking at them in a slightly different cut. I think we're trying to figure out, since the data we're finding out the most of it anyway, except the groups that might not be available within the selection already exist in MIS, do we need to bring in sort of the extract of the Nova, as reported by districts colleges back into the data warehouse. I think we're leaving that way based on this conversation so it would for this purpose, this would serve just the SEA metrics and then the generic version of a MIS data. I don't know what else to call it, you would still be able to use to do different desegregations on similar metrics. So completion and who received what type of degree and what happened to them after they left by different subgroups for different groupings, even you could do with that data, but this will be specific, so that the way I looked at it was if the schools want to sort of look over time progress and how things are going. By having sort of this data set as a unique source would facilitate make the reporting a little easier.” Virginia Moran: “So I'm then going back to Dulce’s question. It sounds like they'll say, as long as local colleges have identified specific groups that we're targeting, in addition to the mandated ones or whatever that are standard, we should be able to continue to track them if the this new system is going to take all of that that we've put into SEA when we're planning. That's what you're saying, right, because any original data that we're keying in to the SCA to Nova will be picked up then into this new system.” Manos Stefanakos: “That is the recommendation, yes.” “It sounds like the first part of the question is yes, we should import this output from NOVA, specifically SEA metrics. The second question that I think Mark and Steve are interested in, is this a priority data set, and that I am unable to answer on behalf of the group or even make a suggestion. I think that's a conversation that we probably need to have. “
Mark Cohen: “To say, but based on what I'm hearing. Yeah, I think, you know, we're saying is, it should be added to the list of potential data sources and it is likely not a high priority of this time. And next time we go over the privatization exercise we could, you know, throw that into the mix and see where it ranks. But for now we should assume that it's not on the top.”
Dustin Tamashiro: “I haven't been keeping on top of like the SEA discussions recently, but, um, is there any thought of like expanding, I thought they were supposed to do like cohort tracking, which would probably be a little bit more challenging for us to be replicated locally. So, I mean, I think I might personally find it useful to have like the like SEA measures like readily available so that I can try to reproduce it if that's upcoming in the future.” Z Reisz (he/him): “Thinking about metrics in two flavors. One is like an institutional health metric, which is usually a cross section at any given term, it's how many graduates, did you have in this term. This lets you know how your institutions health is doing. So we got to keep doing those but then another one and this is kind of what I was hoping to see some of the student success metrics go was really more of this student journey cohort based tracking. Where we're really looking okay, how did this student fair across our system.” Craig Hayward: “Many of the current SEA metrics are unusual in the way they are calculated. As a field, we are waiting for cohort-based SEA metrics to drop.” Manos Stefanakos: “So then I think I'll sum up with Mark suggestion that this is a data set, we would like to include and it will be evaluated as to what level priority deserves that the next time the prioritization discussion.”
Vision for Success Metrics Vision for Success Background What are the Vision for Success Metrics? Vision for Success Commitments VFS Reporting Recommendations VFS Metrics Harmonization/improved definitions so that people know if the metric they are looking at represents what they think it does Changes to Launchboard to show the appropriate target as part of reports/charts that track VfS metrics (have not seen latest builds that are coming out soon)
Questions/Concerns Z Reisz (he/him): “Yes to harmonizing the data sets so that there's fewer small details to confuse the board members when we present this to them.”
|