Feature/participating student #247

coryamanda · 2024-12-03T17:59:21Z

Description

These models implement the 2030 goals for participating students that we have decided on with Karim. The logic is nuanced, so it's described in the header to each model. Essentially - 5 days of activity in a single course or unit for HS, 1 day for MS/ES. We also need a view that shows daily YOY numbers for each grade band so curriculum can easily see where they are in comparison to previous years.

Definitions: https://docs.google.com/spreadsheets/d/1gZR8yADB-kFoS_Bm6-yRb-SYl7KiNqwNxMvKNKNMeBM/edit?gid=300482234#gid=300482234

Testing story

Links

Jira ticket(s):

Testing story

https://docs.google.com/spreadsheets/d/1M6WplzPxHIVqfMJjA2XozwF_Kz1rlWbQDSm8GRWBrj8/edit?gid=0#gid=0

There have been several versions of this previously but nothing was actually released, so I'm not directly testing an existing source.

QC Check 1: Annual metrics for this measure based on the new course structure compared to the version I gave him based on the old course structure. All metrics 2019-2024 are changed <0.1%. There are some expected changes due to reallocation of some curriculum to the correct grade bands. There are also very small changes (<.05%) in the total # of students that I don't have an explanation for but am not worried about.
https://docs.google.com/spreadsheets/d/1M6WplzPxHIVqfMJjA2XozwF_Kz1rlWbQDSm8GRWBrj8/edit?gid=0#gid=0

QC Check 2:
Please make sure that all of these are valid courses or standalone units. Looks right to me but I am less practiced at this.

select course_or_unit, grade_band, count(*) from {{ref('int_participating_students')}}
group by course_or_unit, grade_band
order by count desc

course_or_unit | grade_band | count
csf | ES | 40999924
csd | MS | 5770887
csp | HS | 1234135
csc k-5 | ES | 398240
csa | HS | 43727
how-ai-works | MS | 34811
csppostap | HS | 16274
csc 6-8 | MS | 6814
foundations of cs | HS | 3082
coding-with-ai | HS | 181
exploring-gen-ai2 | HS | 99
computer-vision | HS | 84
foundations-gen-ai | HS | 68
gen-ai-customizing-pilot-v1 | HS | 66
csa-postap-se-and-computer-vision | HS | 50
exploring-gen-ai1 | HS | 32
computer-vision-pilot | HS | 11
gen-ai-customizing-pilot-v2 | HS | 8
blockchain | HS | 8
gen-ai-humanities | HS | 4

Does your change include appropriate tests on key columns?
eg.
- not_null
- unique
- `dbt_utils.unique_combination_of_columns: , ["value","value","value"...]

Note: when submitting a new model for review please make sure the following have been tested:

The model compiles (dbt build -m 'your_model')
or: has the dbt Cloud job succeeded?
The model runs (dbt run -m 'your_model')
The model produces accessible data in the DW (select 1 from 'your_model')

Privacy

1. Does this change involve the collection, use, or sharing of new Personal Data? No
2. Do these data exist in the appropriate schema(s)?
3. Does this change involve a new or changed use or sharing of existing Personal Data?
4. Consider: will this data be visible on Tableau? will this data be surfaced in a report exported from Trevor?
5. If yes to any of the above, please list the models, columns, and justification below:
i.
ii.
iii.

PR Checklist:

--> Note: if these are not all checked, the PR will be sent back.

Tests provide adequate coverage
Privacy and Security impacts have been assessed
Code adheres to style guide👀 and is DRY
Code is well-commented (**please do not leave extraneous commentary in model code, if it is for the purpose of documentation, please relocate accordingly)
Appropriate documentation has been provided (see .yml., did dbt docs generate succeed?)
New features are translatable or updates will not break up/downstream models
Relevant documentation has been added or updated (i.e. dbt docs has been updated successfully on Github Pages
Pull Request is labeled appropriately (eg. chore/, feature/, fix/)
Follow-up work items (including potential tech debt) are tracked and linked (if applicable)

… feature/participating_student

- includes changes to course-structure to map to appropriate content areas - creates 2 reporting tables. TBD if these should be views rather than fct tables

…docs to describe the fct tables.

… feature/participating_student

nataliazm99

I left some comments mostly in the base models, about grouping modular content.
Everything else looks good.

nataliazm99 · 2024-12-04T16:16:53Z

dbt/models/marts/students/dim_participating_students.sql

+Date: 11/30/24
+Purpose: Used for establishing 2030 participating student goals
+Description:
+This dim file creates a row for each student, grade band, course_or_module and then the qualifying date (1 day for ES, 5 days for HS)


One row by school year?

Yes, one for each school year - will correct that

nataliazm99 · 2024-12-04T16:18:30Z

dbt/models/marts/students/dim_participating_students.sql

+Purpose: Used for establishing 2030 participating student goals
+Description:
+This dim file creates a row for each student, grade band, course_or_module and then the qualifying date (1 day for ES, 5 days for HS)
+NOTE: int_participating_students can have multiple rows for a given student, school_year, and grade band. This file cannot - we show only their first qualifying date 


First qualifying date for a student by grade band and school year? So, a student can have one record each for different school year-grade band combinations

Yes, I will clarify that

nataliazm99 · 2024-12-04T16:19:01Z

dbt/models/marts/students/dim_participating_students.sql

+Edit log: 
+
+Description
+- Unique US students with 1+ touchpoint of ES curriculum + 40% uplift


What does the 40% uplift mean? Is this for this model or for the goals calculation?

40% is Karim's expectation of how many new students we'll get at the elementary level when we can bring in anonymous students. It's imperfect and will be replaced with actual numbers we get user-reconciled data from statsig. But in the meantime, that 40% bump is baked into both the 2024 numbers and the 2030 numbers, so I want the tables to reflect it so there's less confusion.

nataliazm99 · 2024-12-04T16:28:46Z

dbt/models/intermediate/int_participating_students.sql

+        when dssla.content_area  = 'curriculum_9_12' then 'HS'
+        else NULL
+        end grade_band
+    , case when dssla.course_name like '%special topics' then unit_name


Some of the standalone units are different units of the same topic, for example, under the general topic of Exploring Gen AI there are two units, under four scripts:
Unit 1 = foundations-gen-ai and exploring-gen-ai1
Unit 2 = customizing-llms and exploring-gen-ai2
So I would treat all special topics as one course, or classify each of them by grouping the units. Otherwise, you only count students who do five days of each specific unit.

good callout - thank you! Will work on this.

…e and simply making it 5 days of activity within the special topics for that grade band

nataliazm99

It looks good, I left some suggestions for formatting and to add the week number and day of the week to enable easier comparisons

dbt/models/reporting_views/participating_students/daily_participating_students.sql

dbt/models/reporting_views/participating_students/yearly_participating_students.sql

…ipating_students.sql Co-authored-by: Natalia Zacipa Mejia <[email protected]>

…cipating_students.sql Co-authored-by: Natalia Zacipa Mejia <[email protected]>

nataliazm99

Looks good!

coryamanda added 7 commits December 1, 2024 04:52

storing logic from previous branch

c758188

Merge branch 'main' of https://github.com/code-dot-org/analytics into…

889f9bd

… feature/participating_student

adding participating_student content

49e422e

- includes changes to course-structure to map to appropriate content areas - creates 2 reporting tables. TBD if these should be views rather than fct tables

fixing logic on course structure based on Natalia's guidance. Adding …

b1ae06f

…docs to describe the fct tables.

editing docs

ca2fdf2

making comments clearer

27c9070

editing logic to pull the new fields from dssla for these views

472568e

coryamanda requested a review from nataliazm99 December 3, 2024 18:00

Merge branch 'main' of https://github.com/code-dot-org/analytics into…

4a632c9

… feature/participating_student

nataliazm99 reviewed Dec 4, 2024

View reviewed changes

taking out the limitation on matching within a unit for the standalon…

911a9d9

…e and simply making it 5 days of activity within the special topics for that grade band

coryamanda requested a review from nataliazm99 December 5, 2024 04:45

nataliazm99 reviewed Dec 6, 2024

View reviewed changes

coryamanda and others added 9 commits December 10, 2024 22:06

Update dbt/models/reporting_views/participating_students/daily_partic…

1b39d40

…ipating_students.sql Co-authored-by: Natalia Zacipa Mejia <[email protected]>

Update dbt/models/reporting_views/participating_students/daily_partic…

d9c6031

…ipating_students.sql Co-authored-by: Natalia Zacipa Mejia <[email protected]>

Update dbt/models/reporting_views/participating_students/daily_partic…

136dc69

…ipating_students.sql Co-authored-by: Natalia Zacipa Mejia <[email protected]>

Update dbt/models/reporting_views/participating_students/yearly_parti…

198aee2

…cipating_students.sql Co-authored-by: Natalia Zacipa Mejia <[email protected]>

Update dbt/models/reporting_views/participating_students/yearly_parti…

43d6187

…cipating_students.sql Co-authored-by: Natalia Zacipa Mejia <[email protected]>

Update dbt/models/reporting_views/participating_students/yearly_parti…

2ce312c

…cipating_students.sql Co-authored-by: Natalia Zacipa Mejia <[email protected]>

Update dbt/models/reporting_views/participating_students/yearly_parti…

83fa985

…cipating_students.sql Co-authored-by: Natalia Zacipa Mejia <[email protected]>

Update dbt/models/reporting_views/participating_students/yearly_parti…

b6a9ff5

…cipating_students.sql Co-authored-by: Natalia Zacipa Mejia <[email protected]>

Update dbt/models/reporting_views/participating_students/yearly_parti…

74160c7

…cipating_students.sql Co-authored-by: Natalia Zacipa Mejia <[email protected]>

coryamanda requested a review from nataliazm99 December 11, 2024 04:37

nataliazm99 approved these changes Dec 11, 2024

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Feature/participating student #247

Feature/participating student #247

coryamanda commented Dec 3, 2024

nataliazm99 left a comment

nataliazm99 Dec 4, 2024

coryamanda Dec 4, 2024

nataliazm99 Dec 4, 2024

coryamanda Dec 4, 2024

nataliazm99 Dec 4, 2024

coryamanda Dec 4, 2024

nataliazm99 Dec 4, 2024

coryamanda Dec 4, 2024

nataliazm99 left a comment

nataliazm99 left a comment

Feature/participating student #247

Are you sure you want to change the base?

Feature/participating student #247

Conversation

coryamanda commented Dec 3, 2024

Description

Links

Testing story

Privacy

PR Checklist:

nataliazm99 left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

nataliazm99 left a comment

Choose a reason for hiding this comment

nataliazm99 left a comment

Choose a reason for hiding this comment