Impact Assessment
Impact Assessment
In 2020, the London School of Economics & Political Science (LSE) India Observatory conducted a case study on the impact of Yuva’s programs on the grassroots.
Student Outcomes
– Imrovement in learning outcomes in Math, Science and other subjects by 4 times
– Improvement in overall attendance by 15%
Enrolment Outcomes
– 4.4% increase in student enrolment
Attendance Outcomes
– 3.5% increase in attendance outcomes across all grades
– 14% increase in attendance in schools with WASH interventions
– 16% increase in attendance in schools with WASH and Smart Classroom interventions
Student Enrolment
Student Attendance
Student Learning Outcomes
Outcomes: Test Results
The availability of data across four states presents an opportunity to visualise how the impact is different in each of the four states. Gujarat, Madhya Pradesh, Maharashtra and Tamil Nadu are four states with different development levels, demographics and economies. The impact that Yuva’s interventions have in the four states is also different. For instance, the increase in enrolment and attendance in the schools in Tamil Nadu is the lowest amongst all four states. This could possibly be because Tamil Nadu is a high performer in the education sector and already has high levels of enrolment. On the other hand, the increase in the scores is highest in Gujarat. This could be due to the increased expertise of the local teams in Gujarat, which is the home state for YU.
Outcomes: State-Wise Differences
The availability of data across four states presents an opportunity to visualise how the impact is different in each of the four states. Gujarat, Madhya Pradesh, Maharashtra and Tamil Nadu are four states with different development levels, demographics and economies. The impact that Yuva’s interventions have in the four states is also different. For instance, the increase in enrolment and attendance in the schools in Tamil Nadu is the lowest amongst all four states. This could possibly be because Tamil Nadu is high performer in the education sector and already has high levels of enrolment. On the other hand, the increase in the scores is highest in Gujarat. This could be due to the increased expertise of the local teams in Gujarat, which is the home state for YU.
Teacher Outcomes
1. The implementation of the Smart Classroom has a positive effect on the teachers engaged in the programme.
2. The process of training, adaptation and engagement with Yuva and the equipment provides additional skills for teachers.
3.To examine teacher outcomes, we use a theoretical framework proposed by Coe et al (2014) for the ingredients for “great” teaching
4.Using qualitative feedback from the operational team at Yuva Unstoppable, we operationalise the framework to offer insights into how the smart classroom impacts teaching.
Outcomes: Inclusion
YU operates primarily in inner-city government or government-aided schools that serve students from diverse lower socio-economic strata. Often, these schools cater to children whose parents are working in lower income-paid essential services. To get insights into the nature of the demography that these schools assist, the YU operations team labelled each of the schools in our sample with the demographics of the parents of the students in the school. Approximately 28 percent of the schools in the sample catered to children of labour workers. Farmers, masons, auto-drivers were also large groups, ranging from 7 to 9 percent of the schools. These are depicted in the wordcloud here. YU provides access to quality education to children in these inner-city schools and contributes greatly to inclusion and towards achieving SDG4.
Outcomes: Qualitative
The quantitative data shows a clear increase in all the indicators that we have measured. We look at the qualitative observations made by YU’s organisational team to understand the nature of the improvement that has occurred through the smart classroom. They make the following 8 observations about how the programme has helped teachers and students: Impact on teachers: Improved lesson delivery, through the aid of technologies. Improved attentiveness amongst kids: Using interactive multimedia makes the students more interactive. Familiarization with new tools: Exposure to new technologies help the teachers to build technological capacity. Impact on students: With the help of interactive tools, the students are able to grasp at a faster pace leading to improved learning levels. Teachers can teach through digital documents which can be shared directly with the students, eliminating the need for taking notes. Better understanding of difficult concepts: Students are able understand the difficult concepts much easily because of the multimedia content. The use of web & smart class, any topic can be explained in an engaging manner. Improved attendance in schools: Multimedia has created an interest in the students, and they therefore enjoy coming to school now.
Input
Outcome
M&E Mechanism
Building new / renovating sanitation (toilet facilities)
Improvement in condition of sanitation (toilet) facilities
Monthly visit to schools by Yuva supervisor, submitting M&E forms, troubleshooting, tracking progress through infrastructure photos
Building new / renovating drinking water facilities
Improvement in access to quality drinking water
Monthly visit to schools by Yuva supervisor, submitting M&E forms, troubleshooting, tracking progress through infrastructure photos
Building digital classrooms
Effective usage of digital classrooms
Monthly visit to schools by Yuva supervisor, submitting M&E forms, troubleshooting, tracking progress through infrastructure photos, monitoring monthly usage of digital classrooms & student attendance / absenteeism
Behaviour Change Communication (BCC) Sessions
WASH related awareness in schools & communities
Quarterly visit to schools by Yuva supervisor, tracking progress through photos, session numbers & attendance
Post project handover assistance
Community Development
Quarterly meetings with School Management Committees (SMCs) and community members
