MONITORING and EVALUATION
The project coordinator will be the person directly responsible for the correct course of action and the quality of project results. Each school coordinator will monitor the progress of the project by conducting a systematic evaluation of the activities and implement the lessons learned from monitoring and evaluation. The evaluation process will involve all participants of the project, according to the division of tasks and responsibilities for a particular stage.
The project evaluation will be carried out in stages:
Evaluation before – will begin in September 2015 by conducting a questionnaire including all participants (teachers and students) in order to see their expectations from the international cooperation Erasmus + Project “Reach the Sky” (questionnaire, “What do I expect from participation in the project? …”). Analysis of the results of the questionnaire will be presented to the team of teachers at the first project management meeting in Poland to be able to respond to the needs of the participants.
Evaluation during the project – will be conducted in all partner schools after each international meeting, after holding a workshop at the end of the first and second year of the project.
Evaluation will be conducted to measure:
1. Gained knowledge of the project participants,
• A survey of the knowledge of the partner countries will be conducted among students of all schools in the beginning of the project, and then will be repeated at the end of implementation,
• The level of knowledge of the participants on the topic of the project will be tested through quizzes, puzzles themed crossword puzzles, educational games – which will be carried out after a scheduled activity, but not less frequently than once a month,
• Thematic competitions will be organized to promote our project and to motivate our students to take part in the activities and improve their communication skills according to schedule
2. The increase in language competence,
• Sets of exercises will be done to test communication in English before every trip to the international meeting;
3. The quality of partnership meetings,
• The relationship of students with international meetings in the form of multimedia presentations;
• A written report on the implementation of teacher planned activities -after each journey abroad,
4. Progress in the project and the involvement of partner schools:
• The list of attendance of students in classes, workshops, meetings summarizing the work,
• On-line surveys for all project participants after completion of the various stages of the schedule;
• Number of visits to the website project – monitored every week.
• The number of users on the social networking group Facebook,
• The quality of the results
• Partial oral report of the project prepared by teachers – at the weekly meetings of the Erasmus Team at each school;
• teacher reports on the work and the intended results which will be prepared every six months,
• Individual interviews with project participants, parents, students, teachers
• The number of people watching the exhibition gallery, participating in organized events and their opinions,
Conclusions resulting from the monitoring and evaluation will be analyzed on an ongoing basis and, if necessary, modifications will be introduced.
To evaluate the achievement of the objectives and results of the project coordinator of the school will apply qualitative methods:
1. The in-depth individual interviews:
• With the participants of the international project meetings;
• Student team leaders involved in the preparation of certain products;
• With respective teachers for tasks such as: conducting web site design, maintenance of communication between the project partners, preparing international meetings, organizing workshops, field work;
2. “Letter to yourself” – written by the students before leaving for a meeting of partner schools;
3. Direct communication of participants in the international teams by using English,
4. The focus group interviews (focus groups);
• Teams of students will be formed to interact and influence each other by discussing particular topics of astronomy
• In order to plan measures to publicize the results of the project among the local community;
• To get prepared for the international project meetings;
5. Analysis of documents – written reports of students and teachers, minutes of meetings;
6. Evaluation of work, photographs, posters, presentations by students, teachers, parents, local community;
7. The interactive group methods (“Review in three words,” “mobile disk”, “applause”).
Evaluation after the completion of the project – will be carried out in June 2017 in all partner schools – will bring together project participants (questionnaire “Did my expectations come true?”). The results of the final evaluation will allow for a summary of the implementation of the objectives and determine the level of achievement of results, and will serve to initiate new projects.
The quality of the project will be ensured by including:
• Headmasters from partner schools
• Teachers of geography, physics and mathematics, with many years of experience in professional work, teachers, coordinating school (I LO im. M. Kromer in Gorlitz) and Slovenian schools for some years close cooperation with scientific institutions – educational participation in courses and trainings astronomy and science issues;
• English teachers from Turkish schools– experienced in working with young people, introducing specialized vocabulary in classes with extended hours of English language teaching,
• Teachers from Romania who are specialists in leading ICT classes,
• Teachers of humanities – responsible for cultural and artistic part of the project;
• Academics and scientific institutions
During the project implementation quantitative indicators will be applied:
• The participation of at least 120 students in 12 classes which will be had throughout the year in each partner school (attendance to classes will be monitored by the attendance list);
• 10 students, at least, from each class will take part in fieldwork, observations, and extracurricular activities;
• At least 2 observations of objects on the celestial sphere will be carried out;
• 500 educational and informational leaflets will be distributed among the participants of the events organized during the project, the Education Fair (open days), meetings with students of other schools in the local community;
• The achievement of the students in the group will be above 60% in the tests containing questions on the topic of the project;
• 70% of students participating in the project will confirm the increasing motivation to learn English;
• Language skills before and after departure will be defined on a scale of 1-6 and it will be aimed to raise the percentage at least 1 degree,
• Every student participating directly in the project will produce at least 1 product (image, multimedia presentation of research results, article, etc.).
In our application form, we had stated that the evaluation process would involve all participants of the project according to the division of tasks and responsibilities for a particular stage. Therefore, the project evaluation was carried out in stages:
Evaluation before: Evaluation process was conducted by the school project’s coordinator and by the headmaster of the school. We conducted a questionnaire including all participants to see their expectations from the project. Therefore, in September 2015, we conducted a questionnaire for the students who are involved in our Erasmus + Project “Reach the Sky” to see their motivation to participate in the project including questions such as “Why do you want to participate in this Project, Have you made any researches about our partner countries? Do you think you will face any difficulties during the visits to partner country? How do you think your Erasmus+ experience will contribute to your academic and personal development, What are the main benefits of the Project?.” We shared the analysis of the results of the questionnaire at the first meeting held in Poland to be able to respond to the needs of the participants.
Evaluation during the project: We asked our students to write their observations about the activities in partner countries during the project meetings on a form we prepared before so that we could see whether the meetings fulfilled their expectations. We used evaluation questionnaires after each meeting to evaluate its strengths and weaknesses, lessons learned and best practices and we organized video conferences to talk about the quality, effectiveness and efficiency of the activities implemented by our organizations before and after each meeting. We used quizzes, puzzles, themed crossword puzzles, educational games to monitor the level of knowledge of the participants on the topic of our project and surveys to see the level of knowledge of the participants on partner countries. To evaluate the achievement of the objectives and the results, we applied qualitative methods such as individual interviews, workshops, letter to yourself, focus group interviews, film reports, presentations, posters, photographs. We also used quantitative indicators. For instance, we carried out at least 2 observations of objects on the celestial sphere, every student created at least one product. We distributed 500 educational leaflets about our project. We organized thematic competitions to promote our project and motivate our students to take part in the activities and improve their communication skills. We monitored our students’ relationship with the students from partner countries via Facebook and multimedia presentations. Both our teachers and students taking part in project meetings wrote articles regarding their experiences after each meeting. We monitored the number of visits to our project website and the number of users on our social networking group Facebook. We organized weekly meetings to give oral report about our project and share our ideas to promote it. In order to get their impressions about our project, project participants were interviewed. We also used e-mail correspondence, telephone calls, Skype, Social networking site Facebook to monitor the progress and timing of the works and to inform other members about any current issues and possible amendment. In order to see the impact of our project on parents, teachers and authorities, we made discussions.
Finally we prepared online quizzes and questionnaires to be able to see participants’ views and experiences in the project and if we could reach the targets in our application form. This was the evaluation after the completion of the project part and it allowed us for a summary of the implementation of the objectives and determined the level of achievement of our project, which we believe that it is really high.
The quality of our project was also evaluated through the excellent feedback received after our participation to the different school activities: ICT teachers meeting, Education’s Fair and dissemination sessions we had in a couple of Slovenian schools.
Regarding the budget management, we didn’t have any problems since we planned each visit very carefully in order to be able to use the money more effectively. Prior to the implementation of our project, we established the principles of cooperation regarding the accommodation of teachers and students during project meetings. So, as we had planned before, the students stayed with the host families and the teachers were assisted by host teachers to be able to arrange the most suitable accommodation. This gave us a chance to manage the allocated budget more effectively and efficiently. Each month, we held a meeting with our school headmaster to conduct records of expenditures and the accuracy of financial records. The school principal was also given a financial monitoring report on a regular basis.