Evaluation

LIDA digital storytelling workshop’s assessment

Digital Storytelling Workshops were implemented with people in situations of vulnerability and professionals/educators who work with them in the four different partner countries.

Given the complexity of the goals set for the validation process of LIDA outcomes, the methodology followed to collect evidence was mixed, with a predominantly qualitative approach, and based on different tools selected to suit best the target group considered. 

The protocols for collecting evidence from the storytelling practices were the following:

  • Focus group/reflection session with professionals/educators and vulnerable adults at the end of the digital storytelling workshop as general feedback
  • Questionnaire to professionals/educators on the incidence of storytelling activities in promoting social inclusion to be administered at the end of the digital storytelling premières
  • Consensus discussion with professionals/educators to agree on quality indicators for social inclusion practices to be carried out after the administration of the questionnaire

Focus group with adults in situations of vulnerability and professionals/educators

At the end of the digital storytelling workshops focus groups were held with the participants. Appendix II.I presents the protocol and the moderator guidelines used to carry out the focus group in different countries for the LIDA project.

This protocol, as well as the following considerations, were adapted to the particular context of each focus group and to address the answers received from participants. The main aim was to collect meaningful information while producing enough depth to allow a thorough description of common points across countries. 

Questionnaire for professionals/educators

The questionnaire (appendix II.II) was administered online at the end of the premières with professionals/educators. It collected information on gender, age, education, occupation of participants, feedback on the event, its strengths and weaknesses, the use of digital storytelling in educational practices (including willingness to be trained and to carry out a workshop, possible lack of skills and support needed), and the perceived possible impact of digital storytelling practices in their country and their specific field of work. 

Educator consensus session 

After completing the online questionnaire, facilitators showed the results of the last closed item (question 7a) on the impact of digital storytelling practices on social inclusion, pointing out and commenting on the modal result (e.g. the alternative that was mostly selected). Then, a discussion of the results was carried out in a plenary session.

The consensus session was modelled based on a simplified version of a mini-Delphi technique.

Evaluation work by the LUMSA team

Andrea Ciasca Marra talks about the evaluation work undertaken by the LUMSA team, highlighting the empowerment that arises from the process of sharing very personal stories in the context of a well-prepared and supportive environment.