Evaluation of Includance: Introduction

Evaluation of Includance: Introduction

This is you

Project Team: Dr Kerry Chappell & Dr Margo Greenwood October 2013

Executive Summary

1       INTRODUCTION

1.1       The Includance Project

Includance was a cross-border micro-project which developed and explored a partnership between an English and French approach to social inclusion via the choreographic process.  The project was built on the idea that the choreographic process and its associated creativity can contribute to the construction, development and emancipation of those participating in it.  The project promoted a Franco-British exchange for young people defined in the bid as “out of school or work” led by professional artists, supported by social workers. An academic team was also engaged across the project to evaluate the progress of the young people involved.   The Includance activity designed to achieve these objectives involved 18 young people, 10 in France and 8 in England between the ages of 16 and 25 years. In each country the young people worked for 2 hours weekly for 10 weeks with a local professional dance artist /company.  The young people also travelled to and took part in two intensive cross-border exchanges one in Brest, France and one in Plymouth, England.  Each exchange involved intensive creative work and culminated in a sharing or performance.

1.2       Evaluation approach

1.2.1 Shared French/English approach

The academic evaluation of the project centred on the first of the project objectives: to promote the social inclusion of disengaged young people.  It was carried out by an academic team one side of which was situated in France the other in England.  This report reflects the work of the English academic team

1.2.2 Creative Impact framing

The evaluation is framed by the Creative Impact Matrix.  This tool suggests 5 different important impacts of performing arts based social inclusion projects, two of which (active citizenship and embodied cultural capital) were used to frame this Includance evaluation.

1.3       English Evaluation questions

In order to evaluate the sub-elements of the first project objective, the English team broke the objective down into eight questions which make up the headings in the Findings section.

1.4       Evaluation Design & Methodology

The English team used a qualitative interpretive methodology to allow for as deep an understanding as possible of the participants’ lived experiences.

1.5       Data Collection & Analysis

Data collection took a number of forms including: beginning and end audio-recorded semi-structured interviews with the young people, interviews with adult professionals, a self- esteem scale filled in by the young people, adult professionals’ reflective logs,

young people’s reflections, researchers’ observational field notes and photographs.

Data analysis used the constant comparative method and worked for trustworthiness via adherence to the principles of credibility, transferability, dependability and confirmability.

1.6       Ethics

The evaluation was carried out following the ethical guidelines of the British Educational Research Association (2011).  Fundamentally this means that all evaluation procedures are carried out subject to voluntary informed consent where participants have the right to withdraw at any time, and the aim is for anonymity and confidentiality.

Click here to read the Findings

Evaluation of Includance: Findings

This is you

Project Team: Dr Kerry Chappell & Dr Margo Greenwood October 2013

Executive Summary

2       FINDINGS

This report has been entitled “This is you” as the findings indicated that at the heart of the project was the aim to re-engage the young people with ‘themselves’ and on many levels this was achieved in practice.

2.1 How has the young people’s ‘engagement’ changed/shifted during the project?

There was evidence within the data that the young people’s engagement had shifted in four different ways within the time frame of the project.  Over time they engaged more fully with: their own power to communicate physically and across cultures, each other/others physically and verbally, their commitment to a task, and combining/ integrating parts of themselves.  There was also evidence that for one student in particular the project had had a profound influence on the way in which she engaged in life on a day-to-day basis.  Alongside this there was evidence of less appropriate kinds of engagement perhaps triggered by the intensity of the project’s ‘creative physicality’.  This demonstrates that part of the engagement process for these young people in the longer term is to understand how to manage the highs and lows of this kind of experience.  Finally, there was evidence that the very commendable high level of engagement sustained by the young people across the project was perhaps not completely sustainable after it had finished.  This is not an entirely negative comment, as with the intensity of the project it would be surprising if all the young people were able to sustain such high level commitment beyond the life of the official project.

2.2 How has the young people’s self-image and self-expression changed/shifted during the project?

Self-image

In relation to self-image, findings show that there were shifts towards greater self-esteem. However, there was also evidence within the data at the end of the project of: continuing low self-esteem and poor body image.  Continuing low self-esteem was evidenced by the Rosenburg self-esteem scale.  All seven young people scored below 25, the number below which is considered to display very low self-esteem. Three quarters of the overall results stayed the same, showing consistency within the comparative study.  Although each young person showed a positive change somewhere within the ten questions by the end of the project, the highest score was only 22, with 31-34 being considered average self-esteem. Of the ten questions in the questionnaire, two were given lower scores by two of the seven young people by the end of the project. This may not indicate a lower self-esteem necessarily, as the qualitative data shows that the young people were becoming more self-aware and grappling with challenges never before experienced. These same young people felt that they had achieved more than they imagined at the end of the project, yet they had also gone through a process in which they had, at times, been frustrated with themselves and their previous limitations, as perhaps indicated by the lower score on these questions. 

However there were also examples of greater self-esteem with two of the young people making clear shifts in being able to recognise and appreciate who they were.

Three of the seven young people interviewed towards the end of the project were explicit in their poor body image.

Self-expression

The young people’s self-expression shifted in two ways over the duration of the project, through being present to the moment and initiating connection.  The former could particularly be seen through young people taking physical and mental ownership of their creative work.  And the latter was particularly evidenced for one young woman who shifted from shying away from interaction to herself stating that she actively sought out conversation and clearly attributing this to experiences within the project.

2.3 How has the young people’s self-confidence changed during the project?

Over the duration of the project, the young people expressed increased confidence through their creativity, connection and adventure.  The young people themselves identified that they were both becoming confident through being creative and becoming more creative as they became confident, especially the girls. Increased confidence through connection could be seen in the young people’s connection both the creative work and to other people.  Adventure also played a big part in all of the young people’s shift in confidence, but particularly the boys. The performance and the travel was a goal that was stretching them, and as they reached that goal, they sensed a shift in themselves.  For the girls, the adventure of travel and performance was also a key to their confidence shift, but they often referred to a new independence. 

2.4 How have the young people’s relationships changed/shifted during the project?

The young people’s approach to relationships had shifted in five different ways within the project.  They showed increased support for each other and an increased awareness of group dynamics; they engaged in group cohesion in a time-limited company, and experienced and overcame tensions. Some of these shifts occurred through celebration of shared project success.  Across the project there was evidence that the young people developed an understanding of what it meant to successfully be in different relationships with different people and how the dynamics of this might work.  There was a clear connection between this and the physical relationships that the young people were required to engage in during the creative dance work, although this process was not without its struggles.  Very much connected to their increased awareness of group dynamics was the development of a strong group or company cohesion.

2.5 What were the skills developed by the young people (foreign language, discovery of another culture, experience to travel)? How might they transfer in the future?

There was evidence of the development of five different kinds of skills for the young people during the project: overcoming language as a barrier, leadership, choreography, movement skills and discovery of culture.  Interestingly overcoming the language barrier meant learning to understand what the French young people were saying, even though they didn’t understand the vocabulary that was being used.   Part of developing their choreographic skills, was developing problem-solving skills, their ability to deal with the unknown and their teamwork. Interestingly, discovering culture meant opening up the young people’s horizons in terms of both new places and their home city.

2.6 How do the young people feel about their future at the end of the project?

By the official end of the project there were two main ways in which the young people felt the project had contributed to shifting their feelings about their future: that dance has a place in their life and that they have a stronger sense of direction.  This is confirmed by the fact that at least four of the young people had signed up to be part of Attik Youth Dance in the autumn of 2013.  New senses of direction included one of the young people seriously considering working towards dance training and two others becoming very clear about career choices to be a photographer and a dance movement therapist.

2.7 How has the project encouraged the construction of a social and professional project and/or the prospect of training for these young people?

There was certainly evidence that a coherent professional project had taken place.

There was also evidence from the adult data that there was a prospect of offering training for the young people with at least four of them expressing an interest in being part of Attik Youth Dance in autumn 2013, after the official end of the Includance project.  They had also earmarked the dance course at Plymouth City College as another dance avenue that some of the young people might access. There was evidence too though that the project had raised high expectations, which needed managing beyond the official end of the Includance project.

2.8 Emergent Themes

There were four main emergent themes: dealing with risk/threat, having fun!, the evaluation process as an opportunity for safe confession in interview, the role of adult practitioners.  The first two were ‘hidden threads’ which played surprisingly powerful roles within the dynamics of the project.  The third highlights an area of future learning in terms of this kind of approach to evaluation.  The fourth makes available evidence which may be useful to the adult practitioners in the project who are analysing their own practice.

Click here to read the conclusion

Evaluation of Includance: Conclusion

This is you

Project Team: Dr Kerry Chappell & Dr Margo Greenwood October 2013

Executive Summary

3       CONCLUSION

This report evaluates the English strand of the Includance project in relation to project objective 1: to promote the social inclusion of disaffected or disadvantaged (from hereon in referred to as ‘disengaged’) young people.  The evidence showed that overall all of the young people to some degree increased their engagement during the project although sometimes this increased engagement led to less appropriate behaviour.  What underlies the more positive findings around engagement might be explained through the documented shifts in self-image, self-expression and self-confidence.  The data also showed some less positive trends in terms of self-esteem and poor body-image, but this perhaps hints at the young people’s growing self-awareness, including a realisation of their previous limitations and frustrations connected to this.  One of the project’s ‘hidden threads’: dealing with risk and threat was an underlying process which could have a strong influence on the young people’s behaviour at key points in the project.  This is worth attention in future projects of this nature.

It is important to note however, that it is too much to expect a project of this short a duration to fully shift the negative behaviour, self-esteem and self-image issues of such a group of disengaged young people.  This is not necessarily a criticism of the project but a recognition that significant positive shifts in projects like this are likely to be for some and not all the young people.

The evaluation findings also provided evidence of shifts in the young people’s ability to engage better in relationships, and that they developed skills in overcoming the language barrier, leadership, choreography and movement skills, and discovered both their own and new cultures.  There was also good evidence that for most of the young people they had more positive aspirations for their future, which they often explicitly connected to their involvement in the Includance project.

Finally, it is important to bring the findings back to the two selected impacts from the Creative Impact framework: Active Citizenship and Embodied Cultural Capital.  The first impact is about whether or not the young people shifted from being passive consumers of culture to active participants and creators.  It is hopefully clear from the conclusions above that the young people engaged much more than they would have done usually, both with cultural activities and in being creators themselves.  As above it is difficult to make claims about this impact beyond the confines of the project.  However, the evidence above regarding future aspirations shows that at least at this point the young people have stronger senses of direction as to their future pathways and societal contributions.

The second Creative Impact is about whether the young people are able to take more risks and break out of their usual patterns of behaviour to do something new and different for them, as well as enhancing their creativity. Again the above conclusions show that the young people were impacted in this way to some extent.  Their future aspirations at least show them able to break out of their usual patterns of thought about their control of their future and what it might hold.  The evidence also certainly shows that, not without struggle and tensions, did they develop their creativity within the project and so show greater self-expression and engagement. 

Drawing across all of the above to comment lastly on the success of the project in “promoting the social inclusion of ‘disengaged’ young people”, the English Includance strand went beyond ‘promotion’ and actively re-engaged a vulnerable group of young people with themselves and each other.  The evidence shows that this was certainly not easy; at times it was challenging and uncomfortable (physically and mentally).  Although this evaluation is not in a position to make causal claims about these young people’s futures, the words of two of the young people point towards key lessons about ‘re-engaging’ that they have learned and will take with them on their journeys:

“I’ve learnt that you get more out of things depending on how much you put in”

“It’s making me go out of my comfort zone…‘cos I’d never normally do it. So doing that is making me try new things”.

To read the full report, please email Emma for a copy

 

Event Categories