|
EVALUATION / FITNESS CHECK ROADMAP |
|
|
Roadmaps aim to inform citizens and stakeholders about the Commission's plans in order to allow them to provide feedback on the intended initiative and to participate effectively in future consultation activities. Citizens and stakeholders are in particular invited to provide views on the Commission's understanding of the problem and possible solutions and to make available any relevant information that they may have, including on possible impacts of the different options. |
|
|
Title of the evaluation/FC |
Ex-Post evaluation of the 2018 European Capitals of Culture (Leeuwarden and Valetta) |
|
Lead DG – responsible unit – AP Number |
DG EAC – Unit D2 |
|
Indicative Planning (planned start date and completion date) |
Start date: Q3 2018 Completion date: Q4 2019 |
|
Additional Information |
https://ec.europa.eu/programmes/creative-europe/actions/capitals-culture_en |
|
A. Context, Purpose and Scope of the evaluation |
|
Context [max 15 lines] |
|
The European Capital of Culture (ECOC) Action is a title awarded by the Council of the European Union to two cities in two Member States each year according to an established calendar. The Action is regulated by a Decision of the European Parliament and the Council (1622/2006/EC) that details its objectives as well as the selection and monitoring procedures. The overall aim of the action is to highlight the richness and diversity of European cultures and the features they share, as well as to promote greater mutual understanding between European citizens. Under Decision 1622/2006/EC, Malta and the Netherlands were the two Member States entitled to host a European Capital of Culture in 2018. Valetta (Malta) and Leeuwarden (the Netherlands) were ultimately designated as the two ECOC 2018, in May 2013 and May 2014 respectively. Article 12 of Decision 1622/2006/EC of the European Parliament and of the Council lays down the obligation to ensure "the external and independent evaluation of the results of the European Capital of Culture event of the previous year". The Commission is obliged to present a report on that evaluation by the end of the year following the event – in this case, by end 2019. |
|
Purpose and Scope [max 15 lines] |
|
The evaluation shall cover the activities run by the two ECOC 2018. It aims at: i) analysing and understanding how the two ECOC 2018 contributed to the objectives of the ECOC Action, whether they have broadly achieved their objectives and whether implementation has proceeded in line with their application; ii) contributing to reinforcing the existing evidence base on the ability of the Action to produce cultural, social and economic impact; and iii) drawing lessons from the implementation of the two ECOC 2018 that may be useful for future ECOC or cities wishing to bid for the ECOC title. The hierarchy of objectives is presented in Annex 1. The evaluation should cover the activities carried out by the two ECOC 2018 during the period from their nomination to the end of the delivery year. It should assess the relevance, effectiveness and efficiency of the ECOC 2018. It will also examine the overall coherence and EU added value of the Action. This evaluation is not meant to lead to any change in the regulation governing the ECOC Action. Indeed those rules were changed in 2014 on the basis of an ad-hoc interim evaluation of the selection and monitoring procedures of European Capitals of Culture, but the new rules only apply in the case of cities which are designated as ECOC for the years from 2020 to 2033. It will therefore not be possible to use the outcomes of the evaluation of the two ECOC 2018 to draw conclusions on the new legal basis as this new Decision doesn't apply to these two ECOC title-holders. |
|
B. Better Regulation |
|
Consultation strategy [max 10 lines] |
|
Consultations will be carried out among the cultural operators, key stakeholders and implementation teams of the two 2018 ECOC. The consultations will include personal and phone interviews and on-line consultations with stakeholders and general population in the concerned cities. The interviews with the implementation teams should start in the last quarter of 2018 and wider consultations will be carried out in the first quarter of 2019. A public consultation at European level is not foreseen as the Action is considered as a local action and international participation is scattered within and outside Europe, and difficult to reach. Furthermore, a wider evaluation exercise will be carried out at a later stage, with the objective to establish long-term impacts of the initiative as foreseen under Article 16 of Decision 445/2014/EU which governs the ECOC Action for the titles 2020-2033. The first evaluation of this kind shall be finalised by 31 December 2024. A public consultation will be carried out in this framework in 2023-2024 to gather widest possible views. |
|
Data collection and methodology [max 10 lines] |
|
In order for results to be comparable, the methodology for this evaluation shall follow the approach for evidence gathering and analysis adopted in previous assessments of the Action 1 . The evaluation will be grounded in two types of data and respective sources: -Primary data will include data collected during fieldwork or provided by each ECOC such as interviews, online questionnaires and surveys; interviews in particular will seek to gain a variety of perspectives on each ECOC, including those of the management teams, decision-makers at local and national levels, key cultural operators, a range of partners involved in the delivery of the programme and a sample of organisations either leading or participating in the actual projects; -Secondary data sources will encompass EU documents, original bids and applications, internal reports linked to the application processes, monitoring and evaluation reports, studies and reports produced or commissioned by the ECOC, events programmes, promotional materials and websites, statistical data on culture and tourism and quantitative data supplied by the ECOC on finance, activities, outputs and results. |