EVALUATION AND FITNESS CHECK (FC) ROADMAP

title of the evaluation/fc

Evaluation of the 2017 European Capitals of Culture (Aarhus and Pafos)

lead dg – responsible unit

DG EAC – Unit D2

date of this roadmap

24/05/2017

type of evaluation

Evaluation

Ex-post

planned start date

planned completion date

Q4 2017

Q4 2018

Planning calendar

http://ec.europa.eu/smart-regulation/evaluation/index_en.htm

This indicative roadmap is provided for information purposes only and is subject to change.

A. Purpose

(A.1) Purpose

The evaluation shall cover the activities run under the programmes of the two 2017 European Capitals of Culture (ECOC), Aarhus and Pafos.

The aim is to:

analyse and understand how the two 2017 ECOC contributed to the objectives of the Action, whether they have broadly achieved their objectives and whether implementation has proceeded in line with their application;

contribute to reinforcing the existing evidence base on the ability of the Action to produce cultural, social and economic impact;

draw lessons from the implementation of the two 2017 ECOC that may be useful for future ECOC or cities wishing to bid for the ECOC title.

(A.2) Justification

Article 12 of Decision 1622/2006/EC of the European Parliament and of the Council lays down the obligation to ensure "the external and independent evaluation of the results of the European Capital of Culture event of the previous year". The Commission is obliged to present a report on that evaluation by the end of the year following the event – in this case, by end 2018.

B. Content and subject of the evaluation

(B.1) Subject area

The European Capital of Culture Action is a title awarded by the Council of the European Union to two cities in two Member States each year according to an established calendar. The action is regulated by a Decision of the European Parliament and the Council (1622/2006/EC) that details the objectives of the action and the selection and monitoring procedures. Under Decision 1622/2006/EC, Denmark and Cyprus are the two Member States entitled to host a European Capital of Culture in 2017. According to the arrangements of the Decision, the competition is managed by the relevant authorities of the Member State concerned, usually the Ministry of Culture, which publishes a call for submission of applications six years before the ECOC-year. The selection is in two phases: a pre-selection phase, at the end of which a shortlist of applicant cities is drawn up, and then a final selection nine months later. A panel of thirteen independent members, six of whom appointed by the Member State concerned and the other seven by European Institutions, examines the cities' bids on the basis of the criteria laid down in the Decision.

Decision 1622/2006/EC also lays down a monitoring phase, applying from the 2010 title onwards. During this phase between the designation of cities as ECOC and the actual ECOC-year, the progress in the cities' preparations is monitored and guided by a monitoring and advisory panel, composed of seven independent experts appointed by the European Institutions.

Representatives from the cities are invited by the Commission to meet the monitoring and advisory panel on two occasions: no later than two years before the event and no later than eight months before the event. Ahead of each of these meetings, the city concerned sends a progress report. After the meeting, the panel draws up a monitoring report, which is made public 1 .

The report related to the final monitoring meeting also includes a recommendation to the Commission as to whether to award the Melina Mercouri prize. The prize is awarded provided that the designated cities have honoured the commitments made in the selection phase and acted on the recommendations of the panels during the selection and monitoring phases. This prize rewards the quality preparation of the event. It consists of 1,5 million EUR under the EU Creative Europe programme. Both 2017 ECOC were awarded the Melina Mercouri Prize in 2016.

The programme of Aarhus 2017 is articulated around the theme "Rethink", described as the idea of an ongoing European cultural laboratory to rethink the challenges of today and tomorrow through culture and art. The programme is structured around three "programme arenas": "Rethink the City", "Rethink Values" and "Rethink Creativity". "Rethink the City" will "encompass urban spaces and development, the notion of the city as an urban playground and the cultural landscapes that connect the region". "Rethink Creativity" focuses on the artistic and cultural expressions themselves. "Rethink Values" deals with "culture as ethics, morals and value systems, including social practices in the context of ethnicity, language and nationality" and will look at our core values "Democracy, Sustainability and Diversity".

The budget foreseen for the year as reported for the second monitoring meeting amounts to 57,55 million EUR. The biggest contributor will be the National Government with 30% of the total. The City will contribute 27% (15,350 million EUR) the Region 13% (7,2 million EUR) and other regional municipalities 11% (6 million EUR). Aarhus plans to raise around 2.4 million EUR from the EU.

With the title "Open Air Factory", Pafos seeks for openness in the way of thinking, acting and living. A high number of events will happen in open venues, taking advantage of the city's climate and also limiting the need for big infrastructures that might not be used afterwards. Under the motto "Linking Continents, Bridging Cultures", the programme highlights relations and connections between countries and culture, as well as between citizens, migrants and visitors. It is structured in three thematic lines: "Myth and Religion", "World Travellers" and "Stages of the Future". An additional programme runs across the three lines, "Travelling Stage". The programme will feature 140 projects, resulting from the bid-book, open calls or directly designed by the artistic team.

According to the second monitoring progress report submitted by Pafos 2017, the total budget foreseen amounts to 8.5 million EUR. 88% will come from the public sector and 12% (around 1 million EUR) from the private sector. The main contributors will be the National government with 5 million EUR and the Chamber of Commerce with 1 million EUR. The Melina Mercouri prize amounts to 14% of the total foreseen budget.

(B.2) Original objectives of the intervention

The overall aim of the action is to highlight the richness and diversity of European cultures and the features they share, as well as to promote greater mutual understanding between European citizens.

In accordance with Article 4 of Decision 1622/2006/EC, this Action should achieve the following objectives:

As regards ‘the European Dimension’, the Action shall:

•    Foster cooperation between cultural operators, artists and cities from the relevant Member States and other Member States in any cultural sector;

•    Highlight the richness of cultural diversity in Europe;

•    Bring the common aspects of European cultures to the fore.

As regards ‘City and Citizens’ the Action shall:

•    Foster the participation of the citizens living in the city and its surroundings and raise their interest as well as the interest of citizens from abroad;

•    Be sustainable and be an integral part of the long-term cultural and social development of the city.

(B.3) How the objectives were to be achieved

The figure in Annex 1 presents the hierarchy of objectives against which the 2017 ECOC shall be evaluated. This hierarchy is based principally on the 2006 Decision (as this Decision provided the legal basis for the 2015 ECOC), but is also complemented by information in the new legal basis for ECOC post 2019 (Decision 445/2014/EU) in order to reflect the evolving requirements and expectations for ECOC. Where possible, the latter will be taken into consideration.

The cultural and artistic programme of the cities, including the activities during the ramp-up years, should be the means to achieve the objectives described.

C. Scope of the evaluation/FC

(C.1) Topics covered

The evaluation should cover the activities carried out by the two 2017 ECOC – Aarhus (Denmark) and Pafos (Cyprus) – during the period 2013-2017, i.e. from their nomination to the end of the delivery year.

(C.2) Questions/issues to be examined

The evaluation should assess the relevance, effectiveness and efficiency of the 2017 ECOC. It will also examine the overall coherence and EU added value of the Action. 

The evaluation will answer the following questions:

Relevance

To what extent were the objectives of each title city relevant to the objectives of the Action? To what extent were the title cities' cultural programmes and associated activities relevant to their own objectives?

Effectiveness

To what extent were the EU-level objectives achieved? To what extent were the title cities' own objectives achieved?

Efficiency

How did the management arrangements of each title city contribute to the achievement of outputs, results and impacts? To what extent were the financial and human resources secured by each title city appropriate and proportionate?

Coherence

To what extent is the ECOC Action coherent and complementary to other EU initiatives?

EU added value

What is the EU added value of the ECOC Action?

(C.3) Other tasks

The evaluation should link, where possible, the conclusions of the evaluation to the objectives of Decision 445/2014/EU, to allow for future comparison with future ECOC. The intervention logic has been designed on these grounds. 

D. Evidence base

(D.1) Evidence from monitoring

The monitoring reports are published in the Commission's website ( http://ec.europa.eu/programmes/creative-europe/actions/capitals-culture_en.htm ). Further to this, the evaluation will use the monitoring and evaluation material produced by the two cities, to the extent to which it is available on time. Both ECOC intend to produce comprehensive evaluation spanning over several years. The results of these evaluations will be used if they are available on time. The bidbooks and the reports from the selection process, as well as promotion materials related to the two 2017 ECOC will also be used.

(D.2) Previous evaluations and other reports

Evaluation reports on previous ECOC as well as the interim evaluation of selection and monitoring procedures of the ECOC Action are available on the above-mentioned Commission's website. A study carried out for the European Parliament on "European Capitals of Culture: Success Strategies and Long-Term Effects" is also available on the same website.

(D.3) Evidence from assessing the implementation and application of legislation (complaints, infringement procedures)

N/A

(D.4) Consultation

Consultations will be carried out among the cultural operators, key stakeholders and implementation teams of the two 2017 ECOC. The consultations will include personal and phone interviews and on-line consultations with stakeholders and general population in the concerned cities. The interviews with the implementation teams should start in the last quarter of 2017 and wider consultations will be carried out in the first quarter of 2018.

Public consultations will be carried out through the ECOCs' and the cities' websites with the objective of gathering the view of the local and national population with regards to the evaluation criteria. The consultations will also address the awareness of local and national population of the action being an EU action.

A public consultation at European level will be carried out with a limited scope. The consultation will focus on the relevance, coherence and EU added value of the ECOC action. The consultation will also address the awareness of the general public of the action being an EU Action.

These consultations will be carried out in Q4 2017 and Q1 2018.

(D.5) Further evidence to be gathered

N/A



E. Other relevant information/ remarks

N/A

(1)

See Commission’s website (table at the bottom of the page): https://ec.europa.eu/programmes/creative-europe/actions/capitals-culture_en