CM Gaps Explorer

In order to assure that the evaluators are present for all relevant events / injects.

• to ensure the key indicators and planning are met
• the challenge is how we are implementing exercise that have an effect on how the evaluation of the exercise will be
• to narrow down the objective to SMART measuring points that can be evaluated
• to support any logistical and organisational challenges
• to improve impact of evaluation
• often not taken seriously
• to emphasise the learning
• Evaluation starts with identifiying the objectives of the exercise.
• to emphasise the fact that exercises are to improve and not to blame

Ressursihalduse puudujäägid (personal, riistvara jne) mitme huvirühmaga pikaajaliste reageerimisoperatsioonide ajal.

Provide a sound legal basis for various aspects of Crisis Management in all parts of the CM cycle.

Arusaam tulekahju reageerimisest põlevmaterjali, ilmastiku ja topograafia teguritele, sh teguritele nagu näiteks leviku kiirus ja intensiivsus, võivad aidata juba süttinud tulekahjude kustutamisel ja uute tulekahjude ennetamisel.

The evaluator has to gather a lot of information, later analyse it and produce (first impression) reports, which is a difficult task that could be made easier by using modern tools such as applications on a phone or a tablet.

The evaluation of an EU-funded civil protection exercise is not limited to the evaluation of the exercise itself but regularly also to the entire project cycle. This includes the formative evaluation of the phases of exercise planning and exercise preparation in order to be able to identify fields of improvement already in an early phase of the project.

For proper evaluation on has to understand what is going on and be able to follow the process (and changes of the processes) -> e.g. critical points in pathways (why is this and this – not – happening > because something was being brought into perspective)

Sometimes evaluators are perceived as a kind of an "enemy" (might be a strogn word), as they are looking on what participants are doing = stressfull, feeling of being controlled, being observed. It needs to be understood, that the role is not to judge/classify the participants, but to contribute to the improvement.

It is a lot about transparency! If it is clear: methodology to evaluate the teams. It cannot be assumed that every team understands the methodology. If there is a common way to evaluate exercises, it becomes more clear. A kind of standard-evaluation.

The personal needs of exercise participants must be taken into consideration when planning the conduction of an exercise. But also the evaluators’ personal needs must not be overlooked.

Participants tend to lose interest in the exercise, after having completed it. Depending on the expectations about the post-event outcomes (it is about findings, explaining to the people, is it about particular/specific processes/findings).

Opinion of the participants about the exercise is an important part of the picture. It should be a composition of partial perspectives.

When conducting an exercise, the safety and security of the participants and evaluators of an exercise has an impact on the organization of the exercise and hence on its validation.