Capabilities and expertise of the observers
Endorsed by
Motivation
Evaluators need to be aware of the topic that shall be evaluated, knowledge is needed on how to evaluate.
Examples of topics: CBRN, wildfire, flooding.
If participants don't have knowledge about the observer’s knowledge and capabilities and expertise, they will lose trust.
Potential Solutions
Following solutions could be addressing this gap.
Expertise/capabilities that are required: Topic to evaluate, how to evaluate, academical/operational background (“too” academic might be a weakness > “lose track”) to understand what is going on;
Soft skills > attitude not to interfere etc. (linked to understanding of roles)
Rationale & related CM function(s)
Knowledge/Awareness about: which checklist is there/appropriate; understanding of it. (Capabilities to deal with the tools)
- Pre-defined checklists or forms to log observations throughout an exercise
- Possible options of documenting perceptions (e.g. text, photos, videos, audio recordings, drawings, map annotations, etc.), which can be utilized for evaluation
- Tools and methods to process perceptions in order to generate evaluation insights (e.g. through efficient compilation, analysis, data visualization, etc.)
- Sufficient technical expertise (e.g. about tactics, correct use of equipment, best practice, etc.)
- Sufficient understanding of predominant language and abbreviations
Understanding the different models/formats, so it is easier to follow the flow of the exercise.
Ability to follow all the communication, using different channels (e.g. Signal, Telegram)
Lots of discussion: what are the goals, objectives, etc. Anyone has th be part from the very beginning
- Overarching purpose for the exercise
- Objectives to be reached by the exercise participants (qualitative, quanitative or both)
- Key Performance Indicators, utilized to measure the performance of exercise participants
- Areas/Aspects of particular importance to be observed
- Procedures or methods to structure and conduct effective exercise evaluation
- Equipment required to measure performance of exercise participants
 |
Portfolio of Solutions web site has been initially developed in the scope of DRIVER+ project. Today, the service is managed by AIT Austrian Institute of Technology GmbH., for the benefit of the European Crisis Management. PoS is endorsed and supported by the Disaster Competence Network Austria (DCNA) as well as by the STAMINA and TeamAware H2020 projects. |