Evaluation framework and UCD plan

AEGIS has developed a horizontal evaluation framework involving several sequential iterative heuristic evaluations that aimed to involve both experts and users, as appropriate, at various stages of the development lifecycle of all the proposed prototypes and applications of AEGIS. Sequential evaluations involved a series of evaluation techniques that run in sequence, such as contextual inquiry, naturalistic observations, performance testing, technical validation on the hand, etc.

The evaluation framework of AEGIS was based on the User Centred Design (UCD) Plan that was established early in the project and has been reported in D1.1.1: “User groups' and stakeholders' definition and UCD Implementation Plan” (downloadable from here).

The early field studies and the workshops that were realised as well as the identification of the target users and stakeholders (all reported in D1.1.2: “Analysis of the context of ICT use”; downloadable from here) have provided the reference case for the project development and evaluation work.

In parallel, the Use Cases, application scenarios, Personas and conceptual models, reported in D1.1.3: “Use cases and application scenarios” (downloadable from here), constituted the basis for the evaluation scenarios developed in order to support the performance testing of the user trials.