Evaluation of the implementation process and organisation
When you evaluate the implementation process, you have to consider both the interdisciplinary implementation team's work and the actual roll-out of the technology in operation. Read more in the eighth, and final, article on implementing technology.
When implementing new technology, it is recommended to set up an interdisciplinary implementation team. The team's task is to prepare, follow, and lead the implementation process in the organisation. In this article, we take a closer look at how to evaluate the work the interdisciplinary implementation team has made, and how you can evaluate the implementation process as a whole.
In the project DISH (Digital & Innovation Skills Helix in Health), the interdisciplinary team is also referred to as a Learning Innovation Unit (LIU).
Evaluating the interdisciplinary implementation team
Additional resources are spent on the interdisciplinary implementation team. Therefore, it is relevant to evaluate both the implementation process as a whole and establish how the implementation team's work has affected the quality and sustainability of the implementation process.
The evaluation objectives for the interdisciplinary implementation team are linked directly to this purpose. It is examined whether the interdisciplinary implementation team has achieved improved results by:
- Promoting technology readiness among healthcare professionals
- Promoting exploratory behaviour among healthcare professionals
- Improving implementation and change management processes
- Ensuring competence and capacity building in a team rather than in the individual
- Improving collaboration between healthcare professionals and companies
- Ensuring a better understanding of clinical needs in the implementation process
You should pay particular attention to effects such as:
- Better change management (increased acceptance of new technology implementation among staff)
- Better peer learning structure (better sustainability)
- Extended use of the technology beyond the original goal - and it can both be in the same work area or transferred to completely different work areas (greater profit realisation)
Evaluation of the entire implementation process
Already when you develop the implementation plan, the interdisciplinary implementation team must establish mechanisms that will make it possible to evaluate the usefulness of a given technology once it is implemented in the operation:
What is the concrete result you expect from the implementation? How will you measure whether this is achieved? - The expected results will often be found in the business case that has provided the basis for purchasing and implementing a new technology.
What capacity building have you achieved among the staff in connection with the introduction of a given technology? Here it is important that capacity building is seen as part of the overall benefit of the technology.
Has it created extra value for the team that works daily with the implemented technology, that the implementation has been led by the interdisciplinary implementation team? And what value?
Other activities and initiatives related to technology implementation
- The PPI-Guide (OPIguide, Danish only) consists of tools and cases: from ideation over innovation-process to health and welfare technology implementation.
- The network for implementation of video consultations (Danish only) focuses on the specific challenges associated with implementing and harvesting the benefits when implementing video consultations.
- The international project DISH focuses on the lack of healthcare professionals' competencies to use the many digital solutions that are continuously introduced in the healthcare system.
- As a partner in the DISH project, Welfare Tech has contributed to developing a tool that will inform the interdisciplinary team set up before each implementation process. The tool is directly linked to an on-the-job training concept and an associated evaluation concept. The three concepts are currently being tested by 600 health professionals in five European countries. The tools are expected to be available on Welfare Tech's website after testing and adjustments.
In a series of eight articles, Welfare Tech focuses on the essential parameters for a successful implementation. Link to the other articles:
- How to prepare for the implementation of new technology in the health and care sector
- How an interdisciplinary effort during technology implementation ensures the subsequent harvest of benefits
- Key activities in connection with the implementation
- Key employees involved in the implementation process
- Resources that need to be allocated to the implementation process
- Technology Uptake
- Multidisciplinary collaboration
- Evaluation of the implementation process and organisation