Replicability Assessment Form (Computing)

Introduction

This Replicability Assessment tool has been developed to give a comparative assessment of the level of replicabiity of Use Cases and/or Solutions developed by European projects addressing Smart Connectivity. This tool allows each Use Case and/or Solution to be evaluated with respect to five relevant dimensions (Technical, Data, Market, Acceptance, and Regulation/Policy) in order to give potential integrators and indication of how ready the use case is to be replicated. It is a basic indication of the potential to reuse these results by any integrator (such as DIHs) to accelerate the digitalisation of the European Industry.

The replicability factor calculated for each use case may be published by the projects in the SNS Vertical engagement tracker tool and the SNS annual survey (as organised by the SNS CO-OP project). On submitting your entered data you will receive an email copy of the information entered and the calculated Replicability factor.

Instructions

This Replicability Assessment tool must be completed for each individual use case. You must clearly identify your Project and the Use Case Name. There is no limit on how many use cases you can enter from your project. Please align with all key personnel in your project (e.g., Technical manager, WP leader, Exploitation manager, etc.) to ensure the correctness of the provided answers and to avoid duplicate entries.

For each user case / Solution developed and experimented by the project, you have to fill the questionnaire below,

For each question there is a dedicated text box labeled “”Elaboration text””. Please use this to provide additional explanations where necessary.

All Fields are mandatory and must be answered to submit. Once your submit the form will confirm if all questions are answered and the show the calculated factor. You will also get a copy of the calculation by email.

Definitions

A component is a technology piece of a solution
A Solution is a stand-alone feature able to support uses cases
A Project result is a tested solution on at least one use case

Questionnaire:

Please complete every question in each section for one Use case and Submit.

All questions require an answer and all sections must be completed to get a valid assessment of the replicability.


Use Case Description & Contacts:
*Select Project:**		*Select Stream:**
*Use Case Name:**		*Use Case Location:**
*Use case/Solution description:** Please explain in a concise manner what your Use case will deliver (max 200 words)
*Project Representative Name:**		*Project Representative eMail:**

Technical dimension - 11 Questions (T1-T11):
This assessment dimension would determine if a project result/solution is replicable or scalable from a technical point of view.
T1: Openness of components: Component provides interfaces that could allow easy integration in other environments	Easy to integrate in another environment--2Difficult to integrate in another environment without expert support--1Impossible to integrate in another environment--0
T2: Interoperability of components - Standardized device communication API: Provides application developers with uniform and transparent access to physical devices and wearables. (e.g. SCRAL, LinkSmart)	Standardised API available--1No API available--0
T3: Standardized Data Modeling: Allows IoT syntactic and semantic interoperability (e.g. OGC SensorThings API), Standardized Data model available	Standardised Data Model--1Proprietary data model--0
T4: IoT Platform interoperability: Allows the integration with other IoT platforms (e.g. oneM2M, FIWARE, Azzure, …, see SCoDIHNet platform catalogue)	Component is running on one of the IoT platforms--1Component is running on a proprietary platform--0
T5: Modularity: Referred to modular IoT architecture that can be customized for a diverse range of applications or, in general, to a design principle that subdivides a system into smaller parts called modules, which can be independently created, modified, replaced, or exchanged with other modules or between different systems	Components have been designed with several modules--1Components have been designed in one single module--0
T6: Compatibility with legacy infrastructure and equipment: The solution is using legacy network infrastructure (5G, Sigfox, Lora, NB-IoT, …) and devices	The solution is using legacy infrastructure and legacy devices--2The solution is using legacy infrastructure and proprietary devices--1The solution is using proprietary infrastructure and legacy devices--1The solution is using proprietary infrastructure and proprietary devices--0
T7: Updates & Maintenance: Components should evolve to add new functionalities or to correct bugs, this could be made could be easily remotely or need intervention of experts	Components updated and maintained by the integrator--1Maintenance and updates need expert intervention--0
T8: Standards Compliance: Many standards have been developed for IoT and communication, interoperability could only become a reality if components are compliant to one or the other standards	Components are compliant to a standard--1Components are not compliant to any standard--0
T9: Communication/Cloud infrastructure: Data generated by IoT need to be stored and manipulated before feeding the end user application. This topic targets the communication protocol used to send out data to the cloud data centre. There are several types of protocol available (Sigfox, LoRa, 4G, 5G, RF, NFC, …) which need to offer interoperability	Components compliant with a standard communication protocol--1Components use a proprietary communication protocol --0
T10: Exploitation potential/applicability to industrial relevant environment: In order to contribute to the Digitalisation of the European Industry (Digital Europe Program) through the Digital Innovation Hubs, a component should be used for use cases addressing industry whatever it is	Components are able to be used in an industrial environment --1Components are not usable in an industrial environment--0
T11: Technology Readiness Level: A method to estimate the technology maturity of the solution	TRL 1 - Basic principles observed--1TRL2 - Technology concept formulated--2TRL3 - Experimental proof of concept--3TRL4 - Technology validated in lab--4TRL5 - Technology validated in relevant environment--5TRL6 - Technology demonstrated in relevant environment--6TRL7 - System prototype demonstration in operational environment--7TRL8 - System complete and qualified--8TRL9 - Actual system proven in operational environment--9
Technical Replicability factor score:

Data dimension - 6 Questions (D1-D6):
This assessment dimension would determine if a project result/solution is replicable or scalable from a “Data” point of view.
D1: Compatibility with data privacy rules: Data provided by IoT and used by applications should be under the European regulation. IoT are providing basic information but also videos, pictures or human sensors data that fall under GDPR	Components are not collecting personal data--1Components are collecting personal data but respect the GDPR--0
D2: Data Modelling: Data modelling is the process of creating a visual representation of either a whole information system or parts of it to communicate connections between data points and structures. Data modelling employs standardized schemas and formal techniques. This provides a common, consistent, and predictable way of defining and managing data resources across an organization, or even beyond. A number of tools are available to support the methodology (Erwin Data Modeller, Enterprise Architect, ER/Studio, Open ModelSphere, …)	A data modelling tool has been used--1No data modelling tool has been used--0
D3: Data Security: Data security is the practice of protecting digital information from unauthorized access, corruption, or theft throughout its entire lifecycle. How many of these 4 security components: Data Encryption, Data erasure, Data masking and Data resiliency is the component implementing?	Component is implementing all 4 Data security components--4Component is implementing 3 of 4 Data security components--3Component is implementing 2 of 4 Data security components--2Component is implementing 1 of 4 Data security components--1No security components are implemented--0
D4: Data Quality: Data quality measures the condition of data relying on factors such as how useful it is to the specific purpose. How many of these 6 quality factors: Completeness, Accuracy, Timeliness (e.g., is it up to date?), Consistency, Validity, and Uniqueness is the component implementing?	Component is implementing all 6 Data quality factors--6Component is implementing 5 of 6 Data quality factors--5Component is implementing 4 of 6 Data quality factors--4Component is implementing 3 of 6 Data quality factors--3Component is implementing 2 of 6 Data quality factors--2Component is implementing 1 of 6 Data quality factors--1No Data quality factors are implemented--0
D5: Data Assets Management: Data assets management (DAM) has the objective to acquire, monitor, use, optimise, and exploit data assets to generate value. The 3 DAM factors encompass Accessibility, Compliance and Risk management.	Component is providing all 3 DAM factors--3Component is providing 2 DAM factors--2Component is providing 1 DAM factor--1No DAM factors implemented--0
D6: Data Relevance: Data relevance is a measure of the impact of specific data on decisions or actions by the user. Collecting irrelevant data contributes to information “overload” and complicates decision‐making	Component is able to select relevant data--1Component is only using specific collected data--0
Data Replicability Factor score:

Market dimension - 8 Questions (M1-M8):
This assessment dimension would determine if a project result/solution is replicable or scalable from a business point of view.
M1: Market analysis: A market analysis provides information about industries, customers, competitors, and other market variables. You can also determine the relationship between supply and demand for a specific product or service. Based on these insights, you can make more informed decisions about possible marketing strategies.	A market analysis has been conducted--1No market analysis conducted yet--0
M2: Demand analysis: Demand analysis is a research done to estimate or find out the customer demand for a product or service in a particular market. Demand analysis process needs to be done in a structured manner for a particular market and affects the business strategy and decisions. Some of the steps which are to be followed for the analysing the demand are: Market selection, Product/service category analysis, understanding business parameters, understanding the competitors and partner trends.	A demand analysis has been conducted--1No demand analysis conducted yet--0
M3: Business model: The term business model refers to a company's plan for making a profit. It identifies the products or services the business plans to sell, its identified target market, and any anticipated expenses. There are a number of Business models but for a manufacturer which is responsible for sourcing raw materials and producing finished products by leveraging internal labor, machinery, and equipment. A manufacturer may make custom goods or highly replicated, mass produced products. A manufacturer can also sell goods to distributors, retailers, or directly to customers.	A business model has been developed--1No business model available yet--0
M4: Stakeholder needs analysis: A stakeholder analysis is a project management tool used to identify the project’s stakeholders, issues they care about and how they will be impacted by the project.	A stakeholder needs analysis has been conducted--1No stakeholder needs analysis conducted yet--0
M5: IPR analysis: Intellectual Property Rights (IPR) aim to stimulate innovation by enabling inventors to appropriate the returns on their investments.	An IPR analysis has been conducted--1No IPR analysis conducted yet--0
M6: Intellectual Property (IP) strategy for your solution: An IP strategy is a plan for you to develop, grow, leverage and monetize your portfolio of IP assets.	There is no specific IP strategy defined yet--0An IP strategy has been defined--1An IP strategy is in place--2
M7: Solution validated in the market: Market validation includes reviewing your solution with your market (customers and prospects).	Your solution has not been deployed at customer site--0Your solution is deployed at (prospect) customer site--1Your solution is generating revenues--2
M8: Business Readiness Level: A method to estimate the business maturity of the solution.	BRL1 - Concept--1BRL2 - Problem-solution fits--2BRL3 - Build team and plan--3BRL4 - Customer definition--4BRL5 - Hypothesis testing--5BRL6 - Minimum viable product--6BRL7 - Feedback--7BRL8 - Scale--8BRL9 - Fully embedded business--9
Marketing Replicability Factor score:

Acceptance Dimension - 6 Questions (A1-A6):
This assessment dimension would determine if a project result/solution is replicable or scalable from a product acceptance point of view.
A1: End-user interface design/usability: User interface design is responsible for a product's appearance, interactivity, usability, behaviour, and overall feel. UI design can determine whether a user has a positive experience with a product.	User Interface not previewed/published yet--0A focus group has been conducted--1A user test has been conducted--2A pilot/experiment has been conducted--3
A2: Implementation instructions and documentation: Product documentation is a type of technical documentation that explains almost everything there is to know about a product or piece of software. Typically 5 documents should be available: Product specifications and system requirements; Instructions for product setup, installation and configuration; Specific use case instructions; Troubleshooting info; User documentation & answers to frequently asked questions.	All 5 documents are available--54 of 5 are available--43 of 5 are available--32 of 5 are available--21 of 5 is available--1No documents are available yet--0
A3: Adoption by DIHs: The use case/solution will be well accepted by the DIHs if the component answers to the end user needs, is easy to use, to modify, to maintain and cost effective.	The use case/solution is well-known by the DIHs--1The use case/solution is unknown to the DIHs--0
A4: User experience: User Experience refers to the feeling users experience when using a product, application, system, or service. It is a broad term that can cover anything from how well the user can navigate the product, how easy it is to use, how relevant the content displayed is etc.	UX testing has been conducted--1UX testing has not been conducted yet--0
A5: Language: In European projects, user Interface (UI) are usually designed using the English language. In the case of replicability, it is obvious that the UI has to be adapted to the targeted country (even outside Europe).	The solution can't use other languages easily--0The solution could use other languages--1The solution is already supports other languages--2
A6: Societal readiness: The Societal Readiness Level https://innovationsfonden.dk/sites/default/files/2019-03/societal_readiness_levels_-_srl.pdf is a way of assessing the level of societal adaptation of, for instance, a particular social project, a technology, a product, a process, an intervention, or an innovation (whether social or technical) to be integrated into society. There are 9 levels (SRL) which help to qualify the solution, which one fits the best with your case:	SRL1 - Identifying problem and identifying societal readiness--1SRL2 - Formulation of problem, proposed solution(s) and potential impact, expected societal readiness; identifying relevant stakeholders for projects--2SRL3 - Initial testing of proposed solutions(s) together with relevant stakeholders--3SRL4 - problem validated through pilot testing in relevant environment to substantiate proposed impact and societal readiness--4SRL5 - proposed solution(s) validated, now by relevant stakeholders in the area--5SRL6 - Solution(s) demonstrated in relevant environment and in co-operation with relevant stakeholders to gain initial feedback on potential impact--6SRL7 - Refinement of project and/or solution and, if needed, retesting in relevant environment with relevant stakeholders--7SRL8 - Proposed solution(s) as well as a plan for societal adaptation complete and qualified--8SRL9 - Actual project solution(s) proven in relevant environment--9
Acceptance Replicability Factor score:

Regulation/Policy Dimension - 3 Questions (R1-R6):
The European Commission and Member states are elaborating a policy strategy that give a long term vision of the evolution of Europe that are translated into laws. It addresses Environment, economy, health, democracy, …).
The European Union is based on the rule of law. This means that every action taken by the EU is founded on treaties that have been approved democratically by its members. EU laws help to achieve the objectives of the EU treaties and put EU policies into practice. There are several EU acts that are applying to European citizens and industries. There are a number of regulations addressing the digital sectors that all products need to respect.
R1: EU regulation compliance: Looking to the EUR-Lex tool (https://eur-lex.europa.eu), there are 633 regulations that are applicable to the digital sector.	A check of compliance with European Regulations has been conducted--1No check of compliance with European Regulations has been conducted yet--0
R2: National regulation Compliance: At national levels there are also specific laws that are not contrary to European legislation but could bring additional constraints.	A check the compliance with the National Regulations has been conducted--1No check of compliance with National Regulations has been conducted yet--0
R3: EU Policy support: The political strategy of this European Commission is to set Europe on a path to successfully achieving climate neutrality by 2050, shaping our digital future, strengthening our unique social market economy, building a Union of prosperity, and making Europe stronger in the world. 6 priorities have been identified: A European Green deal; An economy that works for people; Promoting our European way of life; A Europe fits the digital age; A stronger Europe in the world; and A new push for European democracy. To what extent does your solution address these goals?	The solution is addressing all 6 European strategic goals--6The solution is addressing 5 European strategic goals--5The solution is addressing 4 European strategic goals--4The solution is addressing 3 European strategic goals--3The solution is addressing 2 European strategic goals--2The solution is addressing 1 European strategic goal--1The solution is not addressing any European strategic goals--0
Regulation/Policy Replicability Factor score:

The Replicability Factor for the use case based on the data entered above is: