Algorithmic Impact Assessment (Archived)

This is an archived version of the Algorithmic Impact Assessment. For the current version being developed, please visit the following site: https://canada-ca.github.io/aia-eia-js/

What is the Algorithmic Impact Assessment?

The AIA is a questionnaire designed to help you assess and mitigate the risks associated with deploying an automated decision system. The AIA also helps identify the impact level of your automated decision system under the proposed Directive on Automated Decision-Making. The questions are focused on your business processes, your data, and your system design decisions.

How does it work?

The questionnaire asks you around 57 questions related to your business process, data and system designed decisions. The results will demonstrate your impact level as well as a link where you can learn about what your requirements are under the Directive. The questionnaire takes 35 minutes to complete.

Where can I find out why my system was rated a certain level?

Click "Detailed Results" below and for a detailed scoresheet showing exactly where you gathered risk. You can download your results.

Can I save my responses and complete the questionnaire later?

Yes. You can save your spot at any time by clicking "Save progress to a file". It will download a tiny JSON file, which you can use to reload your results when you're ready to proceed. We don't save any of your information.

Do you store my answers?

No. We don't store your responses. Feel free to use this tool as many times as you need along the development of your system.

Questionnaire

About the Respondent

1. Name of respondent (required)

2. Job title

3. Department (required)

4. Branch

5. Project title (required)

6. Tell us a bit about your system

About the Decision

7. What parts of the decision-making process will be automated by this system? (Check all that apply)Question 7

a. Risk scoring, profiling, or categorization of a client in terms of risk
b. Recommendation to take a certain course of action
c. Render a complete administrative decision

8. How long is the system expected to function? (Select one)Question 8

One time only
For a limited duration
Indefinitely

9. Can this decision result in the restriction of movement into, out of, or within Canada?Question 9

10. Is this decision regarding an individual's past, current, or potential criminal activity?Question 10

11. Is this a decision about the provision of health care to an individual, community, or population?Question 11

12. Can this system result in granting or restricting access to a premises or network?Question 12

13. Does this system provide funds to an individual, business, or community?Question 13

14. Does this system result in the issuance of a permit, license, or an intellectual property right?Question 14

15. Is this a decision regaring the structure of a market (e.g., merger or acquisition, a limit to the number of market entrants)?Question 15

16. Does this system confer a legal status that is otherwise required to receive a benefit or service (e.g., Indian status, veteran status)?Question 16

17. Is this a decision regarding the provision of consular services?Question 17

18. Does this system involve the distribution of human resources or material in the management of emergencies?Question 18

19. What are the key business drivers for automating the administrative decision-making process? (Check all that apply)Question 19

a. The immediate decisions of the system could save lives
b. Existing backlog of work or cases
c. Improve overall quality of decisions
d. Lower transaction costs of an existing program
e. The system is performing tasks that humans could not accomplish in a reasonable period of time
f. Improve client service delivery
g. Using innovative approaches
h. None of the above

20. Will your system make decisions specifically about Indigenous peoples or territory?Question 20

Yes
No
Unsure

Data and Business Process

21. Who collected the data used for training the system? (Check all that apply)Question 21

a. Your institution
b. Another federal institution
c. Another level of government
d. A foreign government
e. A non-government third party

22. Who collects the input data used by the system? (Check all that apply)Question 22

a. Your institution
b. Another federal institution
c. Another level of government
d. A foreign government
e. A non-government third party

23. Have you consulted with relevant stakeholder groups representing those likely to be affected by the decision?Question 23

24. Is there a process in place to document how data quality issues were resolved during the design process?Question 24

25. Have you undertaken Gender Based Analysis Plus of the training data?Question 25

Yes
No
Not applicable

26. Does the Automated Decision System use personal information as input data?Question 26

27. Have you assigned accountability for the design, development, maintenance, and improvement of the system?Question 27

a. Design
b. Development
c. Maintenance
d. Improvement

28. What is the highest security classfication of the input data used by the system? (Select one)Question 28

Protected
Protected A
Protected B
Protected C
Classified
Confidential
Secret
Top Secret

29. Does the system require the analysis of unstructured data to render a recommendation or a decision?Question 29

Yes
No
Unsure

30. Does your system require input data from an Internet- or telephony-connected device? (e.g., a sensor, drone)Question 30

31. Does your system use contactless machine vision for biometric recognition (e.g. facial, full-body person, gait)?Question 31

32. Have appropriate strategies been developed to manage the risk that outdated or unreliable data is used to make an automated decision?Question 32

33. Is the scope of the system clearly reflected in project documentation?Question 33

Organizational Readiness

42. Has the design team consulted the following experts within their organization? (required)

a. CommunicationsQuestion 42a

b. Data and Information ManagementQuestion 42b

c. PolicyQuestion 42c

d. Human ResourcesQuestion 42d

e. IT/CybersecurityQuestion 42e

f. LegalQuestion 42f

g. Service DeliveryQuestion 42g

h. PrivacyQuestion 42h

43. Have you developed Key Performance Indicators and benchmarks to measure and improve the system’s performance?Question 43

44. Are you specifically measuring impacts (e.g., social, economic, environmental) that may result from the system?Question 44

45. Have you presented a concept case to the Government of Canada Enterprise Architecture Review Board?Question 45

Yes
No
Not applicable

46. Have you conducted a Security Assessment and Authorization?Question 46

Yes
No
Not applicable

47. Is there a process in place to grant, monitor, and revoke access permission?Question 47

48. Is the system used by a different part of the organization than the ones who developed it?Question 48

49. Did you develop training programs or documentation to ensure that the system is used effectively and properly?Question 49

50. Have you developed an external communications plan?Question 50

51. Have you developed an internal communications plan to address any potential changes to work practices for officers?Question 51

52. Do you have a mechanism to capture feedback by users of the system?Question 52

53. Do you have a recourse process planned or established for clients that wish to challenge the decision?Question 53

Results

Questionnaire completed

Final result

Please complete the questionnaire first.

Detailed results

Initial results

Criteria	Score
Impact on Individuals and Entities	0 out of 0 0%
Impact on Government Institutions	0 out of 0 0%
Data Management	0 out of 0 0%
Procedural Fairness	0 out of 0 0%
Complexity	0 out of 0 0%

Detailed score

Question	Selected answer	Impact on Individuals and Entities	Impact on Government Institutions	Data Management	Procedural Fairness	Complexity
1
2
3
4
5
6
7a	1	0 0	0 0	0 0	1.25 0	0 0
7b	1	0 0	0 0	0 0	1.5 0	1.05 0
7c	1	0 0	0 0	0 0	5 0	1.25 0
7.1	1 2	0 0	0 0	0 0	2.5 0	1.5 0
7.1.1
7.1.2	1 2	0 0	0 0	0 0	15 0	1.1 0
7.1.3	1 2	0 0	0 0	0 1.05	0 2	0 0
8	1 2 3	0 0 0	0 0 0	0 1.01 1.05	0 0 1.01	0 0 1.01
9	1 2	30 0	3 0	0 0	0 0	0 0
10	1 2	50 0	5 0	0 0	0 0	0 0
10.1	1 2	100 0	3 0	0 0	0 0	0 0
11	1 2	50 0	0 0	0 0	0 0	0 0
12	1 2	3 0	1 0	0 0	0 0	0 0
12.1	1 2 3 4 5 6 7 8 9	0 0 0 0 0 0 0 0 0	1 2 3 4 20 2 3 4 20	0 0 0 0 0 0 0 0 0	0 0 0 0 0 0 0 0 0	0 0 0 0 0 0 0 0 0
13	1 2	5 0	2 0	0 0	0 0	0 0
13.1	1 2	5 0	2 0	0 0	0 0	0 0
13.1.1	1 2	15 0	0 0	0 0	1.02 0	0 0
13.2	1 2	5 0	1 0	0 0	0 0	0 0
13.2.1	1 2	4 0	12 0	0 0	0 0	0 0
13.3	1 2	10 0	2 0	0 0	0 0	0 0
14	1 2	2 0	2 0	0 0	0 0	0 0
14.1	1 2	8 0	2 0	0 0	0 0	0 0
14.1.1	1 2	35 0	10 0	0 0	0 0	0 0
14.2	1 2	4 0	2 0	0 0	0 0	0 0
14.3	1 2	20 0	2 0	0 0	0 0	0 0
15	1 2	25 0	25 0	0 0	0 0	0 0
16	1 2	8 0	8 0	0 0	0 0	0 0
17	1 2	20 0	8 0	0 0	0 0	0 0
18	1 2	1 0	6 0	0 0	0 0	0 0
19a	1	0 0	0 0	0 0	-0.4 0	0 0
19b	1	0 0	0 0	0 0	-0.2 0	0 0
19c	1	0 0	0 0	0 0	-0.2 0	0 0
19d	1	0 0	0 0	0 0	-0.05 0	0 0
19e	1	0 0	0 0	0 0	-0.1 0	0 0
19f	1	0 0	0 0	0 0	-0.02 0	0 0
19g	1	0 0	0 0	0 0	-0.02 0	0 0
19h	1	0 0	0 0	0 0	0 0	0 0
20	1 2 3	0 0 0	0 0 0	0 0 0	0 0 1.02	0 0 0
20.1	1 2	0 0	0 0	0 0	0 0	0 0
21a	1	0 0	0 0	0 0	0 0	0 0
21b	1	0 0	0 0	1.01 0	0 0	0 0
21c	1	0 0	0 0	1.02 0	0 0	0 0
21d	1	0 0	0 0	1.02 0	1.02 0	0 0
21e	1	0 0	0 0	1.05 0	1.02 0	0 0
22a	1	0 0	0 0	0 0	0 0	0 0
22b	1	0 0	0 0	1.01 0	0 0	0 0
22c	1	0 0	0 0	1.02 0	0 0	1.02 0
22d	1	0 0	0 0	1.02 0	1.02 0	1.02 0
22e	1	0 0	0 0	1.05 0	1.02 0	1.02 0
23	1 2	0 0	0 0	0 0	0 1.05	0 0
23.1	1 2 3	0 0 0	0 0 0	0 0 0	-0.5 1.5 1.05	0 0 0
24	1 2	0 0	0 0	-0.05 2.5	-0.05 1.2	0 0
24.1
25	1 2 3	0 0 0	0 0 0	-0.05 1.15 0	0 0 0	0 0 0
25.1	1 2 3	0 0 0	0 0 0	0 0 0	0 0 0	0 0 0
26	1 2	0 0	0 0	2.5 0	0 0	0 0
26.1	1 2	0 0	0 0	0 0	0 0	0 0
27a	1	0 0	0 0	0 0	0 1.1	0 0
27b	1	0 0	0 0	0 0	0 1.1	0 0
27c	1	0 0	0 0	0 0	0 1.5	0 0
27d	1	0 0	0 0	0 0	0 1.1	0 0
28	1 2 3 4 5 6 7 8	0 0 0 0 0 0 0 0	0 0 0 0 0 0 0 0	0 0 0 0 0 0 0 0	0 0 0 0 0 0 0 0	0 1.05 1.1 1.15 1.02 1.05 1.1 1.15
29	1 2 3	0 0 0	0 0 0	0 0 1.05	0 0 1.02	0 0 0
29.1a	1	0 0	0 0	1.02 0	0 0	1.02 0
29.1b	1	0 0	0 0	1.02 0	0 0	1.1 0
29.1c	1	0 0	0 0	1.02 0	0 0	1.2 0
29.1d	1	0 0	0 0	1.02 0	0 0	1.2 0
29.1e	1	0 0	0 0	1.02 0	0 0	2 0
29.1f	1	0 0	0 0	1.02 0	0 0	1.15 0
29.1g	1	0 0	0 0	1.02 0	0 0	1.15 0
29.1h	1	0 0	0 0	0 0	0 0	0 0
29.1.1
30	1 2	0 0	0 0	1.5 0	0 0	1.5 0
31	1 2	0 0	0 0	0 0	0 0	1.02 0
31.1	1 2 3	0 0 0	0 0 0	0 0 0	0 1.05 0	0 0 0
31.2	1 2 3	0 0 0	0 0 0	0 0 0	0 1.05 0	0 0 0
32	1 2	0 0	0 0	-0.05 1.15	-0.05 1.05	0 0
32.1
33	1 2	0 0	0 0	0 0	0 1.02	0 0
34	1 2	0 0	0 0	0 0	0 0	1.1 0
34.1	1 2	0 0	0 0	0 1.1	0 0	0 0
35	1 2	0 0	0 0	0 0	0 2	0 0
36	1 2	0 0	0 0	0 0	2.5 0	1.5 0
36.1	1 2	0 0	0 0	0 0	-2.5 0	0 0
37	1 2	0 0	0 0	0 0	0 0	0 0
38	1 2	0 0	0 0	0 0	0 3	0 0
39	1 2	0 0	0 0	0 0	0 12	0 0
39.1
40	1 2	0 0	0 0	0 0	0 1.05	0 0
40.1	1 2	0 0	0 0	0 0	0 1.02	0 0
40.2	1 2	0 0	0 0	0 1.05	0 1.05	0 0
40.3	1 2	0 0	0 0	0 0	0 1.02	0 0
41	1 2	0 0	0 0	0 0	0 1.8	0 0
42a	1 2	0 0	0 0	0 0	0 1.01	0 0
42b	1 2	0 0	0 0	0 1.05	0 0	0 0
42c	1 2	0 0	0 0	0 1.02	0 0	0 0
42d	1 2	0 0	0 0	0 0	0 0	0 0
42e	1 2	0 0	0 0	0 1.02	0 0	0 0
42f	1 2	0 0	0 0	0 0	0 1.1	0 0
42g	1 2	0 0	0 0	0 0	0 0	0 0
42h	1 2	0 0	0 0	0 1.01	0 1.02	0 0
42.1	1 2	0 0	0 0	0 0	-0.05 0	0 0
42.2	1 2	0 0	0 0	0 0	0 1.05	0 0
42.3	1 2	0 0	0 0	0 1.05	0 1.05	0 0
44	1 2	0 0	0 0	0 0	0 1.25	0 0
44.1
45	1 2 3	0 0 0	0 0 0	0 1.05 0	0 0 0	0 0 0
46	1 2 3	0 0 0	0 0 0	0 0 0	0 0 0	0 0 0
46.1	1 2	0 0	0 0	0 1.25	0 0	0 0
47	1 2	0 0	0 0	0 1.05	0 0	0 0
48	1 2	0 0	0 0	0 0	0 0	1.1 0
49	1 2	0 0	0 0	0 0	0 1.1	0 0
49.1	1 2	0 0	0 0	0 0	0 0	0 0
50	1 2	0 0	0 0	0 0	0 1.02	0 0
51	1 2	0 0	0 5	0 0	0 0	0 0
52	1 2	0 0	0 0	0 1.02	0 0	0 1.05
53	1 2	0 0	0 0	0 0	0 2	0 0

Search and menus

Search