User study regarding RL Interpretability (Group-A).

JavaScript isn't enabled in your browser, so this file can't be opened. Enable and reload.

The purpose of this survey is to study how much DRL explanation can help users understand a DRL policy.

1. How’s your experience in explainable reinforcement learning (XRL)?

I have published a paper/papers that are related to XRL.

I have read some papers about XRL.

I have a general understanding towards XRL.

I have never heard of XRL.

Not applicable.

Clear selection

2. Please read the Instruction-1 in the following link (https://tinyurl.com/3fadhc) and answer the following question - In which of the following situations do the blocker win the game (multiple choices)?

Blocker successfully stops the runner and keeps standing till the end of game.

Blocker successfully stops the runner but falls on the ground.

Runner successfully reaches the finish line.

I am not sure.

3. Please read the Instruction-3 in the following link (https://tinyurl.com/3fadhc) and answer the following question - The importance of each time step is indicated by a color. Which of the following option correctly reflect the importance ranking (from the most important one to the least important one)?

Red > Orange > Yellow.

Yellow > Orange > Red.

Orange > Yellow > Red.

I am not sure.

Clear selection

4. Please watch the video records of the game episode and the corresponding explanations of Blocker-0 and Blocker-1 shown in the link: (https://tinyurl.com/frf2prnz) and answer the following question - Which blocker has a better policy or, in other words, which blocker will you choose to play the game?

Blocker-0 has a better policy and i will choose it to play the game.

Blocker-1 has a better policy and i will choose it to play the game.

Their policies are of similar performance, and I will randomly choose one to play the game.

I am not sure.

Clear selection

5. Please watch the video records of the game episode and the corresponding explanations of Blocker-0 and Blocker-1 shown in the link: (https://tinyurl.com/38kr536f) and answer the following question - Which blocker has a better policy or, in other words, which blocker will you choose to play the game?

Blocker-0 has a better policy and i will choose it to play the game.

Blocker-1 has a better policy and i will choose it to play the game.

Their policies are of similar performance, and I will randomly choose one to play the game.

I am not sure.

Clear selection

6. Please watch the video records of the game episode and the corresponding explanations of Blocker-0 and Blocker-1 shown in the link: (https://tinyurl.com/npp7kcep) and answer the following question - Which blocker has a better policy or, in other words, which blocker will you choose to play the game?

Blocker-0 has a better policy and i will choose it to play the game.

Blocker-1 has a better policy and i will choose it to play the game.

Their policies are of similar performance, and I will randomly choose one to play the game.

I am not sure.

Clear selection

7. Please watch the video records of the game episode and the corresponding explanations of Blocker-0 and Blocker-1 shown in the link: (https://tinyurl.com/r2umruhh) and answer the following question - Which blocker has a better policy or, in other words, which blocker will you choose to play the game?

Blocker-0 has a better policy and i will choose it to play the game.

Blocker-1 has a better policy and i will choose it to play the game.

Their policies are of similar performance, and I will randomly choose one to play the game.

I am not sure.

Clear selection

8. When answering the above four questions (Question 4-7), did you find the explanations in the video helpful?

Yes.

No.

I am not sure.

Clear selection

9. Please watch the video records of the same game episode with two different explanations of the blocker (Explanation-0 and Explanation-1) shown in the link: (https://tinyurl.com/5hd6h9tk) and answer the following question - Which explanation help you better understand the blocker's policy or, in other words, which explanation is more beneficial in helping you understand why the blocker fails/succeeds?

I found Explanation-0 is more helpful.

I found Explanation-1 is more helpful.

Neither Explanation-0 nor Explanation-1 is helpful.

I am not sure.

Clear selection

10. Please watch the video records of the same game episode with two different explanations of the blocker (Explanation-0 and Explanation-1) shown in the link: (https://tinyurl.com/9x2pdb2z) and answer the following question - Which explanation help you better understand the blocker's policy or, in other words, which explanation is more beneficial in helping you understand why the blocker fails/succeeds?

I found Explanation-0 is more helpful.

I found Explanation-1 is more helpful.

Neither Explanation-0 nor Explanation-1 was helpful.

I am not sure.

Clear selection

Submit

Clear form

This content is neither created nor endorsed by Google. Report Abuse - Terms of Service - Privacy Policy

Forms