Encrypted Email Study

ParticipantID: 5575eda87cd5a

Page: 0

Welcome to our study!

Thank you for your participation. During this study, you will be asked to perform certain tasks using Gmail and then provide feedback to help us improve our software. During the course of this study, all acts taking place on the screen will be recorded along with audio of anything we discuss. This will help us learn whether or not our software is easy to use.

You will have access to a temporary Gmail account for use in completing tasks during this study. You will not be asked to use your own Gmail login name or password at any time. Do not enter or access any of your own personal data during the study since everything on the screen will be recorded.

Are you a student?

What is your occupation or area of study?

What is your gender?

What is your approximate age?

How long have you been a Gmail user?

Approximately how often do you use webmail (Gmail)?

How would you rate your level of computer expertise?

Have you ever sent private or sensitive information via Web email or Facebook?

If so, how did you send that information? (briefly explain):

How important is maintaining the privacy of your messages containing sensitive information?

Have you ever encrypted an email or Facebook message?

If you answered yes to the previous question, please briefly explain how you did so.

Page: 1

Mailvelope Tasks

Mailvelope is a computer program that allows users to protect email messages via encryption. In this portion of the study, you will execute various tasks that comprise the primary functionality of Mailvelope and answer a few related questions.

Task 1: Set up Mailvelope

Please login to our test Gmail account with the login name and password shown below. Read the first message and follow the instructions given in the message.

Click here to open Gmail

Username: jane.doe.cs889@gmail.com
Password: supercomputers

At some point, you will be prompted for your name and email. Please use the information below:

Name: Jane Doe
Email: jane.doe.cs889@gmail.com

Task 2: Mailvelope Email Decryption

Wait for a new message from the study coordinator.

It may take a few minutes for the email to arrive.

Read the message and enter the secret phrase below:

Task 3: Mailvelope Email Encryption

Send a secure message to

study.coordinator.cs889@gmail.com

using Mailvelope. Include the secret phrase you were given in your message.

Task 4: Adding new Mailvelope Contacts

Try sending a secure message to

study.coordinator2.cs889@gmail.com (notice the "2" in "coordinator2")

using Mailvelope. You will notice they do not have Mailvelope installed yet, so follow the instructions that appear to send them an invitation.

It will take a few minutes for the study coordinator to receive and accept your invitation.

Once they have accepted the invitation, send the secure message. Include the phrase "The vault combination is 1234" in the message.

Page: 2

Please answer the following questions about Mailvelope. Try to give your immediate reaction to each statement without pausing to think for a long time. Mark the N/A column if you don't have a response to a particular statement.

Choose from 1 (strongly disagree) to 5 (strongly agree):

Question	1	2	3	4	5	N/A
I think that I would like to use this system frequently	1	2	3	4	5	N/A
I found the system unnecessarily complex	1	2	3	4	5	N/A
I thought the system was easy to use	1	2	3	4	5	N/A
I think that I would need the support of a technical person to be able to use this system	1	2	3	4	5	N/A
I found the various functions in this system were well integrated	1	2	3	4	5	N/A
I thought there was too much inconsistency in this system	1	2	3	4	5	N/A
I found the system very cumbersome to use	1	2	3	4	5	N/A
I would imagine that most people would learn to use this system very quickly	1	2	3	4	5	N/A
I felt very confident using the system	1	2	3	4	5	N/A
I needed to learn a lot of things before I could get going with this system	1	2	3	4	5	N/A

Remaining Questions:

What did you like about Mailvelope?

What did you dislike about Mailvelope and how would you like it to be changed?

If you started using Mailvelope on your own, would you prefer protection for new messages to be?

Page: 3

Message Protector Tasks

Message Protector (MP) is a computer program that allows users to protect Internet messages (e.g., email, Facebook private messages) via encryption. In this portion of the study, you will execute various tasks that comprise the primary functionality of MP and answer a few related questions.

Task 1: Set up MP

Open Message Protector from the toolbar on the left-hand side of your screen.

This is what the MP icon looks like.

MP requires an email address and the email account password to allow the user's contacts to be able to read their protected messages. For this study, we have created the following test account for you to use:

Email Address: jane.doe.cs889@gmail.com
Password: supercomputers

Allow the following contacts to read your protected messages: randomFriend@hotmail.com, mom@familyWebsite.com, and study.coordinator.cs889@gmail.com.

In this scenario, you will encrypt and decrypt email messages with MP. The encrypted emails are sent and received, however, using Gmail. Click here to go to Gmail and log in with the credentials above.

Task 2: MP Email Encryption

Use MP to encrypt an email and send it to study.coordinator.cs889@gmail.com (note that you will need to copy and paste the message contents from the MP window into a new Gmail message). Include the phrase "The last four digits of my SSN are 6789" in the message.

Task 3: MP Email Decryption

After completing the previous task, you will receive a protected reply email from study.coordinator@gmail.com. Use MP to decrypt the message.

It may take a few minutes for the email to arrive.

Type the decrypted message below:

Task 4: Adding contacts

Try sending a secure message to

study.coordinator2.cs889@gmail.com (notice the "2" in "coordinator2")

using MP. You will notice they do not have MP installed yet, so follow the instructions that appear to send them an invitation.

It will take a few minutes for the study coordinator to receive and accept your invitation.

Once they have accepted the invitation, send the secure message. Include the phrase "The vault combination is 1234" in the message.

Page: 4

Please answer the following question about MP. Try to give your immediate reaction to each statement without pausing to think for a long time. Mark the N/A column if you don't have a response to a particular statement.

Choose from 1 (strongly disagree) to 5 (strongly agree):

Question	1	2	3	4	5	N/A
I think that I would like to use this system frequently	1	2	3	4	5	N/A
I found the system unnecessarily complex	1	2	3	4	5	N/A
I thought the system was easy to use	1	2	3	4	5	N/A
I think that I would need the support of a technical person to be able to use this system	1	2	3	4	5	N/A
I found the various functions in this system were well integrated	1	2	3	4	5	N/A
I thought there was too much inconsistency in this system	1	2	3	4	5	N/A
I found the system very cumbersome to use	1	2	3	4	5	N/A
I would imagine that most people would learn to use this system very quickly	1	2	3	4	5	N/A
I felt very confident using the system	1	2	3	4	5	N/A
I needed to learn a lot of things before I could get going with this system	1	2	3	4	5	N/A
My level of understanding of MP directly affects whether I would use it to protect my email messages.	1	2	3	4	5	N/A

Remaining Questions:

Who can read messages that you protect with MP?

After MP is installed, what actions must recipients take to read MP protected messages?

How often would you use MP to protect your email messages?

What did you like about MP?

How could MP be improved?

Page: 5

Post Study Survey

Please answer the following questions. Try to give your immediate reaction to each statement without pausing to think for a long time. Mark the N/A column if you don't have a response to a particular statement.

Choose from 1 (strongly disagree) to 5 (strongly agree):

Question	1	2	3	4	5	N/A
I trust Gmail employees to not disclose, misuse, or abuse my email messages	1	2	3	4	5	N/A
I am concerned about Gmail scanning my messages	1	2	3	4	5	N/A
I worry that some messages aren't really from who they say they are from	1	2	3	4	5	N/A
I feel safe sending important information through email	1	2	3	4	5	N/A
I feel safe creating accounts with usernames and passwords on new sites	1	2	3	4	5	N/A
I feel safe installing browser extensions or plugins	1	2	3	4	5	N/A
Creating accounts for new websites is easy	1	2	3	4	5	N/A
Installing browser extensions is easy	1	2	3	4	5	N/A
I feel safe clicking on links in email messages	1	2	3	4	5	N/A
I feel safe clicking on links in email messages from people I know	1	2	3	4	5	N/A
I never click on links in email messages	1	2	3	4	5	N/A
I would trust a company other than Facebook or Gmail (e.g., MP, Mailvelope) to protect my email messages	1	2	3	4	5	N/A
I feel that it is important to encrypt my emails and messages that contain sensitive or private information	1	2	3	4	5	N/A
I would use a different Internet Encryption tool for every website that I store or share sensitive information	1	2	3	4	5	N/A

Have you installed browser extensions, add-ons or plugins before today?

What has prevented you from installing browser extensions, add-ons or plugins in the past?

When deciding whether you will trust a browser extension, add-on or plugin, what influences your decision?

Have you ever been asked to send sensitive information you were not comfortable sending through email?

What type of sensitive information were you asked to send?

Did you send the requested information?

Have you ever received information you were not comfortable receiving through email?

What type of sensitive information did you receive?

Which system would you prefer to use?

Please explain your answer to the previous question:

Thank you for completing our study! Before you go, please let us know if there is any additional information you would like us to have.

Additional Info: