Re: [gentoo-project] RFC: draft of Nitrokey survey questions re shipping, usage & satisfaction

[Michał Górny]

On Sat, 2019-07-13 at 23:38 +0000, Robin H. Johnson wrote:
> Hi,
>
> I'm trying to put together a survey about the Nitrokey units that the
> Foundation arranged for devs.
>
> The rough goals:
> - measure shipping results [=> quantitative, at least one dev had their shipment returned]
> - measure usage [=> quantitative, was this a waste?]
> - measure satisfaction with nitrokey units [=> qualitative]
>
> I'm planning on using Google Forms for this, because I'm familiar with
> that as a survey platform.
>
> I'm not going to spin up an entire survey system just keep it entirely
> libre. I do plan on publishing the results of the survey, with some
> parts made anonymous/redacted.
>
> The form will NOT require sign-in, but there will be a field for
> entering your developer name.
>
> I would appreciate both public & private input, both about this as a
> survey, and meta-input about future surveys to measure success of
> particular programs.
>
> Draft questions:
> ----------------
>
> Setup:
> - Dev Username [textfield]
>
> Shipping:
> - Did you order a nitrokey unit? boolean
> - When did you placed the order (optional) Y/M/D

'place', and ISO8601, please.

> - When did you received the order (optional) Y/M/D

Likewise.

> - How many nitrokey units did you actually receive? [integer]
> - Did you have to pay any additional charges to receive the unit?
> - If so, how much did you pay? [numeric]
>   COMMENT: I want to be able to adjust this question to both per-country
>   cost-of-living and socioeconomic level of different developers within
>   a country. See the demographics at the end.
> - If so, what were the nature of the charges (e.g. customs) [freetext]
> - Additional: If you did not receive the order, or got more than one,
>   can you summarize what happened? [freetext] Please do not
>   self-identify in the text.
>
> Usage:
> - Note: per-developer commit count will be extracted from Git
> - What percentage of your commits use the on-device key? (0..100% in 25% increments)
> - Did you use the units for non-commit signing or encryption? [boolean]
> - If so, how often? [many times a day, daily, weekly, monthly]
>
> Satisfaction:
> - What setup tooling documentation did you use: [select-many]
>   - Gentoo wiki
>   - Nitrokey docs
>   - Other doc (freetext)
>   - Figured it out by hacking it
> - Did you find the setup tooling easy to use? [1-5 scale]
> - Do you find regular usage of the tooling & unit easy? [1-5 scale]
> - Does the tooling & unit work consistently? [1-5 scale]

I don't really understand what 'consistently' means here.

> - Would you have considered purchasing a Nitrokey if the Foundation did
>   not fund it, and cost was not a problem? [1-5 scale]
> - If you encountered problems, can you summarize some of them?
>   [freetext] Please do not self-identify in the text
> - What do you feel could have been done better?
>   [freetext] Please do not self-identify in the text

You may want to clarify if that relates specifically to Gentoo usage of
Nitrokey, or should include generic remarks about it.

>
> Demographics, all optional:
> - Where are you located: [textfield, ISO country code]
> - Age bracket [0-17, 18-25, 25-35, 35-45, 45-55, 55-65, 65+]
> - For your country, what is your household income level, relative to the
>   median income? [select-one]
>   - Decline to answer
>   - Significantly below [<=50% below]
>   - Below [20-50% below]
>   - About the same [20% either side of median]
>   - Above [20-50% above]
>   - Significantly above [>=50% above]
>   COMMENT: This is specifically to identify need where developers
>   would have trouble purchasing hardware. The complex wording of the
>   question is meant to improve anonymity while identifying socioeconomic
>   need.
>

-- 
Best regards,
Michał Górny