Mailing-List: contact dev-help@openoffice.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@openoffice.apache.org
Received-SPF: pass (athena.apache.org: local policy includes SPF record at
 spf.trusted-forwarder.org)
MIME-Version: 1.0
Sender: zobelg@mail.wou.edu
In-Reply-To: 
 <CAP-ksojs55ey=CpJEubjTYuVDAm86Vpw6xjH=RtqLv8aF5RxSg@mail.gmail.com>
References: 
 <CAP-ksogLBVTGy3ZRt3zUNrVkhQJxu3FpV-WAc-3DNLS6fap4pw@mail.gmail.com>
 <CADca4QTugYc2gGcM6VMhw1TC9s21gTFFw-ozvRkKGWfpt_ERQQ@mail.gmail.com>
 <CAP-ksogc9osMmhy7-KX+GAtJ-YqWMVeTKNf=Em6XP=HkVWhsUg@mail.gmail.com>
 <CADca4QThqsbJWD3Gsa8SNCjBijo8np=SjV0YrHnat4UYtnTupg@mail.gmail.com>
 <CAP-ksojs55ey=CpJEubjTYuVDAm86Vpw6xjH=RtqLv8aF5RxSg@mail.gmail.com>
From: Gregory Zobel <zobelg@wou.edu>
Date: Wed, 11 Dec 2013 12:06:21 -0800
Message-ID: 
 <CADca4QRKN8ipSe9s9WfCFZMaRBVkUu3JXBD=OtVmeEY9FCa_4w@mail.gmail.com>
Subject: Re: Proposed: Website Satisfaction Survey
To: dev@openoffice.apache.org
Content-Type: multipart/alternative; boundary=047d7b5d35b8758e3504ed47c429

--047d7b5d35b8758e3504ed47c429
Content-Type: text/plain; charset=ISO-8859-1

Sounds good. I'll need to poke around a bit more. It looks like there are
some already-existing and good resources in the UX section. I haven't
worked in a wiki for a while either, so I need to review some of that.

But I'll get to it.

Best,
gz


On Wed, Dec 11, 2013 at 11:57 AM, Rob Weir <robweir@apache.org> wrote:

> On Wed, Dec 11, 2013 at 2:40 PM, Gregory Zobel <zobelg@wou.edu> wrote:
> > I'd be happy to help develop the survey questions.
> > We could devise probably 4-7 more questions without users resisting too
> > much--long surveys annoy users. Ending with a couple of open-ended
> > questions: what is most frustrating to you about AOO? what do you like
> most
> > about AOO? could also shed some light.
> >
> > From what I can tell, ASF has a policy of open content, open source, and
> it
> > would follow that open data is a part of this. It might be possible to
> get
> > engagement from parts of the academic usability community (i.e. analysis
> > and discussion of what the different results mean, what to adjust, as
> well
> > as promoting AOO in academia) by sharing the usability responses/results
> > openly.
> >
> > Just an idea. I know when I was training, it was hard to find usability
> > data because most entities protect it like IP--can't give results,
> > shortcomings, or improvements. Having the data would also be nice.
> >
>
> We take user privacy seriously as well.  Even though we're a US-based
> non-profit we know that data protection laws vary and are stronger in
> Europe, where many of our users are.  So if we anticipate that we'll
> want to make the raw survey results open (as opposite to just
> aggregate summarize) we'll need to think about what additional steps
> will be needed.   For example, I usually track IP addresses in
> LimeSurvey to detect multiple submissions.  We'd need to strip that
> out of any publicly released data.  We'd also need a prominent
> disclaimer/notice to the user, stating how the data will be used.
>
> When we did the logo survey (results here [1]) we received over 5000
> responses in one week.  So there is an opportunity to get a
> substantial number of responses.
>
> If you want to start designing the survey questions a good place for
> this might be on the UX section of our wiki [2].  Maybe a new page
> linked to the UX Research Strategy page?  Then send a link to that
> page to the dev mailing list and anyone interested can follow along
> and help.   I'll volunteer to translate the survey design into
> LimeSurvey.  If we keep it short it should be possible to then get it
> translated into a handful of languages.
>
> Regards,
>
> -Rob
>
>
>
> [1] http://survey.openoffice.org/reports/aoo40-logo-poll/
>
> [2] https://wiki.openoffice.org/wiki/Apache_OpenOffice_User_Experience
>
>
> > Best,
> > gz
> >
> >
> > On Wed, Dec 11, 2013 at 11:34 AM, Rob Weir <robweir@apache.org> wrote:
> >
> >> On Wed, Dec 11, 2013 at 1:29 PM, Gregory Zobel <zobelg@wou.edu> wrote:
> >> > Hi Rob,
> >> >
> >> > I like the idea of a satisfaction survey. I would suggest using an
> >> industry
> >> > standard, the SUS.
> >> > http://www.measuringusability.com/sus.php
> >> >
> >> > It's been around for 25 years or so, it has provided reliable metrics,
> >> and
> >> > it could prove to be a rich data source.
> >> >
> >>
> >> Thanks for passing that link along.  The SUS approach might be even
> >> more interesting to apply to a satisfaction survey of the OpenOffice
> >> product itself.
> >>
> >> One thing to know:  we do have access to a LimeSurvey instance
> >> (http://survey.openoffice.org).  We used it most-recently to gather
> >> feedback for our AOO 4.0 logo contest.  But it would be easy to use it
> >> for a SUS survey as well.  The advantage with LimeSurvey is it makes
> >> it really easy to manage multiple translations of the survey,
> >> something nice with our international user based.
> >>
> >> If we did this survey, what other questions would we want to ask, to
> >> give data to correlate against?   Maybe demographic factors like age,
> >> sex, country.  Maybe operating system used (usability might vary by
> >> OS), certainly what version of OpenOffice is used, how long they have
> >> been using OpenOffice.
> >>
> >> Regards,
> >>
> >> -Rob
> >>
> >> > Another alternative is to create the survey in Google Forms and then
> >> embed
> >> > it on sub-page. I've used this approach in many classes taught online,
> >> and
> >> > it goes pretty well. Plus you get more questions.
> >> >
> >> > Best,
> >> > gz
> >> >
> >> >
> >> >
> >> > On Wed, Dec 11, 2013 at 10:24 AM, Rob Weir <robweir@apache.org>
> wrote:
> >> >
> >> >> Google has a new service that makes it easy to add a website
> >> >> satisfaction survey to a website.  The free version has 4 questions
> >> >> that are asked of 500 random website visitors each month.  We would
> be
> >> >> given results on a monthly basis.  (They also have a paid version of
> >> >> this service where you can customize the questions, but I think the
> >> >> free version is fine for our use).
> >> >>
> >> >> The questions are:
> >> >>
> >> >> I. Overall, how satisfied are you with this website?
> >> >>
> >> >> 1) Very satisfied
> >> >> 2) Somewhat satisfied
> >> >> 3) Neither satisfied nor dissatisfied
> >> >> 4) Somewhat dissatisfied
> >> >> 5) Very dissatisfied
> >> >>
> >> >> II. What, if anything, do you find frustrating or unappealing about
> >> >> this website?
> >> >>
> >> >> III. What is your main reason for visiting this website today?
> >> >>
> >> >> IV. Did you successfully complete your main reason for visiting this
> >> >> website today?
> >> >>
> >> >> 1) Yes, I was successful
> >> >> 2) I'm still completing my reason for visiting
> >> >> 3) No, I tried but wasn't successful
> >> >>
> >> >> You can see an example of what the survey looks like here:
> >> >>
> >> >> http://www.google.com/insights/consumersurveys/websat_example
> >> >>
> >> >> Adding it to the website is easy:  a single line added to the header.
> >> >>
> >> >> Regards,
> >> >>
> >> >> -Rob
> >> >>
> >> >> ---------------------------------------------------------------------
> >> >> To unsubscribe, e-mail: dev-unsubscribe@openoffice.apache.org
> >> >> For additional commands, e-mail: dev-help@openoffice.apache.org
> >> >>
> >> >>
> >> >
> >> >
> >> > --
> >> > ---
> >> > Gregory B. Zobel, Ph.D.
> >> > Assistant Professor of Educational Technology
> >> > MSEd Program Coordinator
> >> >
> >> > Western Oregon University
> >> > 345 N. Monmouth Ave
> >> > Monmouth, OR 97361
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: dev-unsubscribe@openoffice.apache.org
> >> For additional commands, e-mail: dev-help@openoffice.apache.org
> >>
> >>
> >
> >
> > --
> > ---
> > Gregory B. Zobel, Ph.D.
> > Assistant Professor of Educational Technology
> > MSEd Program Coordinator
> >
> > Western Oregon University
> > 345 N. Monmouth Ave
> > Monmouth, OR 97361
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@openoffice.apache.org
> For additional commands, e-mail: dev-help@openoffice.apache.org
>
>


-- 
---
Gregory B. Zobel, Ph.D.
Assistant Professor of Educational Technology
MSEd Program Coordinator

Western Oregon University
345 N. Monmouth Ave
Monmouth, OR 97361

--047d7b5d35b8758e3504ed47c429--