Survey on daily pains with requirements

What are your daily pains with requirements? A survey on problems with Requirements Engineering in the automotive domain

We, a group of researchers from Chalmers | University of Gothenburg in Sweden, are currently studying problems that occur in automotive Requirements Engineering. This means both during the elicitation of requirements and later on when using requirements for development, validation, etc.

In this context we are looking for people working at automotive companies (OEMs, Suppliers, Consultancies) who get into contact with requirements of any form. This could be requirements engineers, who are actually eliciting requirements, but also software or verification engineers, who implement or test based on requirements.

We will use the data to validate challenges previously extracted from qualitative interview data and complement them with quantitative data. The results will be compiled into a scientific publication.

The survey should not take more than 20 minutes to answer. It would be incredibly valuable for the scientific community if you could share your experiences with us! The survey starts on 7th July 2015 and ends on 7th September 2015.

Survey Link:

If you have any questions, feedback, or concerns, please feel free to contact:
Grischa Liebel, Matthias Tichy, or Eric Knauss
Software Engineering Division, Computer Science and Engineering
Chalmers & University of Gothenburg, Sweden

Questionnaires with Likert Scales Using SoSciSurvey and GNU R

In a recent post, I discussed different online questionnaire tools. My personal preference is still SoSci Survey, because it’s support for complex Likert scale questions, the good options for data export, and the support for reuse. In this post, I focus on visualizing results from the System Usability Scale (SUS) question block that is available in SoSci Survey. For this, I am using GNU R and the likert package.

Continue reading

Online Questionnaires

Questionnaires are a funny thing. Obviously, they are a great tool for researchers. They seem to be so simple. But it is really difficult to create a good one. Two years ago I tried an online questionnaire tool for the first time and I was impressed on how helpful it was.

First, the assistants and editors such tools provide allow to quickly create a questionnaire with a good layout of questions. Then, you get the results in a format that allow analysis even with little experience. You do not have to bother with setting up a webpage.

As a drawback, you have to find the right tool or service provider. And this proves to be difficult. There is all kinds of advertisements going on, service providers try to lure you with features you don’t need (in my case: Facebook integration) and make it almost impossible to discover that they do not offer features you do need as part of their basic plan, before you have created and posted your first questionnaire (in my case: export of the data as CSV or similar). Here are some of my experiences. Please let me know if there is more.

Further reading: How to questionnaire?

Wai-Ching Leung: How to design a questionnaire. These three pages are a great read. Leung provides a checklist with do’s and don’ts that quickly help to create and improve a first draft. It also includes some inspiration for longer thinking but might be to brief for real experts.

Idealware: A few good questionnaire tools. A good starting point for choosing a tool. I especially liked the discussion.

Where to do it

Google Docs: This is pretty straight forward. Just create a Google Form as a front-end to your Google spreadsheet. The questionnaire can be directly integrated into the email, it looks great and might be the best solution for a quick poll. From Google spreadsheets, you can do all the analysis you want to do and export the data in all possible formats. Maximum freedom, but limited support for more advanced types of questions.

Surveymokey: Google search gave me this tool as first result. It looks great. I love the question editor. I was able to create a nice questionnaire pretty quickly. What I do not like: I cannot export the data in the free plan and the restrictions (amount of responses, amount of questions) might actually be hurtful. I have to check if they offer free upgrades for education and not-for-profit research.

SurveyMoz: Extremely good price and lots of important things in the extreme plan. However, the data only exports to Microsoft Word in the free plan, which would be a no go. There is a free upgrade for educational and non-profit organizations, which mitigates this problem. Did not try to create a questionnaire yet, because apparently one cannot sign up with a Mac (Exception: Validation of viewstate MAC failed.)

SoGoSurvey: The new star among the questionnaire tools. It has a very reasonable free package and low prizes. My opinion: Has all the functionality I need, even in the free plan, but the editor is more complicated and not as straight forward as SurveyMonkey, without direct support for a set of questions with the same Likert-scale.

SoSciSurvey: This is the provider I made my good experience two years ago. Although this seems to be a German project, you can switch the language and create surveys in English, too. If I look on the page today, it looks a bit old-fashioned, but it is a solid tool, especially focused on the needs of university research. It has all the question types I need, excellent data export (e.g. to R), great examples. For example, you can integrate standard usability questions with one click. This is the tool I am currently recommending when asked by students.

Please let me know about your experiences!