Hi there,
I am trying to clean my data at the moment.
So far, I´ve looked for straighlining within the choice tasks and other survey questions and also for speeders who spend less than 3 seconds on one choice task. Furthermore, I took a look at suspicious answers to open qualitative questions in the survey.
Is that approach sufficient or would you recommend any other analysis to find "bad respondents"? Also hints on helpful literature on this topic are very welcome.
Thank you very much in advance,
Best regards,
Patrick
Important: Read this before posting to this forum
- This forum is for questions related to the use of Apollo. We will answer some general choice modelling questions too, where appropriate, and time permitting. We cannot answer questions about how to estimate choice models with other software packages.
- There is a very detailed manual for Apollo available at http://www.ApolloChoiceModelling.com/manual.html. This contains detailed descriptions of the various Apollo functions, and numerous examples are available at http://www.ApolloChoiceModelling.com/examples.html. In addition, help files are available for all functions, using e.g. ?apollo_mnl
- Before asking a question on the forum, users are kindly requested to follow these steps:
- Check that the same issue has not already been addressed in the forum - there is a search tool.
- Ensure that the correct syntax has been used. For any function, detailed instructions are available directly in Apollo, e.g. by using ?apollo_mnl for apollo_mnl
- Check the frequently asked questions section on the Apollo website, which discusses some common issues/failures. Please see http://www.apollochoicemodelling.com/faq.html
- Make sure that R is using the latest official release of Apollo.
- Users can check which version they are running by entering packageVersion("apollo").
- Then check what is the latest full release (not development version) at http://www.ApolloChoiceModelling.com/code.html.
- To update to the latest official version, just enter install.packages("apollo"). To update to a development version, download the appropriate binary file from http://www.ApolloChoiceModelling.com/code.html, and install the package from file
- If the above steps do not resolve the issue, then users should follow these steps when posting a question:
- provide full details on the issue, including the entire code and output, including any error messages
- posts will not immediately appear on the forum, but will be checked by a moderator first. This may take a day or two at busy times. There is no need to submit the post multiple times.
Data cleaning
-
- Site Admin
- Posts: 1049
- Joined: 24 Apr 2020, 16:29
Re: Data cleaning
Patrick
removing people arbitrarily according to straightlining or speeding is bad practice. These people might still be behaving rationally. There is ample literature guidance on this. Much better to look at why someone might be behaving in a certain way, and see how you can accommodate them in a model
Stephane
removing people arbitrarily according to straightlining or speeding is bad practice. These people might still be behaving rationally. There is ample literature guidance on this. Much better to look at why someone might be behaving in a certain way, and see how you can accommodate them in a model
Stephane
Re: Data cleaning
Dear Stephane,
thank you for this important advice.
Though, it might be the same with irrational respondents (not answering two same fixed choice tasks in the same way), isn´t it?
So not deleting them from the sample just because they failed the test for completeness axiom?
Thank you very much.
thank you for this important advice.
Though, it might be the same with irrational respondents (not answering two same fixed choice tasks in the same way), isn´t it?
So not deleting them from the sample just because they failed the test for completeness axiom?
Thank you very much.
-
- Site Admin
- Posts: 1049
- Joined: 24 Apr 2020, 16:29
Re: Data cleaning
The key job for the modeller here is to judge whether the behaviour is in line with RUM or not
Re: Data cleaning
Are there any specific guidelines how this can be judged or any papers you can recommend on dealing with inconsistent respondents?
-
- Site Admin
- Posts: 1049
- Joined: 24 Apr 2020, 16:29
Re: Data cleaning
Patrick
a long time ago, I wrote this paper: https://doi.org/10.1016/j.trd.2010.04.008
There are probably many others now
This is in terms of "inconsistent" responses. For people that are very fast or very slow, my recommendation is always to first see whether these people actually behave differently from others
Stephane
a long time ago, I wrote this paper: https://doi.org/10.1016/j.trd.2010.04.008
There are probably many others now
This is in terms of "inconsistent" responses. For people that are very fast or very slow, my recommendation is always to first see whether these people actually behave differently from others
Stephane