Opportunities and Challenges in Internet Research
Posted on April 26, 2006
Robert Kraut (bio) discusses the benefits of online research and some of the differences between online research and traditional research.
By conducting research online, the researcher gives up some control of the research environment. The researcher has a much harder time verifying subjects' identities online and has more difficulty monitoring and/or intervening with the participants. Multiple submissions from participants can be a concern, but some of that can be prevented by assigning unique identifiers to invited participants and tracking Internet protocol (IP) addresses. Also, researchers should examine incoming data for inconsistent data patterns.
Assessing whether the research is human subjects research or what types of regulations apply requires the researcher to clarify some basic terms such as anonymous, public behavior, and preexisting data for use in online research.
First, researchers need to address what makes a person identifiable or anonymous. Anonymity is not so complicated an issue with online surveys, but it becomes a more ambiguous concept when one wants to observe naturally occurring behavior online. Researchers cannot assume that pseudonyms make conversations anonymous because pseudonyms may contain real names or identifying information, and quoted sections can often be linked back to the original poster through search engines. To truly keep participants anonymous, researchers need to alter pseudonyms and any quoted text.
Second, researchers have to determine when online behavior can be regarded as public behavior. Private communication such as emails or instant messaging between individuals is protected communication. Online forums can usually be treated as public areas, but there are many factors to consider when determining the status of online communications. What are the applicable legal regulations? What are the social norms of the group? Is membership restricted or open? Is the membership relatively static, or is there frequent turnover? Are conversations archived? Does the forum have explicit recording policies?
Third, researchers need to clearly define preexisting public data because research involving the collection of that data is exempt from federal human-subjects regulations. To be classified as preexisting, all of the data must exist prior to the beginning of the research, so entries in an ongoing online journal or live discussion group cannot be considered preexisting.
The more likely source for risk in Internet research involves breaches of confidentiality. Data in transit such as email between a participant and researcher can be vulnerable, and data also needs to be stored securely. Identifying information needs to be stored in separate files away from the data, and researchers should protect directories containing data so that only researchers and their staff have access.
Another critical issue involves vulnerable populations, especially children. In Internet research, it is difficult to identify whether a potential participant is a child. If you want to include only adults in your study, there are certain actions you can take to discourage children from participating. For example, you can create displays that do not appeal to children, advertise in sites that children do not frequent, ask participants for their date of birth, or ask them for some identifying information that children are unlikely to have.
Based on published article and personal communication with the researcher in March 2006. Kraut, R. E., Olson, J., Manaji, M., Bruckman, A., Cohen, J., & Couper, M. (2003). Psychological research online: Opportunities and challenges. American Psychologist, 59(2), 105-117.
Please note that the feedback is viewed only by 4researchers staff and is not intended for communication with individual contributors.
Use the form below to submit feedback about this article. If you would like a response, please be sure to include your e-mail address.