1IT ENTERPRISE
Big Data’s delimited by ‘Streetlight Effect’

Big Data’s delimited by ‘Streetlight Effect’

Big Data’s delimited by ‘Streetlight Effect’Big data offers us a window on the world. But large and easily available datasets may not show us the world we live in. For instance, epidemiological models of the recent Ebola epidemic in West Africa using big data consistently overestimated the risk of the disease’s spread and underestimated the local initiatives that played a critical role in controlling the outbreak.

Researchers are rightly excited about the possibilities offered by the availability of enormous amounts of computerized data. But there’s reason to stand back for a minute to consider what exactly this treasure trove of information really offers. Ethnographers use a cross-cultural approach when they collect data because family, marriage and household mean different things in different contexts.

We’ve all heard the joke about the drunk who is asked why he is searching for his lost wallet under the streetlight, rather than where he thinks he dropped it. “Because the light is better here,” he said.This “streetlight effect” is the tendency of researchers to study what is easy to study. I use this story in my course on Research Design and Ethnographic Methods to explain why so much research on disparities in educational outcomes is done in classrooms and not in students’ homes. Children are much easier to study at school than in their homes, even though many studies show that knowing what happens outside the classroom is important. Nevertheless, schools will continue to be the focus of most research because they generate big data and homes don’t.

The streetlight effect is one factor that prevents big data studies from being useful in the real world, especially studies analysing easily available user-generated data from the Internet. Researchers assume that this data offers a window into reality. But you have to have the eye to see it.

leave a reply

USA

2950 North Loop West Suite 500 Houston TX – 77092

+1 (832) 426-2567

editor@1itenterprise.com

ACCOUNTING & MAILING

Level 2, Prestige Omega, No. 104, EPIP Zone, Whitefield Bangalore – 560066 Karnataka

+91 70226 09430

lakshmi.narayana@1itenterprise.com

Newsletter

1IT Enterprise a Technology Magazine which is focused on bridging the gap between Enterprises World and the insights based on success stories of established entrepreneurs.

Follow Us

Back to Top