
Researchers are using social media data to build a picture of the personalities of millions, changing core ideas of how psychological profiling works. They say it could revolutionise employment and commerce, but the work must be done transparently.
Researchers are using social media data to build a picture of the personalities of millions, changing core ideas of how psychological profiling works. They say it could revolutionise employment and commerce, but the work must be done transparently.
Your searches and statuses are all reflections of questions, experiences and emotions you have: all psychometric data. It鈥檚 the basis for a future where computers can truly interact with human beings
John Rust
In 2007, Dr David Stillwell built an application for an online networking site that was starting to explode: Facebook. His app, , allowed users to complete a range of psychometric tests, get feedback on their scores and share it with friends. It went viral.
By 2012, more than six million people had completed the test, with many users allowing researchers access to their profile data. This huge database of psychological scores and social media information, including status updates, friendship networks and 鈥楲ikes鈥, is the largest of its kind in existence. It contains the moods, musings and characteristics of millions 鈥 a holy grail of psychological data unthinkable until a few years ago.
Stillwell and colleagues at Cambridge鈥檚 provided open access to the database for other academics. Academic researchers from over 100 institutions globally now use it, producing 39 journal articles since 2011.
Meanwhile, the Cambridge Psychometrics team devised their own complex algorithms to read patterns in the data. Resulting publications caused media scrums, with a paper published in early 2015 generating nervous headlines around the world about computers knowing your personality better than your parents.
But how surprising is this really, given the amount we casually share about ourselves online every day? And not just through social media, but also through web browsing, internet purchases, and so on. Every interaction creates a trace, which all add up to a 鈥榙igital footprint鈥 of who we are, what we do and how we feel.
We know that, behind closed doors, corporations and governments use this data to 鈥榯arget鈥 us 鈥 our online actions mark us out as future customers, or even possible terrorists 鈥 and, for many, this reduction in privacy is a disturbing fact of 21st-century life.
探花直播Cambridge researchers believe that the new era of psychological 鈥榖ig data鈥 can be used to improve commercial and government services as well as furthering scientific research, but openness is essential.
鈥淚f you ask a company to make their data available for research, usually it will go to some corporate responsibility office which deems it too risky 鈥 there鈥檚 nothing in it for them. Whereas if you tell them you can improve their business, but as part of that they make some data available to the research community, you find a lot more open doors,鈥 says Stillwell, who co-directs the Centre.
Around half of the Centre鈥檚 current work involves commercial companies, who come to them for 鈥渟tatistical expertise combined with psychological understanding鈥 鈥 often in an attempt to improve online marketing, an area still in its infancy.
探花直播team has recently launched an interface called , based on the myPersonality results, which can be used as a marketing and research tool that turns digital 鈥榝ootprints鈥 into psycho-demographic profiles.
鈥淚f you use the internet you will be targeted by advertisers, but at the moment that targeting happens in the shadows and isn鈥檛 particularly accurate,鈥 says Vesselin Popov, the Centre鈥檚 development strategist.
鈥淲e all have to suffer advertising, so perhaps it鈥檚 better to be recommended products that we might actually want? Using opt-in anonymous personality profiling based on digital records such as Facebook Likes or Last.fm scores could vastly improve targeted advertising and allow users to set the level of data-sharing they are comfortable with,鈥 says Popov. 鈥淭his data could then, with the permission of users, be used to enrich scientific research databases.鈥
Measuring psychological traits has long been difficult for researchers and boring for participants, usually involving laborious questionnaires. This will sound familiar to anyone who has used an employment agency or job centre. 探花直播team are now building on their previous work with algorithms to take psychometric testing even further into uncharted territory 鈥 video games. Job centres might be the first to benefit.听 听
鈥淎 job centre gets about seven minutes with each job seeker every two weeks, so providing personalised support in that time is challenging,鈥 explains Stillwell. 鈥淲e are working with a company to build a game that measures a person鈥檚 strengths in a 鈥榞amified鈥 way that鈥檚 engaging but still accurate.鈥
In 鈥楯obCity鈥, currently an iPad proof of concept, users explore job opportunities in a simulated city. 探花直播game measures psychological strengths and weaknesses along the way, offering career suggestions at the end, and providing the job centre with feedback to help them guide the applicant. 探花直播team has tested the game with a group of under-25s and the results are promising.听听听听
For the Centre鈥檚 Director Professor John Rust, the team鈥檚 background in psychology means they don鈥檛 lose sight of the people within the oceans of data: 鈥淲e鈥檙e dealing with organisations that are using 鈥榖ig data鈥 to make actuarial decisions about who gets lent money, who gets a job 鈥 you don鈥檛 want this left solely to computer engineers who just see statistics.鈥 听
鈥淲e want machines that can recognise you as a person. Much of the information for doing that already exists in the servers of Google, Facebook, Amazon, and so on. Your searches and statuses are all reflections of questions, experiences and emotions you have: all psychometric data. It鈥檚 the basis for a future where computers can truly interact with human beings.鈥澨
Cyberspace has, for Rust, opened a 鈥楶andora鈥檚 box鈥 that鈥檚 taken psychological testing to a new level. But, he says, the current explosion in big data bears comparison to a previous shift that happened a century ago 鈥 the advent of IQ tests shortly before the First World War. Millions of servicemen were tested to determine role allocation within the military. Suddenly, says Rust, overexcited scientists had massive psychological datasets. IQ tests influenced societies long after the war, leading he says to some of the most shameful episodes of the 20th century including scientific racism and sterilisation of the 鈥榝eebleminded鈥.
鈥淭oday you have another psychological big data situation being used to challenge a perceived global threat: terrorism. Government data scientists hunting would-be terrorists are enthusiastically adopting big data, but there will be social consequences again. In many ways, we already have Big Brother 鈥 whatever that now means,鈥 Rust says.
鈥 探花直播new psychological data revolution needs serious research, and ethical debates about it need to be happening in the public arena 鈥 and they鈥檙e not. We have a responsibility to say to people working on this in secret in companies and institutions: 鈥榊ou鈥檝e got to come and discuss this in an open place鈥. It鈥檚 what universities are for.鈥
Inset images:听Facebook's Infection (); Dr David Stillwell, Professor John Rust and Vesselin Popov ( 探花直播 of Cambridge).
探花直播text in this work is licensed under a . For image use please see separate credits above.