Shock: Big Data Sellers Fail To Hide Personal Information

Big data
Please Share This Story!

When money is at stake, all caution and safeguards are thrown to the wind. These ‘big data sellers’ are charlatans and their actions are patently illegal and unconstitutional. Technocrats don’t care about those kind of details.  TN Editor

The “alternative data” industry, which sells information such as app downloads and credit card purchases to investment groups, is failing to adequately erase personal details before sharing the material, according to several hedge funds.

The rapidly growing world of big data is seen as an increasingly attractive source of information for asset managers seeking a vital investment edge, with data providers selling everything from social media chatter and emailed receipts to federal lobbying data and even satellite images from space. But several hedge funds say some vendors are selling information that still contains sensitive personal information that could be used to identify individuals.

“The vendors claim to strip out all the personal information, but we occasionally find phone numbers, zip codes and so on,” said Matthew Granade, chief market intelligence officer at Steven Cohen’s Point72. “It’s a big enough deal that we have a couple of full-time tech people wash the data ourselves.”

The head of another major hedge fund said that even when personal information had been scrubbed from a data set, it was far too easy to restore. “We were shocked at how easy it was to de-anonymise the data,” he said. “It took one of my analysts 30 minutes to discover someone who was probably having an affair.”

Sophisticated algorithmic approaches such as “machine learning” allow money managers to sift through enormous data sets for profitable patterns. Tabb Group, a consultancy, estimates that in the US alone, spending on big data will double in the next five years to $400m, while CB Insights, a data provider, has counted at least 30 start-ups in the field.

Read full story here…

Notify of
Inline Feedbacks
View all comments