massive is an understatement. I have only dealt with puny GB sized data sets. Th... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

mrcactu5 on Nov 16, 2016 | parent | context | favorite | on: Mining of Massive Datasets

massive is an understatement. I have only dealt with puny GB sized data sets. They deal with vectors which cannot fit into main memory.

infinitone on Nov 18, 2016 [–]

Yes, in general what they refer to are things like the IRS Tax records (250 TB), Yahoo Ad data (900 TB). You just can't use a single machine to work with such data.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact