Hey!
I have tried to run the sample dgrep application on a file with 100MB size and my laptop has crashed. Is there any limit or recommended value as to the size of a file for mapreduce in skynet? I ask this because I will have files with GB size to run some reports on. Is there anything like HDFS for hadoop and GFS for google in skynet? Otherwise, won't disk IO be a possible issue with skynet?
-keyo
|