Submitted by: Jan Wijffels; Assigned to: Nobody; R-Forge link
In my day-to-day settings I use ff because the computers I'm working on have RAM limitations. In order to allow to write a function like fread.ffdf which imports a file through fread in an ffdf, it should be possible with fread to allow to pass a connection - like what is possible in read.table - so that that fread.ffdf function can read in parts of the file in chunks and add it to the ffdf.
Would it be possible to allow fread to pass a file connection instead of only a path?
Submitted by: Jan Wijffels; Assigned to: Nobody; R-Forge link
In my day-to-day settings I use ff because the computers I'm working on have RAM limitations. In order to allow to write a function like fread.ffdf which imports a file through fread in an ffdf, it should be possible with fread to allow to pass a connection - like what is possible in read.table - so that that fread.ffdf function can read in parts of the file in chunks and add it to the ffdf.
Would it be possible to allow fread to pass a file connection instead of only a path?