Let me start by saying that I am aware that several similar-sounding questions have been asked, but I have reviewed the answers supplied in all of those I could find and none of them appear to me to apply to my particular case.
I have a very large file in a format that I can not read or work with (Stata .dta). I have conversion software to get it into R (haven) But the file is too big to put in my RAM (about 30 GB). So I want to post a question about some way of breaking in into pieces and loading it piecewise into R, and thence into a database.
However, I do not know how to make a reproducible example for this. It seems like a would need a copy of Stata to subset the original file. I could read a set of lines and output the lines, maybe, but I don't think this preserves the header information regarding, e.g., factor levels.
What should one do in such a case? If I can somehow break off a piece of more reasonable size, is there a way to upload it so that someone who wants to help can get at it? Is a dropbox link acceptable in this very specific set of circumstances? Should I try to find some arbitrary small Stata file, with no guarantee that the data is similar to my data?
ulimit -m
andulimit -v
respectively) to get the same effect.