Skip to main content
corrected spelling, unless I am misunderstanding a pun
Source Link
Suragch
  • 510.1k
  • 10
  • 52
  • 75

Actually, I miss understandmisunderstand your question:

How to create a reproducible example when converting a very large file I am unable to manipulate directly?

Miss-leadingMisleading me. My first answer was just focus about "How to create a reproducible example when converting a very large file", my brain just skip the rest because this is impossible. You can't ask how to convert a file to something without be able to manipulate directly. So, I just somehow ignore the end of your sentence.

Actually, I don't see any problem to just ask "a question about some way of breaking in into pieces and loading it piecewise into R" without any MCVE.

Actually, I miss understand your question:

How to create a reproducible example when converting a very large file I am unable to manipulate directly?

Miss-leading me. My first answer was just focus about "How to create a reproducible example when converting a very large file", my brain just skip the rest because this is impossible. You can't ask how to convert a file to something without be able to manipulate directly. So, I just somehow ignore the end of your sentence.

Actually, I don't see any problem to just ask "a question about some way of breaking in into pieces and loading it piecewise into R" without any MCVE.

Actually, I misunderstand your question:

How to create a reproducible example when converting a very large file I am unable to manipulate directly?

Misleading me. My first answer was just focus about "How to create a reproducible example when converting a very large file", my brain just skip the rest because this is impossible. You can't ask how to convert a file to something without be able to manipulate directly. So, I just somehow ignore the end of your sentence.

Actually, I don't see any problem to just ask "a question about some way of breaking in into pieces and loading it piecewise into R" without any MCVE.

Post Undeleted by Stargateur
deleted 148 characters in body
Source Link
Stargateur
  • 26.6k
  • 13
  • 25

The solution is simple to meActually, just create a very small exemple file of your format. You don't need to have 30 Go to have a reproductive format file. Just create one exemple that fit into the minimal ofI miss understand your format file.question:

How to create a reproducible example when converting a very large file I am unable to manipulate directly?

For exemple, take a BJSON file,Miss-leading me. My first answer was just focus about "How to create a BIG dump ofreproducible example when converting a very big databaselarge file", hundred of Gomy brain just skip the rest because this is impossible. You can't post it anywhere and nobody will download it justask how to answer you. But you can easily remove all data and just createconvert a sample with one entry for each of the table, and everyone could reproduce itfile to something without problembe able to manipulate directly.

  So, you must provide a file that match withI just somehow ignore the formatend of your original file, but keep the minimal of data in itsentence. And you will finish with a very small file

Actually, and you couldI don't see any problem to just ask your"a question about how handle this file ifsome way of breaking in into pieces and loading it will be 30 Gopiecewise into R" without any MCVE.

The solution is simple to me, just create a very small exemple file of your format. You don't need to have 30 Go to have a reproductive format file. Just create one exemple that fit into the minimal of your format file.

For exemple, take a BJSON file, a BIG dump of a very big database, hundred of Go. You can't post it anywhere and nobody will download it just to answer you. But you can easily remove all data and just create a sample with one entry for each of the table, and everyone could reproduce it without problem.

  So, you must provide a file that match with the format of your original file, but keep the minimal of data in it. And you will finish with a very small file, and you could ask your question about how handle this file if it will be 30 Go.

Actually, I miss understand your question:

How to create a reproducible example when converting a very large file I am unable to manipulate directly?

Miss-leading me. My first answer was just focus about "How to create a reproducible example when converting a very large file", my brain just skip the rest because this is impossible. You can't ask how to convert a file to something without be able to manipulate directly. So, I just somehow ignore the end of your sentence.

Actually, I don't see any problem to just ask "a question about some way of breaking in into pieces and loading it piecewise into R" without any MCVE.

Post Deleted by Stargateur
Source Link
Stargateur
  • 26.6k
  • 13
  • 25

The solution is simple to me, just create a very small exemple file of your format. You don't need to have 30 Go to have a reproductive format file. Just create one exemple that fit into the minimal of your format file.

For exemple, take a BJSON file, a BIG dump of a very big database, hundred of Go. You can't post it anywhere and nobody will download it just to answer you. But you can easily remove all data and just create a sample with one entry for each of the table, and everyone could reproduce it without problem.

So, you must provide a file that match with the format of your original file, but keep the minimal of data in it. And you will finish with a very small file, and you could ask your question about how handle this file if it will be 30 Go.