Mar 7, 2015, 3:25 PM
Post #6 of 17
Re: [BillKSmith] Open file command with Sort and sub function call
[In reply to]
Your step 3 sends the data to the sort program. It cannot do anything until it has all the data.
Hmm, I understand what you mean, but I think this is not really accurate, or not accurately phrased. The correct sentence would be, I think: "It cannot output anything until it has all the data."
I am using the Unix sort utility together with Perl programs very regularly, with huge data sets (very often tens of GB). And, monitoring the temporary directory for work files, I know it starts to do a lot of things before having the whole data. But of course, you are absolutely right that a sort program cannot start spitting out data before it has seen the entire output.