CGI/Perl Guide | Learning Center | Forums | Advertise | Login
Site Search: in

  Main Index MAIN
Search Posts SEARCH
Who's Online WHO'S
Log in LOG

Home: Perl Programming Help: Beginner: Re: [Dhamma] Reading Huge .csv and searching it: Edit Log


Jan 31, 2013, 8:55 AM

Views: 1880
Re: [Dhamma] Reading Huge .csv and searching it

Will PERL be able to read .csv files of a week with one line full of measurements per per second and generate a monthly report?

One of perl's strengths is reading text and matching it against regular expressions. When a computer programmer talks about a 'huge' file, they might mean a file with over something like 5GB of data or roughly 75 million lines. A "big" file might be 1GB or roughly 15 million lines. A 600,000 line file is not trivial, but it is certainly not 'huge'.

It's faster to read the whole file into memory, then process it. However, for files that are larger than your computer's memory, you need to read the file line by line. You might start off by writing code that reads a file line by line. After you finish your program, you can benchmark your program and if you find you need more speed, you can look for ways to make your code faster.

(This post was edited by 7stud on Jan 31, 2013, 9:02 AM)

Edit Log:
Post edited by 7stud (Enthusiast) on Jan 31, 2013, 8:58 AM
Post edited by 7stud (Enthusiast) on Jan 31, 2013, 9:01 AM
Post edited by 7stud (Enthusiast) on Jan 31, 2013, 9:02 AM

Search for (options) Powered by Gossamer Forum v.1.2.0

Web Applications & Managed Hosting Powered by Gossamer Threads
Visit our Mailing List Archives