CGI/Perl Guide | Learning Center | Forums | Advertise | Login
Site Search: in

  Main Index MAIN
INDEX
Search Posts SEARCH
POSTS
Who's Online WHO'S
ONLINE
Log in LOG
IN

Home: Perl Programming Help: Beginner: Re: [Dhamma] Reading Huge .csv and searching it: Edit Log



7stud
Enthusiast

Jan 31, 2013, 8:55 AM


Views: 944
Re: [Dhamma] Reading Huge .csv and searching it


Quote
Will PERL be able to read .csv files of a week with one line full of measurements per per second and generate a monthly report?

One of perl's strengths is reading text and matching it against regular expressions. When a computer programmer talks about a 'huge' file, they might mean a file with over something like 5GB of data or roughly 75 million lines. A "big" file might be 1GB or roughly 15 million lines. A 600,000 line file is not trivial, but it is certainly not 'huge'.

It's faster to read the whole file into memory, then process it. However, for files that are larger than your computer's memory, you need to read the file line by line. You might start off by writing code that reads a file line by line. After you finish your program, you can benchmark your program and if you find you need more speed, you can look for ways to make your code faster.


(This post was edited by 7stud on Jan 31, 2013, 9:02 AM)


Edit Log:
Post edited by 7stud (Enthusiast) on Jan 31, 2013, 8:58 AM
Post edited by 7stud (Enthusiast) on Jan 31, 2013, 9:01 AM
Post edited by 7stud (Enthusiast) on Jan 31, 2013, 9:02 AM


Search for (options) Powered by Gossamer Forum v.1.2.0

Web Applications & Managed Hosting Powered by Gossamer Threads
Visit our Mailing List Archives