CGI/Perl Guide | Learning Center | Forums | Advertise | Login
Site Search: in

  Main Index MAIN
INDEX
Search Posts SEARCH
POSTS
Who's Online WHO'S
ONLINE
Log in LOG
IN

Home: Perl Programming Help: Advanced:
framework for data parsing

 



sardare
New User

Jun 19, 2008, 6:56 PM

Post #1 of 4 (1670 views)
framework for data parsing Can't Post

Hi,

I need to parse data from many data sources which provide their data files in different formats along with a specification to parse the data. The data gets parsed into different formats as required by our systems. So there is:

- Input data
- Parse Specification
- Output format
- Output data

The specification looks something like --
fieldA is from character 9 to 14 or field B is ...

The files are all text files.

Since this seems to be a common problem, I am wondering if there is a small framework out there I could use for this purpose. I can extend it to adapt to my own problems. But the idea is to make this as extensible and manageable as possible since there can be new data sources, change in specification or new specification, and change in output format.

Any suggestions are most welcome.

thank you,
Sam


KevinR
Veteran


Jun 19, 2008, 7:47 PM

Post #2 of 4 (1666 views)
Re: [sardare] framework for data parsing [In reply to] Can't Post

I'm pretty sure there is but I don't know the name of the module or modules. Ask on www.perlmonks.com and you will hopefully get some suggestions.
-------------------------------------------------


sardare
New User

Jun 21, 2008, 12:48 PM

Post #3 of 4 (1622 views)
Re: [KevinR] framework for data parsing [In reply to] Can't Post


In Reply To
I'm pretty sure there is but I don't know the name of the module or modules. Ask on www.perlmonks.com and you will hopefully get some suggestions.

]

Nope no reply yet... what happened to the vibrant perl community :)

are other languages taking over?


KevinR
Veteran


Jun 21, 2008, 1:58 PM

Post #4 of 4 (1616 views)
Re: [sardare] framework for data parsing [In reply to] Can't Post

There is Parse::RecDescent but it is a rather complex module (at least to me it is) to use. If your files are all fixed-length records you can use pack/unpack or look into Parse::FixedLength. I'm sure there are many more Parse modules, you can search CPAN and sift through them.
-------------------------------------------------

 
 


Search for (options) Powered by Gossamer Forum v.1.2.0

Web Applications & Managed Hosting Powered by Gossamer Threads
Visit our Mailing List Archives