Industry Standard ETL Script Needed

[ajay234]

Hi,

I am new to perl and I have a need to upgrade myself evry quick to write ETL scrips for Sybase and oracle datawarehouse.

I know the basic of perls but need to see how professional ETL scripts look like.

Can anyone help me with information about free industry standard PERL script liinks?

Regards
Ajay

 

[Golan]

Just a thought: I have worked with Perl for ETL, but I considered it a wrong technical choice. When the data are big, Perl does not meet the performance of a binary program. Ok, you may say that the IO stuff is nearly as good in performance as in C, for instance, but when you speak of millions of rows that tiny amount of time sums up. And we had problems with memory limits: Perl 5.6.0 would not allow more than 2 Gb of data at least in our AIX. The idea was to load all lookup tables in a Perl hash. We tried some buffering, but Perl itself already has some buffer code and we couldn’t improve it significantly. You may try modules in CPAN like Memoize. I have worked with ETI*Extract, and it generates code that we compile and run, and I could easily compare the performance between them. Anyway, for small to intermediate amount of data, I think you could use Perl without of problems. Be careful with millions, though.