Bulkloading Performance Question 1

[biggusdeeus]

This is one of those "depends" questions, but I need a general idea for reference; Customer complains that 7,888 objects take 9 min 30 secs to load. That translates to .072 seconds per object. Using the same load file, I can only get 1.8 sec per object. I assume the difference is mostly with the hardware, checking on that. However, .072 sec per object seems really good to me, even with great hardware and an efficient Oracle configuration.

Opinions?

 

[sem]

Do you mean loading with sql*loader?

Regards, Dima

http://seminihin.narod.ru

 

[biggusdeeus]

Hi Dima. Actually, it's our s/w interface to sql - I was just needing a point of reference, you know the customer will always want something faster. But there is a big difference between my 1.8 sec per object and their .072 sec per object (~ 13 objects per second). I am inclined to tell them there's not much room for improvement, but I don't know that. Have you seen faster performance? Although it would not be comparing apples to apples, is it possible to see 50 or 100 objects processed per second? more?

 

[sem]

Unfortunately I don't know how your tool works so can not provide any references.
BTW do you really just insert 1 record per 1.8 second? Do you have complex triggers or foreign keys referencing huge tables?

Regards, Dima

http://seminihin.narod.ru

 

[biggusdeeus]

Well, I was not asking specific for our tools, just for any bulkloader. But to answer your question - I don't know about complex triggers or foreign keys - I don't think so. But we don't have huge tables. There are a lot of relationships ...

 

[sem]

You may check for rollback issues or even consider direct loads. But 7,888 records should be loaded within a few seconds on a properly configured system with adequate hardware. Of course this assumes you're not loading 7,888 movies

Regards, Dima

http://seminihin.narod.ru