How do I process long web request?

[mileruiz]

Hi list.

I need to make a process in a python script that reads a file from disk and insert into a various tables of a database.

At the end of the process I need to generate a HTML page showing the user about the results.

That works ok if the data are small (lets say 100 or even 1000 records)
but sometimes the data can have over 30000 records and the web server
just timeout.

My first solution was try to make that process in background , using Threading but I cant exit the script that make that call ...and I would like
exit and then make another script that refreshes every certain time and
asks how many records has inserted.

I also have proved with spawnv(mode, path, args) but its the same. The script does not exit.

any ideas?

thanks.

 

[Guest_imported]

I had a similar problem ...

... I wanted to insert I guess about 10,000 records and the script seemed to timed out, but after a long long time the script returned poperly.
I guess it has to do with the database but I'm not quite sure.