Does your server have enough memory RAM?

Here is the code sample

	long ll_start_record,il_batc_record,ll_cnt,ll_end_record,il_column_count
	il_batc_record=100
	il_column_count = long(dw_import.Object.datawindow.Column.Count)
	DO while ll_error <> - 1
		ll_cnt++
		
		if ib_stop = true then
			ll_batches = ll_cnt -1
			exit
		end if
		/*Getting Start Record*/
		ll_start_record = (il_batc_record* (ll_cnt - 1))+1
		
		/*Getting End Record */
		ll_end_record = il_batc_record*ll_cnt

		/*Resetting the Data window before inserting the records*/
		dw_import.reset()
		
		/*Importing the records into data window based on the batches*/
		ll_error = dw_import.ImportFile('import.txt' , ll_start_record,ll_end_record,1, il_column_count, 1)
	 
	 	/*If file Reaches  the end of the line than exits from the loop*/
		if ll_error < 0 then
			If ll_error = -2 then
				MessageBox("Oops","Empty File Found")
				exit
			else
				ll_batches = ll_cnt -1
				exit
			end if
		end if
		/*some validation and data setting to update dw goes here */
		/* update the data to database */
	loop

check the PS time out settings.

 if you want to run it in PS, make sure the process commits while processing.  so if you are importing 50000 items, each of which is a separate thing, then do a commit for each of them, rather than load all 50,000 and then commit at the end.  If you wait to commit until the entire file is processed then it will often time out.

also, if you are doing a lot of validation of the data by retrieving data from the server, that will slow things down.  look into caching that data.  review the processing in general you should be able to get it to run faster by changing up some of these things. 

Ultimately running it on a server as Chris suggested is the fastest way to process.   You are doing a large volume of transactions so uploading the file to a machine local to the database will always be the fastest.  You can write your own, along with a console application.  or you can look into using  Topwiz Software - TopwizWeb (topwizprogramming.com)  to do it all in PB.

Hi. Narayana ; 

  Suggestion:  I would change the system design to FTP these external files over to your server. Then run your PB import App as a C/S application on the DB server connecting directly to the DBMS as before. That way, the high volume interaction could use native DB client connectivity for exponentially better performance. 

Food for thought. 

Regards ... Chris 

Try FileReadEx() ?

Try creating a datawindow and use ImportFile() ?

Try creating a macro in Excel that inserts the data into a database ?