Datagrid - loading/saving large datasets as xml

[jcisco2]

I'm having issues on reading in large amounts of data (about 713,162 KB) into a dataset. When I try to it takes a really long time to load, and i get an out of memory exception. Is there better way to view large datasets offline? This data is sales data thus the size.

'gl vars
 Private dSet As New DataSet

'save button 
 dSet.WriteXml("c:\offline.xml")
...

'load button
 dSet.ReadXml("c:\offline.xml")
            MsgBox("done")
            Me.UlGrid1.DataSource = dSet
            Me.UlGrid1.DataBind()

cheers,

 

[cjelec]

I am having the same problem for ages,

The DataSet needs to read the hole xml file to be able to understand the structure of the database.

The only thing that i could think of (wouldn't solve my problem), is to split the dataset up. But this is not very practicle in most situations.

Have you looked a Binary Serialization?
It can be a little faster.

 

[jcisco2]

thanks for the info. Here is what I went with. I'm now storing a large sub set of my data in excel (right now it's like 30,000 rows. Think excel has a max row size of ~63,000+ rows. Then I query off excel via a OleDbDataAdapter this works very fast over the xml.

Cheers.