HighTechTalks DotNet Forums  

High Performance Xml parser

Dotnet Framework (Compact Framework) microsoft.public.dotnet.framework.compactframework


Discuss High Performance Xml parser in the Dotnet Framework (Compact Framework) forum.



Reply
 
Thread Tools Search this Thread Display Modes
  #1  
Old   
rony_16
 
Posts: n/a

Default High Performance Xml parser - 11-27-2006 , 12:15 PM






Hi,
I am looking for component which allows me to parse my xml file.
the reason i am asking this, is because my xml files are huge it can
reach as far as 1GB more or less.
the time to parse such a file is something like 5 Hours.
Now i am using the XmlRead, XmlNode ... (I do not load the file to the
memory).
Can you suggest better components to use?

** I tried SAX but i couldn't understand how it works, because there is
no examples for .net , and very bad documentation.
p.s : I am writing in C#.

Regards, Rony


Reply With Quote
  #2  
Old   
Ilya Tumanov [MS]
 
Posts: n/a

Default Re: High Performance Xml parser - 11-27-2006 , 03:12 PM






As soon as XML size is above ~2 MB (SQL Mobile footprint) it's time to get
rid of XML and use SQL Mobile to store data.

Also keep in mind devices just don't have enough power to process XML this
big; most powerful devices are probably comparable in power to Pentium 100
PCs from early 90s:



http://groups.google.com/group/micro...b5c31829c3affc




--
Best regards,

Ilya

This posting is provided "AS IS" with no warranties, and confers no rights.

*** Want to find answers instantly? Here's how... ***

1. Go to
http://groups-beta.google.com/group/...mework ?hl=en
2. Type your question in the text box near "Search this group" button.
3. Hit "Search this group" button.
4. Read answer(s).

"rony_16" <rony.vainblat (AT) gmail (DOT) com> wrote

Quote:
Hi,
I am looking for component which allows me to parse my xml file.
the reason i am asking this, is because my xml files are huge it can
reach as far as 1GB more or less.
the time to parse such a file is something like 5 Hours.
Now i am using the XmlRead, XmlNode ... (I do not load the file to the
memory).
Can you suggest better components to use?

** I tried SAX but i couldn't understand how it works, because there is
no examples for .net , and very bad documentation.
p.s : I am writing in C#.

Regards, Rony




Reply With Quote
  #3  
Old   
 
Posts: n/a

Default Re: High Performance Xml parser - 11-28-2006 , 03:31 AM



CPU-wise a 600MHz PXA270 beats an AMD 600MHz
hands down. The problem is I/O speed (disk)
-- very slow on every PPC I've ever seen.
And using lousy code (it only takes one slow
layer - xml is only the first (lousy) layer).

Quote:
big; most powerful devices are probably comparable in power to Pentium 100
--
40th Floor - Software @ http://40th.com/
iPlay : the ultimate audio player for mobiles
mp3,mp4,m4a,aac,ogg,wma,flac,wav, play+record
parametric eq, xfeed, reverb; all on a mobile


Reply With Quote
  #4  
Old   
Mike Margerum
 
Posts: n/a

Default Re: High Performance Xml parser - 11-29-2006 , 05:24 PM



its pretty simple to build a non validating xml parser. just look for
the < and </ tags and fire off events when you find them. there is much
less memory overhead than a dom parser.
rony_16 wrote:
Quote:
Hi,
I am looking for component which allows me to parse my xml file.
the reason i am asking this, is because my xml files are huge it can
reach as far as 1GB more or less.
the time to parse such a file is something like 5 Hours.
Now i am using the XmlRead, XmlNode ... (I do not load the file to the
memory).
Can you suggest better components to use?

** I tried SAX but i couldn't understand how it works, because there is
no examples for .net , and very bad documentation.
p.s : I am writing in C#.

Regards, Rony


Reply With Quote
Reply




Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.4
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.