Liam, you're right, any kind of whitespace is a delimiter by default for streamtokeniser (from the doc : The stream tokenizer is initialized to the following default state : ... All byte values '\u0000' through '\u0020' are considered to be white space. )
Everyone, can you help ? because i **don't** want the whitespace to be a delimiter - i want the "," to be - and i want the white spaces as parts of the "words" i get
(a line in my file looks like : "the name, the surname, the adress ..." and i don't want to get : "the/name/the/surname..." )
i've tried (st here is a streamtokenizer) :
st.quoteChar(',');
or st.whitespaceChars(',', ',');
to declare that the "," should be a delimiter and this is fine
st.wordChars(' ', ' ');
to declare that the whitespace should be part of the "tokens" but it doesn't seem to be working ...
so then i've add (before) the : st.resetSyntax() but it resets so well that i get each single char as a token :-(
i'm sure it's an easy and quick thing to do but i just can't figure out how to
oh and i've tried to modify the source file as "the name", "the surname", ... but then i get only ", ", " ...