I'm using vb6 to do some screen scraping of web pages. I'm using the MS XML 3.0 object reference and using this code to get the html:
The actual html if the page was retrieved in a browser, the character count with spaces is 95,607. The html returned in the above example cuts of at 65,xxx characters.
Does anyone know how to get around this limitation?
Code:
Dim HttpReq As New MSXML2.XMLHTTP
HttpReq.Open "Get", url, False
HttpReq.setRequestHeader "Content-Type", "application/x-[URL unfurl="true"]www-form-urlencoded"[/URL]
HttpReq.setRequestHeader "Referer", "192.168.1.1"
datatosend = ""
HttpReq.send datatosend
p_out = HttpReq.responseText
Does anyone know how to get around this limitation?