Tek-Tips is the largest IT community on the Internet today!

Members share and learn making Tek-Tips Forums the best source of peer-reviewed technical information on the Internet!

  • Congratulations bkrike on being selected by the Tek-Tips community for having the most helpful posts in the forums last week. Way to Go!

PHPDIG indexes remote sites not localhost

Status
Not open for further replies.

BiJae

Programmer
Oct 1, 2002
154
US
I'm a little perplexed. I've followed the installation instructions to get the program to work. I followed a thread on the PHP dig site that offered the following code to work with MySql 5.0

Code:
if ($pu['port'] == 0 || $pu['port'] == 80) {
 $pu['port'] = 0; 
} 
else 
   { settype($pu['port'],'integer');

After I put this change in place I ran the index on the localhost using the domain name. It failed as it had before. I then ran an index on a remote site I own. This time the index ran just as expected. Based on this information PHPDIG is working.

I've verified that the local server is configured according to the prerequisites, safe_mode = OFF, allow_url_fopen = ON.

When I put the url, localhost, IP address I get this response in under a second:

Spidering in progress... [Stop spider]
Optimizing tables...
Indexing complete ! [Back] to admin interface.

I'm not sure what I've configured wrong on my server. If some one can help me locate the problem I would appreciate it. My php info file is at
Thank you,


"If the only prayer you said in
your whole life was, 'thank you,'
that would suffice."
-- Meister Eckhart
 
when you say "using the domain name" does that mean "localhost" or the machinename@internaldomain.lan (i.e. internal FQDN) or an external domain name that points at your firewall?

are you CERTAIN that you have no firewall blocking EXTERNAL access to port 80 on your development box?
 
Thank you for your response.

I have tried with all, FQDN, interal IP address, External IP address, localhost.

The box that PHPDig resides on is the server that is hosting the website. All traffic from the outside is able to get to that box without firewall issues.


"If the only prayer you said in
your whole life was, 'thank you,'
that would suffice."
-- Meister Eckhart
 
do you have a robots.txt file that phpDig could be tripping up on?

anyway i see you have posted on phpDig's forum and that's probably the best place for you to seek advice.
 
I did have a robots text file. And the outcome was a little different after I renamed that file. This time I got the following message:
Code:
Spidering in progress... [Stop spider]

SITE : [URL unfurl="true"]http://www.tcud.state.tx.us/[/URL]
  Exclude paths : - @NONE@
Meta Robots = NoIndex, or already indexed : No content indexed
1:[URL unfurl="true"]http://www.tcud.state.tx.us/[/URL]
(time : 00:00:00)
No link in temporary table
links found : 0
...Was recently indexed
Optimizing tables...
Indexing complete !

The "no link in temporary table" caused me concern so I sent it out to index the remote site again. It ran as expected on the remote site.


"If the only prayer you said in
your whole life was, 'thank you,'
that would suffice."
-- Meister Eckhart
 
Status
Not open for further replies.

Part and Inventory Search

Sponsor

Back
Top