"Check With Another Proxy When Crawling Failed" is broken

Discuss about Seo Panel Bugs and Issues

Moderators: sendtogeo, hellow0rld, eugene

"Check With Another Proxy When Crawling Failed" is broken

Postby v1ktor » Wed Sep 24, 2014 1:09 pm

This is for 3.6.0 version. In Proxy settings, there's an option to turn on "Check With Another Proxy When Crawling Failed".
But, in my tests, when crawling for keyword ranking fails (regex error or captcha found error), SEO panel stops. It does not
go to the next proxy automatically.

It should automatically try next proxy, and next proxy, and next proxy until it is successful or ALL proxies fail.

Thanks.
v1ktor
 
Posts: 6
Joined: Thu Sep 13, 2012 12:32 pm

Re: "Check With Another Proxy When Crawling Failed" is broke

Postby seopanel_forum » Wed Sep 24, 2014 8:14 pm

Thanks for finding this and we will fix it in seo panel 3.7.0

Currently if crawl failed with out returning any data, new proxy will be taken and executed it again.

For current version <= 3.6.0, you can fix it by following steps

File: seopanel/controllers/report.ctrl.php
Line: 694

Add following line of code

Code: Select all
// if proxy enabled if crawl failed try to check next proxy
      if (SP_ENABLE_PROXY && CHECK_WITH_ANOTHER_PROXY_IF_FAILED) {
         if ($proxyInfo = $proxyCtrler->getRandomProxy()) {
            $crawlResult = $this->crawlKeyword($keywordInfo, $seId, $cron, $removeDuplicate);      
         }
      }


Please update here it fixed your issues or not.
Thanks,
Seo Panel Team
http://www.seopanel.in
seopanel_forum
Site Admin
 
Posts: 1378
Joined: Sat Apr 17, 2010 6:42 pm
Location: India

Re: "Check With Another Proxy When Crawling Failed" is broke

Postby v1ktor » Wed Sep 24, 2014 9:41 pm

Thanks. Line 694 has this:

Code: Select all
return  $crawlResult;


1. Should I delete it and replace it with new code?
2. Add new code below existing code?
3. Add new code above existing code?

Also, quick question. What exactly does this do "Enable HTTP Proxy Tunnel"? When do we want to enable it and when should we disable it?

Thanks.
v1ktor
 
Posts: 6
Joined: Thu Sep 13, 2012 12:32 pm

Re: "Check With Another Proxy When Crawling Failed" is broke

Postby seopanel_forum » Thu Sep 25, 2014 7:30 am

Sorry, i forgot to mention that. Do following

3. Add new code above existing code?


And about your question below

Also, quick question. What exactly does this do "Enable HTTP Proxy Tunnel"? When do we want to enable it and when should we disable it?

For some proxies it should be needed, its depends on proxy type. Once a proxy is not working you can try to change it and chekc it status. Normal case do not need to change it.
Thanks,
Seo Panel Team
http://www.seopanel.in
seopanel_forum
Site Admin
 
Posts: 1378
Joined: Sat Apr 17, 2010 6:42 pm
Location: India

Re: "Check With Another Proxy When Crawling Failed" is broke

Postby v1ktor » Thu Sep 25, 2014 6:16 pm

Hi, it doesn't seem to work. Once I initiate manual keyword check, it never stops. But it also does not rotate proxies according to log manager. I let it run for 10 minutes, it never restarted with new proxies.

This is what I have:

Code: Select all
// if proxy enabled if crawl failed try to check next proxy
      if (SP_ENABLE_PROXY && CHECK_WITH_ANOTHER_PROXY_IF_FAILED) {
        if ($proxyInfo = $proxyCtrler->getRandomProxy()) {
            $crawlResult = $this->crawlKeyword($keywordInfo, $seId, $cron, $removeDuplicate);     
         }
      }
      return  $crawlResult;


I don't know, but maybe it's related to my other issue with google crawling?
http://forum.seopanel.in/viewtopic.php?f=6&t=11407
v1ktor
 
Posts: 6
Joined: Thu Sep 13, 2012 12:32 pm

Re: "Check With Another Proxy When Crawling Failed" is broke

Postby seopanel_forum » Thu Sep 25, 2014 6:30 pm

Okay may be issue with your google crawling issue. Can you please contact me with your seo panel details. Let directly check it there.
Thanks,
Seo Panel Team
http://www.seopanel.in
seopanel_forum
Site Admin
 
Posts: 1378
Joined: Sat Apr 17, 2010 6:42 pm
Location: India


Return to Seo Panel Bugs and Issues

Who is online

Users browsing this forum: No registered users and 0 guests