global search for crot

global search for crot

by Daniel Villareal -
Number of replies: 10

is there anyone here tried windows azure bing search to incorporate with crot? thanks.

is it ok to use? thanks....

Average of ratings: -
In reply to Daniel Villareal

Re: global search for crot

by John Andrewartha -

Crot used Bing until Bing$$$ started to be asked same with Google. If you can find a well connected search engine that is prepared to give it free, no charge... please let the rest of us know.
Average of ratings: -
In reply to John Andrewartha

Re: global search for crot

by Daniel Villareal -

Hi john i found this one http://www.faroo.com/hp/api/api.html#xml

i will try this one if it is working... smile


CHEERS...

Average of ratings: -
In reply to Daniel Villareal

Re: global search for crot

by Sergey Butakov -

Daniel,

thank you for the suggestion. please try it. 

The api says no more than 1 query per second so you may want to embed a mechanism to obey this limit. 10^6 queries per month sounds as reasonable limit.

I have doubts  about the quality of the search. for example this query returned 0 results:

http://www.faroo.com/#q=As%20part%20of%20the%20award%20Loder&s=1&l=en&src=web

while these words were taken from Wikipedia article:

http://en.wikipedia.org/wiki/Kellie_Loder

But please give it a try. 

Average of ratings: -
In reply to Daniel Villareal

Re: global search for crot

by John Andrewartha -

Good, let the maintainer of Crot know when you have got a little further. Have fun with the API.

Average of ratings: -
In reply to Daniel Villareal

Re: global search for crot

by Sergey Butakov -

Daniel,

Please read THIS forum before asking questions.

1. Crot is Not compatible with Azure

2. Read my answer here about cost of using Azure.

 

Sergey

 

Average of ratings: -
In reply to Sergey Butakov

Re: global search for crot

by Daniel Villareal -

HI sergey,

when comparing two files in local search, is crot reading all the contents on the files?

if yes? how did the global do searching? what is the format query?


CHEERS smile

Average of ratings: -
In reply to Daniel Villareal

Re: global search for crot

by Sergey Butakov -

Hi Daniel,

 

it would take few hours of writing for me to describe the algorithms in Crot. It uses modified shingling algorithm to compare texts. 

You can easily find the query format in the code. It follows old Bing API. Please study the code, there are some comments inside. 

Average of ratings: -
In reply to Sergey Butakov

Re: global search for crot

by Daniel Villareal -

hi sergey

do you know the old format of xml response of old bing that is working with crot?

thanks..

Average of ratings: -
In reply to Daniel Villareal

Re: global search for crot

by Sergey Butakov -

Hi Daniel,

study the code! Its self-explanatory. 

locallib.php: lines 268 and 439

All the communications with bing are documented in the code.

Average of ratings: -
In reply to Sergey Butakov

Re: global search for crot

by Daniel Villareal -

is this the old format of xml of bing search?

<?xml version="1.0" encoding="utf-8" ?>

<?pageview_candidate?>

<SearchResponse xmlns="http://schemas.microsoft.com/LiveSearch/2008/04/XML/element" Version="2.2">

  <Query>

    <SearchTerms>testign</SearchTerms>

  </Query>

  <spl:Spell xmlns:spl="http://schemas.microsoft.com/LiveSearch/2008/04/XML/spell">

    <spl:Total>1</spl:Total>

    <spl:Results>

      <spl:SpellResult>

        <spl:Value>testing </spl:Value>

      </spl:SpellResult>

    </spl:Results>

  </spl:Spell>

  <web:Web xmlns:web="http://schemas.microsoft.com/LiveSearch/2008/04/XML/web">

    <web:Total>5680</web:Total>

    <web:Offset>0</web:Offset>

    <web:Results>

      <web:WebResult>

        <web:Title>Hacker News | PHP Unit testign</web:Title>

        <web:Description>PHP Unit testign: 1 point by amrithk 134 days ago | 1 comment: Interested to know what tools people use/recommend for unit testing for PHP? What do people think about PHPUnit?</web:Description>

        <web:Url>http://news.ycombinator.com/item?id=196435</web:Url>;

        <web:DisplayUrl>http://news.ycombinator.com/item?id=196435</web:DisplayUrl>;

        <web:DateTime>2008-10-03T15:09:15Z</web:DateTime>

      </web:WebResult>

    </web:Results>

  </web:Web>

</SearchResponse>
Average of ratings: -