Welcome, Guest. Please login or register.
May 17, 2012, 02:45:42 pm
Home Help Search Login Register
News: SMF Forum plugin now available: Code Samples

BotScout  |  General Category  |  BotScout Discussion (Moderator: MysteryFCM)  |  Topic: Just a note .... « previous next »
Pages: [1] 2 3 ... 5 Print
Author Topic: Just a note ....  (Read 8677 times)
MysteryFCM
Moderator
Full Member
*****
Posts: 187



View Profile WWW
« on: January 29, 2009, 06:24:17 pm »

I sent you an e-mail earlier concerning the API key's usage, but decided what the heck, and figured I'd find out myself and it seems the key isn't site dependant, which is great.

I've went ahead and included a BotScout lookup in my Spambot Search Tool Smiley (I use this on multiple sites for multiple forums/forms/blogs/etc)
Logged

Regards
Steven Burn
I.T. Mate / hpHosts
it-mate.co.uk / hosts-file.net
Mike
Administrator
Sr. Member
*****
Posts: 280



View Profile
« Reply #1 on: January 29, 2009, 06:35:58 pm »

I sent you an e-mail earlier concerning the API key's usage, but decided what the heck, and figured I'd find out myself and it seems the key isn't site dependant, which is great.

I've went ahead and included a BotScout lookup in my Spambot Search Tool Smiley (I use this on multiple sites for multiple forums/forms/blogs/etc)

Welcome, and thank you for implementing the API in your software!

You're correct, the API key is not site-dependent; you can use the same API key on as many sites as you need to. Currently the key is good for 300 API queries a day, but we can adjust that up if you need more (just let us know).

We're almost ready to release our Bot Trap Form Server, and you're more than welcome to use that as well. We're putting the finishing touches on it and hope to have it available within a few days.

The Form Server lets people put a small line of code in a page that invisibly embeds a randomized form in the page each time it's loaded. The form is very attractive to bots and is designed to be nearly impossible for them to identify as a bot trap.

Unfortunately, the Form Server system needs a different key for each site registered; this was a design consideration forced on us in order to prevent malicious users (botnet owners) from poisoning the database. We don't have a hard limit on the number of sites allowed yet, and the limit will be adjustable on a per-user basis, so trusted users will be able to deploy more forms than other users.

The system uses a scoring ladder to help weed out false entries, and should be very effective in proactively responding to bots and letting them add themselves to the database. Smiley

If you're interested in trying out the Bot Trap Form Server, let me know and we'll get you going. It's very easy to implement.

Again, welcome and thank you for implementing the BotScout API in your code!


Mike
Logged

Please don't PM me for assistance- post your questions in the forum where others can see them.
MysteryFCM
Moderator
Full Member
*****
Posts: 187



View Profile WWW
« Reply #2 on: January 29, 2009, 06:41:06 pm »

I sent you an e-mail earlier concerning the API key's usage, but decided what the heck, and figured I'd find out myself and it seems the key isn't site dependant, which is great.

I've went ahead and included a BotScout lookup in my Spambot Search Tool Smiley (I use this on multiple sites for multiple forums/forms/blogs/etc)

Welcome, and thank you for implementing the API in your software!

You're correct, the API key is not site-dependent; you can use the same API key on as many sites as you need to. Currently the key is good for 300 API queries a day, but we can adjust that up if you need more (just let us know).

hehe cheers Smiley ....... I'll definately need more than 300 per day (the SBST gets in excess of 5000 queries per day on a single site, and I've got it installed on 3 sites so far (no idea of the traffic to them on the other two sites as I don't monitor them)).

We're almost ready to release our Bot Trap Form Server, and you're more than welcome to use that as well. We're putting the finishing touches on it and hope to have it available within a few days.

The Form Server lets people put a small line of code in a page that invisibly embeds a randomized form in the page each time it's loaded. The form is very attractive to bots and is designed to be nearly impossible for them to identify as a bot trap.

Unfortunately, the Form Server system needs a different key for each site registered; this was a design consideration forced on us in order to prevent malicious users (botnet owners) from poisoning the database. We don't have a hard limit on the number of sites allowed yet, and the limit will be adjustable on a per-user basis, so trusted users will be able to deploy more forms than other users.

The system uses a scoring ladder to help weed out false entries, and should be very effective in proactively responding to bots and letting them add themselves to the database. Smiley

If you're interested in trying out the Bot Trap Form Server, let me know and we'll get you going. It's very easy to implement.

Again, welcome and thank you for implementing the BotScout API in your code!

Mike

My pleasure Smiley and yep, I'll be interested in trying out the BTFS Smiley
Logged

Regards
Steven Burn
I.T. Mate / hpHosts
it-mate.co.uk / hosts-file.net
Mike
Administrator
Sr. Member
*****
Posts: 280



View Profile
« Reply #3 on: January 29, 2009, 06:45:20 pm »

hehe cheers Smiley ....... I'll definately need more than 300 per day (the SBST gets in excess of 5000 queries per day on a single site, and I've got it installed on 3 sites so far (no idea of the traffic to them on the other two sites as I don't monitor them)).
Yikes, lol. Okay, we'll keep an eye on the query count for your key and if it starts to climb we'll bump it up (probably way up).

The one bit of advice I'd offer in terms of implementing the code is to check the return values carefully, the absence of a 'Y' doesn't necessarily mean there was no match- it may mean that an error is being returned (bad format, query limits, etc). We're looking at adding a special return value to help implement this, most likely a "!" returned as the first character to give scripts something to trigger on.
Logged

Please don't PM me for assistance- post your questions in the forum where others can see them.
MysteryFCM
Moderator
Full Member
*****
Posts: 187



View Profile WWW
« Reply #4 on: January 29, 2009, 06:48:41 pm »

Much appreciated, cheers Smiley

A return value specific to errors would be much appreciated as it would allow easier differentiation from non-matches (let me know when you've done this and I'll modify the scripts accordingly).
Logged

Regards
Steven Burn
I.T. Mate / hpHosts
it-mate.co.uk / hosts-file.net
Mike
Administrator
Sr. Member
*****
Posts: 280



View Profile
« Reply #5 on: January 29, 2009, 06:54:33 pm »

Much appreciated, cheers Smiley

A return value specific to errors would be much appreciated as it would allow easier differentiation from non-matches (let me know when you've done this and I'll modify the scripts accordingly).
We'll look at adding this within the next day or so and we'll post a notice here (the API Doc page will also be updated).
Logged

Please don't PM me for assistance- post your questions in the forum where others can see them.
MysteryFCM
Moderator
Full Member
*****
Posts: 187



View Profile WWW
« Reply #6 on: January 29, 2009, 06:59:28 pm »

Nice one Smiley

Btw, your main site login form isn't allowing my full e-mail address in order to login Sad

Full e-mail = botscout_com AT it-mate.co.uk

It seems to limit the chars so the last letter isn't allowed?
Logged

Regards
Steven Burn
I.T. Mate / hpHosts
it-mate.co.uk / hosts-file.net
Mike
Administrator
Sr. Member
*****
Posts: 280



View Profile
« Reply #7 on: January 29, 2009, 07:04:33 pm »

Nice one Smiley

Btw, your main site login form isn't allowing my full e-mail address in order to login Sad

Full e-mail = botscout_com AT it-mate.co.uk

It seems to limit the chars so the last letter isn't allowed?
Whoops. That's fixed now. It should take up to 50 characters now.

My partner is adding the error handling modification to the API and says he'll be done by the time I finish this message. Here's the change to the API info page:

API Error Handling
In the event of an API error or query limit, the API will return an exclamation mark (!) followed by a single space, and then the text of the error message. For example:

! Sorry, but that doesn't appear to be a valid API key.

If your code tests for an exclamation mark as the first character and finds one, then it can expect an error message to follow. The message could be emailed to an admin. It's possible we'll add an error code for the various messages, but I'm not sure if there's much utility in doing that. (??)
Logged

Please don't PM me for assistance- post your questions in the forum where others can see them.
Mike
Administrator
Sr. Member
*****
Posts: 280



View Profile
« Reply #8 on: January 29, 2009, 07:16:05 pm »

I sent you an e-mail earlier concerning the API key's usage, but decided what the heck, and figured I'd find out myself and it seems the key isn't site dependant, which is great.
Hmmm, did you send the email through the contact form? I looked but didn't see anything. (??)
Logged

Please don't PM me for assistance- post your questions in the forum where others can see them.
MysteryFCM
Moderator
Full Member
*****
Posts: 187



View Profile WWW
« Reply #9 on: January 29, 2009, 07:25:35 pm »

I sent you an e-mail earlier concerning the API key's usage, but decided what the heck, and figured I'd find out myself and it seems the key isn't site dependant, which is great.
Hmmm, did you send the email through the contact form? I looked but didn't see anything. (??)

I did, yep Smiley
Logged

Regards
Steven Burn
I.T. Mate / hpHosts
it-mate.co.uk / hosts-file.net
MysteryFCM
Moderator
Full Member
*****
Posts: 187



View Profile WWW
« Reply #10 on: January 29, 2009, 07:26:11 pm »

Nice one Smiley

Btw, your main site login form isn't allowing my full e-mail address in order to login Sad

Full e-mail = botscout_com AT it-mate.co.uk

It seems to limit the chars so the last letter isn't allowed?
Whoops. That's fixed now. It should take up to 50 characters now.

My partner is adding the error handling modification to the API and says he'll be done by the time I finish this message. Here's the change to the API info page:

API Error Handling
In the event of an API error or query limit, the API will return an exclamation mark (!) followed by a single space, and then the text of the error message. For example:

! Sorry, but that doesn't appear to be a valid API key.

If your code tests for an exclamation mark as the first character and finds one, then it can expect an error message to follow. The message could be emailed to an admin. It's possible we'll add an error code for the various messages, but I'm not sure if there's much utility in doing that. (??)


Cool Smiley I've just made another modification to the script so will add this aswell then re-release it Smiley
Logged

Regards
Steven Burn
I.T. Mate / hpHosts
it-mate.co.uk / hosts-file.net
MysteryFCM
Moderator
Full Member
*****
Posts: 187



View Profile WWW
« Reply #11 on: January 29, 2009, 07:43:17 pm »

I've added this in and released the new version Smiley

Btw, the bot trapping form generator doesn't seem able to detect the domains IP? (domain is the hosts-file.net server)
Logged

Regards
Steven Burn
I.T. Mate / hpHosts
it-mate.co.uk / hosts-file.net
Mike
Administrator
Sr. Member
*****
Posts: 280



View Profile
« Reply #12 on: January 29, 2009, 08:18:51 pm »

I've added this in and released the new version Smiley

Btw, the bot trapping form generator doesn't seem able to detect the domains IP? (domain is the hosts-file.net server)
I'll have a look at this, let me see what I can find. It should trigger once you TAB away from the field or click on the next field.

..........

Hmmmm, it seemed to find it okay for me: 67.228.216.52

Sometimes it takes it a moment or two to resolve the IP. If it still doesn't find it for you, let me know. Are you using IE or Firefox, or...?

I tried it with FF and IE 7.0 and it worked okay for me. (??)
Logged

Please don't PM me for assistance- post your questions in the forum where others can see them.
MysteryFCM
Moderator
Full Member
*****
Posts: 187



View Profile WWW
« Reply #13 on: January 29, 2009, 08:28:10 pm »

It's detecting an IP now, but the wrong one Huh

hosts-file.net = 212.56.95.253 (PTR: mysteryfcm.plus.com)

67.228.216.52 = eccparking.com

http://hosts-file.net/?s=67.228.216.52

Incidentally, I've got 3 sites on that IP listed in the hpHosts blacklist;

http://hosts-file.net/?s=67.228.216.52&sDM=1#matches

/edit

Using Avant Browser btw (uses the same Trident engine as IE)
Logged

Regards
Steven Burn
I.T. Mate / hpHosts
it-mate.co.uk / hosts-file.net
Mike
Administrator
Sr. Member
*****
Posts: 280



View Profile
« Reply #14 on: January 29, 2009, 08:33:38 pm »

Weird. Hmmm. Well, go ahead and save it and I'll change the IP manually. Tell me which IP to put in there and we'll give it a shot.

The form server code is nearly done and should be available within a day or so. Once you get the form key you can go here to get a preview of the form server (the forms are visible now, but they won't be when it's released):

http://botscout.com/form/?apikey=your_form_api_key

(Note that the form key isn't the same as your regular API key)

We use the PHP function gethostbyname() to resolve the IP address, but apparently it's not reliable...so we'll need to find a reliable method of getting IP addresses. (Suggestions  welcome, lol)




It's detecting an IP now, but the wrong one Huh

hosts-file.net = 212.56.95.253 (PTR: mysteryfcm.plus.com)

67.228.216.52 = eccparking.com

http://hosts-file.net/?s=67.228.216.52

Incidentally, I've got 3 sites on that IP listed in the hpHosts blacklist;

http://hosts-file.net/?s=67.228.216.52&sDM=1#matches

/edit

Using Avant Browser btw (uses the same Trident engine as IE)
Logged

Please don't PM me for assistance- post your questions in the forum where others can see them.
Pages: [1] 2 3 ... 5 Print 
BotScout  |  General Category  |  BotScout Discussion (Moderator: MysteryFCM)  |  Topic: Just a note .... « previous next »
Jump to:  


Login with username, password and session length

BotScout - Just a note ....

SEO light theme by © Mustang forums. Powered by SMF 1.1.16 | SMF © 2011, Simple Machines