STV Import: Imdb Search Interface (7 Jul 2008 v6.10)

[TBacker]

+1

Anyone PM Nielm?

Guess I will just in case he doesn't see this thread...

[Texas-Hansen]

I loaded 6.5.18 RC and updated my HD200 to the most recent firmware. When I do an IMBD search for a DVD movie I have in my library I get the error in the attached screen shot. Any recommendations on a fix, anyone else seeing this?

Thanks

* merged *

[cmaffia]

Yep broken for me too!
This happend about a year ago.. same message.. Nielm had to fix it.

[nielm]

IMDB is blocking based on the user-agent string sent by the IMDB plugin (Java/version#)
The following text is sent by the IMDB servers:

Originally Posted by imdb

Access denied
http: 403

Sorry, this imdb.com (Internet Movie Database) page is not accessible from your address or browser. This page contains information which may explain why you are seeing this error instead of the page you wanted. Please read this information and if after reading it you still do not understand why you have been denied access then you should use the contact details at the end to request information specific to your case.

Note: the majority of people seeing this page are innocent users suffering because of offenders who use the same Internet address or software as they do. Chances are, you're not the offender and we'll do our best to restore your access once we're aware of your circumstances.

The three main reasons for seeing this message are:

1. your browser or proxy server isn't identifying itself and is blocked because we don't trust it to behave.
If your browser/proxy/agent does not send a HTTP User-Agent header, this server will reject the request. Most anonymous software turns out to be automated junk that hits us too fast and too hard. This deprives our online users of a quick and speedy service. Such denials of service (intentional or not) will result in loss of access to our site. You may be able to gain access by reading the information here

2. you've typed or followed some broken URL.
Returning to the home page should get you started.

3. your Internet address or web browser or proxy server has been banned for misuse of our service, e.g. overloading our servers with automated requests that are just too fast
If you want your own local copy of the database then you only needed to have looked for it. http://imdb.com/interfaces will explain how you can have your own copy of the IMDb and as it runs on your system you can hit it as hard and as frequently as you like. Please note the copyright on the data.

All requests from NetSonic, NetJet, NetCarta, Autonomy, WebWhacker, FlashSite, Java102, Teleport-Pro, MemoWeb, Microsoft's MS-Catapult/0.9, Netscape's Catalog-Robot, Microsoft's "Site Analyst" are rejected because of persistent attempts to download huge numbers of pages as fast as the networks permit.

So called 'web-accelerators' can be a nuisance and we don't want them here. We can't block these programs but what we can do is send this page instead of whatever the software asked for every time. Please disable your URL prefetching 'web accelerators' to avoid loss of service.

Personal web crawlers (e.g. the built-in crawler modes from MSIE 4.0 and Netscape 4.0) are not welcome on this site. MSIE 4.0 is more responsible in that it sometimes identifies itself differently when in crawler mode, so we can block crawling with it, Netscape 4.0 doesn't identify itself as being in crawler mode so we can't detect it - instead we have to use more extreme measures to block abusers of our service - IP addresses of these abusers can be blocked completely once they misbehave (note that Netscape and Microsoft's Internet Explorer are not blocked.)

Filtering IMDb isn't allowed, so WebWasher filters etc aren't allowed. If everyone used a banner ad filter the vast majority of sites would run out of money to provide you with 'free' services... it's either banner ads or subscription fees.

Robot/crawler guidelines:

Please see http://info.webcrawler.com/mak/proje...ts/robots.html for background information and hints on writing well behaved browsers/robots/crawlers.

Reporting problems:

If you cannot work out why you've seen this page, please report problems to 'access-errors@imdb.com', include the items listed below in any email.

Date: Sun Jun 28 11:51:05 2009
Host: www.imdb.com
Server: iof631
Status: 403
Client: 78.24.121.2
Browser: Java/1.6.0_13
Request: GET /find?s=nm&mx=200&q=test HTTP/1.1
Instance: 2009-06-28
Referrer:

Based on this message, if I change the user agent string in the web page requests to identify my plugin as itself (sageimdb/version#) then normal service should be resumed. I will be testing a releasing a new JAR shortly.

The IMDB plugin is sailing on the edge of the IMDB terms and conditions, (although it could be considered a custom text-based web browser) and if they in the future block the specific user agent I will send, then this plugin will not be developed any further.

While testing, I have also noticed some parsing problems which I will also update...

[Lucas]

Thanks Niel.

[flashbacck]

The update posted by JREwiki back in january should have the user-agent problem fixed. The present problems seem to be from parsing search results.

[fiatmonkey]

I have not had this plugin a real long time however I can say its the one I absolutely use the most and I think it is really great. If the HTML changes often enough on the IMDB site maybe putting the regex parsing paramaters in a .properties file would be helpful maybe?

Just a thought - again love this plugin!

-FM

[pjpjpjpj]

I actually had a few random shows for which I was able to access the IMDB site yesterday, but most I can not. I don't know anything about how the code is written so I won't hazard a guess as to what this means, but if it helps any of you developers who are trying to fix it, well, there ya go.

[mike1961]

If there were more examples on how to create sage plugins and it didn't seem so complicated I would try to have fun creating plugins as I'm a programmer myself.

[Hunter69]

I use the imdb plugin to identify my video collection. As far as I know it does not work right now, has there been an update to fix the change in the website?

Thanks for the info
Bill

* merged *

[TBacker]

Status update? Nielm? Anyone?

There's an echo in here... and tumbleweeds

[pvr599]

Could anyone tell me what I need to do to fix this? I get

net.sf.sageplugins.sageimdb.DbFailueExeption

I worked fine about a week ago. I didn't do any upgrades or anything.

Thanks a ton,
Dana

* merged *

[jackalpsp]

ditto, pvr599's error. Any word on a fix?

[pjpjpjpj]

Originally Posted by Hunter69

I use the imdb plugin to identify my video collection. As far as I know it does not work right now, has there been an update to fix the change in the website?

Thanks for the info
Bill

* merged *

Originally Posted by pvr599

Could anyone tell me what I need to do to fix this? I get

net.sf.sageplugins.sageimdb.DbFailueExeption

I worked fine about a week ago. I didn't do any upgrades or anything.

Thanks a ton,
Dana

* merged *

Originally Posted by jackalpsp

ditto, pvr599's error. Any word on a fix?

See nielm's post above: http://forums.sagetv.com/forums/show...&postcount=384

Should be on the way.

Nielm (if you read this), you rock, by the way.

[nielm]

07 July 2009 v6.11 for SageTVv6.4+ (Download)
* JAR: Fix parsing
* JAR: add user-agent string

This is a JAR file update only -- simply unpack and then restart Sage...

[fiatmonkey]

Awesome news! Can't wait to deploy it on my server. Thanks nielm!

[JREkiwi]

Thanks nielm, the new version is working, but there are a couple of regressions in it though.

Quotes have numbers like "0398646"> " prepended
MPAAratings returns nothing
No "" around TV shows and TV Movies. IMDB use that "standard" to differentiate between theatrical and TV items and I use that for flagging items when saving IMDB data.

John

[Lucas]

Thanks Nielm.

I noticed that the sageutils jar in this was an older version than the one I had installed.

[Texas-Hansen]

Thanks nielm!!!! Working great.

[jackalpsp]

Thanks for the help Nielm.