Utility: Batch Metadata Importer 3.x

[S_M_E]

I hadn't noticed that you added a gui and I don't see it in the wiki either but I checked it out. It's a good idea but as you know it still needs work and better documentation.

Passing commandline arguments while starting the gui seems to pick them up but they revert to default when the scan is started, therefore you can't change the order of the providers. Also, not all commandline options are available in the gui yet.

Good start though...

[stuckless]

I didn't include it in the wiki, or even mention it before, because it's more of a POC. I wanted to give it a try, but I'll probably end up removing it in the future, if someone else dosn't volunteer to take it over. (I was curious if anyone was going to notice )

It's enough effort on my part to maintain the command line tool

[S_M_E]

I'd be happy to help but I gave up on programming back in 1982 so all I can offer is input.

The CLI works well too and we appreciate it...

[onlydarksets]

I am running into some incorrectly identified movies. I posted about it here, but it seems more relevant in this thread.

"American Pie" comes up as "American Pie presents Band Camp"
"Friday" comes up as "Friday the 13th"
"Casino" comes up as "Casino Royale"

My metadata.properties looks like this:

/media/videoExtensionsRegex=avi|mpg|divx|mkv|wmv|mov|xvid|mp4|m2ts|m4v
/metadata/defaultProviderId=themoviedb.org-2

Strangely, in all cases the _providerDataUrl points to the correct IMDB page, but the data is all incorrect.

I believe Andy is looking into it, but I wanted to get it in the right thread.

[S_M_E]

That's why I run it with the prompt option so I don't get false hits. It's a PITA to do it if you have a lot of media but if you just delete the .properties file with the bad info and run it with the prompt option you can specify which one is right for the second pass.

[stuckless]

onlydarksets, thanks for posting it here as well... I did see your post in the the other thread, but I didn't realize it was related to BMT.... And yeah... I think that Andy (babgvant) has decided to look into this. (thanks Andy )

[onlydarksets]

Originally Posted by S_M_E

That's why I run it with the prompt option so I don't get false hits. It's a PITA to do it if you have a lot of media but if you just delete the .properties file with the bad info and run it with the prompt option you can specify which one is right for the second pass.

Thanks, I haven't tried that method yet. However, the weird thing is that the IMDB lookup is correct, it's just pulling the wrong data. I assume that it gets the proper movie name from IMDB, which it then uses to get the artwork. Because it is somehow hitting the wrong URL, the movie name is wrong, which makes the subsequent lookups wrong, as well. I'm speculating here, but I don't know how else to explain the _providerDataUrl.

Originally Posted by stuckless

onlydarksets, thanks for posting it here as well... I did see your post in the the other thread, but I didn't realize it was related to BMT.... And yeah... I think that Andy (babgvant) has decided to look into this. (thanks Andy )

Great tool, stuckless - thanks for putting it together!

[stuckless]

Thanks, I haven't tried that method yet. However, the weird thing is that the IMDB lookup is correct, it's just pulling the wrong data. I assume that it gets the proper movie name from IMDB, which it then uses to get the artwork. Because it is somehow hitting the wrong URL, the movie name is wrong, which makes the subsequent lookups wrong, as well. I'm speculating here, but I don't know how else to explain the _providerDataUrl.

I think the problem here is the themovedb-2 provider and how composite providers work. In a nutshell, composite providers use 2 different providers, one for searching and one for details... the only thing linking them is the movie title. So even though the search hit is correct (using the imdb provider), the search details (ie, metadata is wrong) and it results in incorrect data... (I should really add a better logic to the composite provider).

In the meantime, you can try the imdb.xml provider. It also supports backdrops, (from themoviedb.org) but it does a better job as resolving the correct title.

[onlydarksets]

I tried imdb.xml, but it doesn't work for me. For most titles, it gets very uncertain and prompts me to resolve the movie name, and then it does nothing when I select one of the numbers (e.g., "00"). There are only a few movies that have failed, so I'm manually processing those with mediaScraper.

[S_M_E]

Here's the command I use most:

java -jar MetadataTool.jar --gui --recurse --displaySize=20 --prompt=true --auto=false --provider=nielm_imdb,themoviedb.org,imdb,imdb.xml,tvdb.xml --setProperty=/imdb/forcedIMDBImageSize:1920 \\Abit\videos\Movies\

but I want it to prompt so YMMV...

[onlydarksets]

Per the wiki, though, the prompt option is already enabled by default, but it only prompts if it can't make a match. That's not the issue I have - it thinks it has a match, it's just the wrong one. I've confirmed it also happens with the "themoviedb.org" provider, so it does seem to be an issue with that database, as opposed to IMDB.

[S_M_E]

Maybe it's the --auto=false that does it then. Either way, that's the command I use and becasue it prompts every time, I don't get false hits. I do put the imdb providers first in the order though. *shrug*

[onlydarksets]

Originally Posted by S_M_E

Maybe it's the --auto=false that does it then. Either way, that's the command I use and becasue it prompts every time, I don't get false hits. I do put the imdb providers first in the order though. *shrug*

Yep, that's the one. Thanks!

[stuckless]

You may want to run a complete scan, then later you can "fix" the problem files, by running in "manual" as SME noted. (I normally run it as plugin, then then "manually" fix the problem files later)

ie,

# java -jar MetadataUpater.jar --update --force --forceThumbnail --forceBackdrop --auto=false --prompt YourIncorrectFile.avi

But that requires some effort to keep track of the incorrect titles.

Personally, I think that the tool needs a UI I've been learning the STV language lately, so who knows, maybe I'll try to put something together.

[onlydarksets]

That's exactly what I did. I just scanned the thumbnails of the covers for images that didn't match, then I moved the folders/files to a new directory and ran the "forced" version on the temp directory. Then I moved everything back.

Thanks for the feedback!

[stuckless]

Babgvant has been busy fixing bugs and adding enhancements....

• All search providers now use the same scoring algorithm and Exact Match, Popular Match, etc have been removed as a means of determining valid search results
• Support for Multi DVD TV dics (ie, Show - S01D01)

What this basically means is that instead of using abstract terms like "exact match", "popular match", etc, the tool now uses a "scoring" system that ranks the search score from 0-1 as a float value (mush like search engines do). So, for example a search result of 0.30 is not a poor match, but a score of 0.90 is pretty good, and 1.0 is an exact match.

The tool, by default will use a "default" score of 0.90 as being a score that it will accept if it cannot find an exact match. You can change this value by changing the /metadata/goodScoreThreshold property.

# Description: Score which must be exceeded to consider a result a good match
/metadata/goodScoreThreshold=0.9

The higher the value the more likely you will avoid false hits, but you may be prompted for more searches. You can accept the default, or set your own.

The second enhancement involves Multi DVD TV titles. ie, the tool will fetch metata for Disc sets, if the DVD TV set contains S##D## in the filename, where S## is the season and D## is the Disc #.
eg,

# season 1 - 3 discs
/Dexter - S01D01/VIDEO_TS
/Dexter - S01D02/VIDEO_TS
/Dexter - S01D03/VIDEO_TS
# season 2 - 3 discs
/Dexter - S02D01/VIDEO_TS
/Dexter - S02D02/VIDEO_TS
/Dexter - S02D03/VIDEO_TS

Obviously it won't download episode information, but it will download the series info, thumbnail and backdrop.

You can thank babgvant for these enhancements.

[onlydarksets]

Sounds like a couple of great improvements! I'll give it a go this weekend.

Thanks!

[lsochia]

This tool seems to be working fine getting metadata, however, it does not retrieve any cover art can someone point me in the right direction. I can download tv show art manually, but I was hoping this tool could do this automatically for me, am I mistaken???

[stuckless]

which provider metadata providers are you using? If you are not passing a --provder argument, then it will only use the default imdb provider, which doesn't have coverart.

Some other providers that you can try include... --provider=themoviedb.org-2,imdb.xml,imdb,tvdb.xml

This will first look at the moviedb.org, then imdb.xml (which will fetch coverart). If you have tvshows in the format "Title s##e##" then the tvdb.xml will be used to fetch any metdata for those...

In the next release, I may enable all providers by default, with the option of turning them off, or reordering them, that would make it easier for most users, who just want it work with everything out the box...

[lsochia]

Originally Posted by stuckless

which provider metadata providers are you using? If you are not passing a --provder argument, then it will only use the default imdb provider, which doesn't have coverart.

Some other providers that you can try include... --provider=themoviedb.org-2,imdb.xml,imdb,tvdb.xml

This will first look at the moviedb.org, then imdb.xml (which will fetch coverart). If you have tvshows in the format "Title s##e##" then the tvdb.xml will be used to fetch any metdata for those...

In the next release, I may enable all providers by default, with the option of turning them off, or reordering them, that would make it easier for most users, who just want it work with everything out the box...

Thx, I will try that.

I am using the reindex command in sage.properties file ( on restart ) and it seems to refresh the .properties files...Where do I specify the providers? I am not running this by the command line....