Utility: Batch Metadata Importer 3.x

[S_M_E]

Originally Posted by stuckless

backdropsOnly only works if there is existing metadata for a file. It uses the Title as the search and not the filename. --backdropsOnly was added because I already have metadata properties for all my movies, and I wanted to way to just update the backdrops without have to research for the movies. So, to clarify, --backdropsOnly does not use the filename, it uses the movie Title from an existing movie properties file.

where --backdropsOnly is passed, pretty much all other command line properties are ignored. So using --auto=false with --backdropsOnly doesn't work. Mainly because backdropsOnly is a simple non interactive process that fetches backdrops for movies if it can find an exact match title.

I had metadata for it but it didn't grab any image. I tried renaming the metadata and it just grabbed the metadata, still nothing more.

auto=false did work but it didn't grab an image:
java -jar MetadataTool.jar --recurse --prompt=true --auto=false --provider=themoviedb.com --backdropsOnly --setProperty=/imdb/forcedIMDBImageSize:1920 "\\Abit\videos\Movies\
Unleashed (2005).avi"
Batch MetaData Tools (1.12)


Search Results: Unleashed 2005
00 (*) - Danny the Dog [2005-05-13]
01 (-) - Ginger Snaps: Unleashed [2004-01-30]
02 (-) - Scooby Doo 2: Monsters Unleashed [2004-03-20]
LEGEND: ? Unknown; * Exact Match; - Partial Match; + Popular Match;

[q=quit, n=next (default), ##=use result ##, TITLE=Search TITLE]
> 00
Updated: Danny the Dog (Unleashed (2005).avi)


MetaData Stats...
Processed: 1; Updated: 1 (1 manual), Skipped: 0; Errors: 0.

Is the "backdrop" the same thing as the cover that the imdb provider grabs? I thought it was a different image.

It should do that now already. Most of my movies have dates in the filename and I don't have an issue. Or maybe I'm not understanding the issue?

I tried it without the auto=false and it failed to find a match. I assumed it was picky about the filename because you said it was.

This should prompt and it will only download a backdrops, if one exists in themoviedb.com database.

Perhaps you can paste some of your movie titles that you are having issues with, and the commandlines that you are using. I can then test them using the --offline switch.

java -jar MetadataTool.jar --recurse --prompt=true --provider=themoviedb.com --backdropsOnly --setProperty=/imdb/forcedIMDBImageSize:1920 \\Abit\videos\Movies\
(skipped everything grabbed no image)

java -jar MetadataTool.jar --recurse --update --prompt=true --provider=themoviedb.com --backdropsOnly --setProperty=/imdb/forcedIMDBImageSize:1920 \\Abit\videos\Movies\
(updated some of the metadata, some failed "IMDB getting URL:http://www.imdb.comhttp://www.imdb.com/title/tt0080339/combinedcombined", grabbed no image)

java -jar MetadataTool.jar --recurse --prompt=true --provider=themoviedb.com --backdropsOnly --setProperty=/imdb/forcedIMDBImageSize:1920 "\\Abit\videos\Movies\Unleashed (2005).avi"
(skipped file, grabbed no image)

java -jar MetadataTool.jar --recurse --prompt=true --provider=themoviedb.com --update --backdropsOnly --setProperty=/imdb/forcedIMDBImageSize:1920 "\\Abit\videos\Movies\Unleashed (2005).avi"
(failed with existing metadata, "Error: null" - updated without metadata, grabbed no image)

*shrug*

[megamojo]

Originally Posted by stuckless

FYI... if I do another screen scraper, it will probably be for tv.com... I have alot of TV shows that need metadata

It's already been done, and quite well before tv.com changed their site and broke the scraping. Maybe you could work with roxy99 and fix the scraping? I very much miss having that plugin.

[stuckless]

It's already been done, and quite well before tv.com changed their site and broke the scraping. Maybe you could work with roxy99 and fix the scraping? I very much miss having that plugin.

Unfortunately, I'm part of a very small minority that doesn't use windows, so there's no real incentive for me to get this working But I'm sure the project owner will fix it soon it enough.

[stuckless]

SME,

You don't appear to be running the latest, based on your output, you are running 1.12, which doesn't have support for backdrops/fanart.

Did you install over an older install? If so, check the libs directory of where you installed BMT and make sure that you do not have similar jars with different versions in there.

[mrdrbdt]

Originally Posted by stuckless

--auto is back. You can set it to false, and it will prompt for every file.

Sweet!

Thanks!

[S_M_E]

Originally Posted by stuckless

SME,

You don't appear to be running the latest, based on your output, you are running 1.12, which doesn't have support for backdrops/fanart.

Did you install over an older install? If so, check the libs directory of where you installed BMT and make sure that you do not have similar jars with different versions in there.

I did install over the older version and that does seem to be the issue. I'll delete the lib dir and start over.

Thanks...


EDIT:
It's working as I edit but it is skipping a lot of files.

Example:
Skipping Backdrop for: file:////Abit/videos/Movies/Terminator%20Collection/Terminator%202%20Judgment%20Day%20(1991).avi
Perhaps it doesn't like colons in the names? From the properties file: Terminator 2\: Judgment Day (1991)

[stuckless]

Skipping Backdrop for: file:////Abit/videos/Movies/Terminator%20Collection/Terminator%202%20Judgment%20Day%20(1991).avi
Perhaps it doesn't like colons in the names? From the properties file: Terminator 2\: Judgment Day (1991)

The problem is that the search results comming back, is not marking terminator 2 as an exact match, so the tool won't select it.

[S_M_E]

Originally Posted by stuckless

The problem is that the search results comming back, is not marking terminator 2 as an exact match, so the tool won't select it.

So nothing can be done, other than manually fetching the backdrop for every file that fails?

[stuckless]

So nothing can be done, other than manually fetching the backdrop for every file that fails?

Their's always something that can be done I'll put it on a list of things to look at when I get time. I may add a "tolerance" setting that may help in this case. Or I could add code that will manually check the titles and find a match that way.... Currently I'm involved in something else, so this won't be a quick change.

[S_M_E]

No rush, just checking what the options were...

[babgvant]

I installed an earlier version of the MetadataUpdaterPlugin (mediafile_metadata_parser_plugins=org.jdna.sage.MetadataUpdaterPlugin) in sage and it was working, but after pulling down the latest and importing a video file it didn't seem to do anything (the metadata for the file did not get written).

What can I do to try to debug it (I didn't see anything in the sage log)?

[S_M_E]

Here's another example of how imdb and themoviedb both get it wrong:

"Kung Fu Hustle" is the name of the movie in the US but imdb calls it "Kung fu"
http://www.imdb.com/title/tt0373074/
but themoviedb pulls down backdrop art for "Kung fu Panda"

Once I get these straightened out I'll try making them read-only, hopefully that will prevent overwriting them if I ever do an --update.

[stuckless]

Once I get these straightened out I'll try making them read-only, hopefully that will prevent overwriting them if I ever do an --update.

Actually, backdrops and posters (thumbnails) should never be overwritten unless --forceThumbnail or --forceBackdrop is passed.

[stuckless]

First, check the JARs directory and make sure that there isn't 2 metadata-updater-nnn.jar files. If there are, then remove the one with the loweset #.

Next, I think, based on your jetty stuff you sent me earlier, that Jetty redirecting the log to you JETTY_HOME/logs/yyyy_mm_dd.stderrout.log. Check in there for any messages.

Originally Posted by babgvant

I installed an earlier version of the MetadataUpdaterPlugin (mediafile_metadata_parser_plugins=org.jdna.sage.MetadataUpdaterPlugin) in sage and it was working, but after pulling down the latest and importing a video file it didn't seem to do anything (the metadata for the file did not get written).

What can I do to try to debug it (I didn't see anything in the sage log)?

[mp328]

im having a problem after updating to the new version myself, i did do like u said, copy the new files over and delete the 1.13 file that was in there from before and it wont work anymore

i see the note of "unknown source" but not sure what it all means...

and the line with the plugin is still in the properties file, like i said it worked perfectly fine with 1.13 and after moving the new jars over and deleting that one old file it stopped working now and i love this import

[S_M_E]

Originally Posted by stuckless

Actually, backdrops and posters (thumbnails) should never be overwritten unless --forceThumbnail or --forceBackdrop is passed.

The .properties on some files sometimes get the wrong data and has to be edited, if --updated, too. Once I get everything the way I want it, for existing files, I still want to try to lock it down. Hopefully setting RO will do that. That way I'll only have to worry about new files added.

[babgvant]

Originally Posted by stuckless

First, check the JARs directory and make sure that there isn't 2 metadata-updater-nnn.jar files. If there are, then remove the one with the loweset #.

Next, I think, based on your jetty stuff you sent me earlier, that Jetty redirecting the log to you JETTY_HOME/logs/yyyy_mm_dd.stderrout.log. Check in there for any messages.

removing the previous version got it running again (I see entries in the sage log), but meta data isn't getting pulled down.

Tue 1/6 22:47:35.438 [LibraryImporter@1c6407f] BatchMetadataTools; Handling File: \\server\dvd\Lock, Stock and Two Smoking Barrels\VIDEO_TS; arg:
Tue 1/6 22:47:35.488 [LibraryImporter@1c6407f] Could not automatically update: file:////server/dvd/Lock,%20Stock%20and%20Two%20Smoking%20Barrels/VIDEO_TS/

I found this reply earlier in the discussion and there aren't any exceptions could it be an issue with the logic that tries to putt the movie title from the path (is that what /media/stackingModelRegex= is)?

[stuckless]

babgvant, there may be a bug in how the plugin works with DVDs. I'll have to check into it further.

As for stackingModeRegex, it's the regular expression that is used to calculate a movie stack. It's mainly used to group multi cd movies (movie-cd1, movie-cd2) as a single entry.

[babgvant]

Originally Posted by stuckless

babgvant, there may be a bug in how the plugin works with DVDs. I'll have to check into it further.

As for stackingModeRegex, it's the regular expression that is used to calculate a movie stack. It's mainly used to group multi cd movies (movie-cd1, movie-cd2) as a single entry.

Thanks.

Originally Posted by stuckless

Backdrops are stored in the same directory are the movie, thumbnail, and properties. I do not have suppprt, nor will I add it, for the option to store fanart in a separate location. Since this tool runs outside of Sage, I have no idea how I would support storing metadata to another location.

Could you add a property that points to the base folder for an alternate location. Subfolders (Movies/TV/Music) will be static in the next release of SageMC, so they can be derived (I wrote an external fanart dl tool that works like this).

If you don't have time I could take a look at adding the feature to the tool if you're open to it.

[stuckless]

If you don't have time I could take a look at adding the feature to the tool if you're open to it.

The source is open, so you are free to with it as you please. You can do it and submit it back to me as a patch if you want.

If you are going to do it.... Here's the basics of what you need to know....

• BMT uses a virtual filesystem that is URI based
• IMediaResource is an interface and it contains getLocalBackdropUrl()
• You would need to update getLocalBackdropUrl() in MediaFile and DVDMediaFile
• SageVideoMetadataPersistence is what is used to write out the image files. The only thing to change here is that you'll want to ensure that the directory structure is actually created before you write the image file.

Now for the hard part. in getLocalBackdropUrl() you'll need to somehow determine what all of the sage video paths are, and then determine what the final destination directory/filename should be. In brent's blog, he made reference to the fact that some special characters need to be stripped out, when calculating the destination filename.

Good luck.