Utility: Batch Metadata Importer 3.x

[White94Cobra]

I must be missing something. The tool works great, but Sage isn't showing any of the metadata for my DVD files. I removed the import directories from Sage, did a refresh, shut Sage down, ran the importer, started Sage, added the directories back in and did another refresh. The images show up, but no data. I'm running Sage 6.3.10 with SageMC 6.3.7a-fix.

DVD structure:
<drive>:\Movies1\DVD Movies\<DVD Title>\Video_TS

It is placing both the properties file and the cover art in the "DVD Movies" folder.

What am I doing wrong?? Thanks!

[JREkiwi]

You need SageTV 6.4.x for DVD .properties support.

John

[White94Cobra]

Hmm... I updated to the latest RC and did a refresh but still no movie data. Where does the properties file need to go?

[Addict]

WHOOO! Been waiting for this for a loooong time. Great app, thank-you!

I have a question about "stacking" though. I'm not sure how to take advantage of this, within your app, or within Sage...and am looking for a little advice.

A typical example of my DVD folder structure looks like this:

X-Men - SERIES
..X-Men
....X-Men
......VIDEO_TS
....X-Men - Disc 2
......VIDEO_TS
..X-Men United
....VIDEO_TS
..The Last Stand
....VIDEO_TS

I assume this is not how it needs to be done, because your app isn't catching the Disc 1/2 thing and is trying to capture both.

How do I go about dealing with this?

Thanks again for any help, very much appreciated!

[iolaus]

Originally Posted by White94Cobra

Hmm... I updated to the latest RC and did a refresh but still no movie data. Where does the properties file need to go?

Same problem here. Running latest RC and utility runs great (creates all .properties files) but no info showing up for DVD folders. The few .mkv files I have are showing up with info as expected.

[White94Cobra]

Originally Posted by iolaus

Same problem here. Running latest RC and utility runs great (creates all .properties files) but no info showing up for DVD folders. The few .mkv files I have are showing up with info as expected.

After removing my imports directory for a 3rd time, refreshing, shutting down, restarting, adding the import directory back and refreshing again the property files are now being read.

Now I need to figure out how to deal with the few movies that it got wrong (very impressive that it got 195 out of 200 right).

Thanks for an amazing tool!

[iolaus]

Originally Posted by White94Cobra

After removing my imports directory for a 3rd time, refreshing, shutting down, restarting, adding the import directory back and refreshing again the property files are now being read.

Now I need to figure out how to deal with the few movies that it got wrong (very impressive that it got 195 out of 200 right).

Thanks for an amazing tool!

Thanks White94Cobra, that seemed to do it.

[jusjoken]

I noticed in the .properties files that this utility creates, there are a number of "non-standard" properties included...

_releaseDate=
_aspectRatio=
_userRating=
_thumbnailUrl=
_company=

Are these imported into Sage? If not, what are they there for?

Ken

[stuckless]

Sorry for not responding sooner to some of these requests..... I just just back from a 2 week vacation at the cottage.... and I didn't have interent there

I have a question about "stacking" though. I'm not sure how to take advantage of this, within your app, or within Sage...and am looking for a little advice.

Video stacking is process whereby multi cd movies are grouped to appear as a single video. It only works with multi-cd files and not directories (yet). So if you had a movie "batman cd1.avi" and "batman cd2.avi", then the tool would stack/group them and as a result the tool would only need to fetch the metadata once and write it for both files. Sage does not support stacking at all. So this was added to give increased performance for people (myself) that have a lot of multi-cd movie files.

Now I need to figure out how to deal with the few movies that it got wrong (very impressive that it got 195 out of 200 right).

Just edit the .properties file and field the _providerUrl to the correct imdb url for the movie. Save, then rerun the tool using --update

I noticed in the .properties files that this utility creates, there are a number of "non-standard" properties included...
_releaseDate=
_aspectRatio=
_userRating=
_thumbnailUrl=
_company=

_providerId, _providerUrl, and _thumbnailUrl are used internally by the tool. All other names starting with _ are simply there because i could parse information for it. At some point in time, I may looking at writing a Movies stv and I may use these extra fields. As well.... perhaps the Sage folks may see them and decide to add them to their supported fields. I used an underscore to denote non sage properties.

[bcjenkins]

Hey welcome back.

[stuckless]

Hey welcome back.

Thanks! 2 weeks without internet.... very tough

[rrambo]

Originally Posted by stuckless

Video stacking is process whereby multi cd movies are grouped to appear as a single video. It only works with multi-cd files and not directories (yet). So if you had a movie "batman cd1.avi" and "batman cd2.avi", then the tool would stack/group them and as a result the tool would only need to fetch the metadata once and write it for both files. Sage does not support stacking at all. So this was added to give increased performance for people (myself) that have a lot of multi-cd movie files.

How does the updater detect this?? I have several movies that are split, but the naming of the files vary greatly... ie, CD1, CD2 or Part1, Part2, etc... is the updater looking for something specifically in the filename to determine if stacking should occur?

[jusjoken]

Look in the metadataupdater.properties file (or create on if there isn't one). the following line uses regex to determine if the file is a "stacked" CD...

# Regular Expression for deciding how to stack/group cds
org.jdna.media.impl.CDStackingModel.StackingRegex=[ _\\.-]+(cd|dvd|part)[ _\\.-]*([0-9a-d]+)

K

[bcjenkins]

When you upgrade from a previous version, make sure you remove the old JAR file in the libs directory too.

B

[tonysathre]

Any chance of adding MP4 support? It seems to work great on all my DVD rips, except the MP4's.

[stuckless]

You can add support for additional file types by creating a metadataupdater.properties file in the installation root and then adding/updating the following line.

# Regular Expression for determining a Video File
org.jdna.media.impl.MovieResourceFilter.VideoExtensionRegex=avi|mpg|divx|mkv|wmv|mov|xvid

To add a new file format, just append to the regular expression, for example

# Regular Expression for determining a Video File
org.jdna.media.impl.MovieResourceFilter.VideoExtensionRegex=avi|mpg|divx|mkv|wmv|mov|xvid|mp4

See the Wiki Page for more information about configuration properties.

I'll make a note to add the mp4 extension to the internal configuration for the next build.

[tonysathre]

Awesome. Thanks a lot.

[kentro71]

I know someone already asked this, but I haven't seen it answered yet. The utility is placeing the created files in the root of the drive where the movie folders are located (i.e. e:\). Is there a way to have them created in the movie folder (i.e. e:\terminator2\). Also thank you very much for creating this great utility.

[stuckless]

I know someone already asked this, but I haven't seen it answered yet. The utility is placeing the created files in the root of the drive where the movie folders are located (i.e. e:\). Is there a way to have them created in the movie folder (i.e. e:\terminator2\). Also thank you very much for creating this great utility.

I could update the tool to do that.... but my understanding is that Sage will not pick up the files unless they are at the same level as the dvd folder. Currently there is an option to have the thumbnail written to the VIDEO_TS folder, since sage will pick it up there.

Could someone comment on whether or not Sage will pick up properties and thumbnails if they are in the dvd folder itself. Originially I did write them there, but there were several complaints that the properties and thumbnail must be written to th same directory as the dvd folder.

[kentro71]

I'm sorry let me explain my structure. I store my movies on an external drive (e:\). All my movies are in there own directories there (e:\movie name\videoTS). The utility is creating all its files at the root of e:\. I would like to have them created in e:\movie name\. This is what I'm using at the command prompt c:\metadata\java -jar metadatatool.jar --update. I'm guessing I'm doing it correctly, if not please let me know. Thank you for your help.