Utility: Batch Metadata Importer 3.x

[heffe2001]

Originally Posted by stuckless

ok.... i'll try to take a look at it tonight.

In your example above (both places), you have this line:

/compositeMetadataProviders/dvdprof2/searchproviderIdd=dvdprofiler

I think it should be:

/compositeMetadataProviders/dvdprof2/searchProviderId=dvdprofiler

Changing that appears to let it work correctly.

[stuckless]

it was typo on my part...

[VikingCrown]

Sean,

Got this up and running this morning and noticed that when using the manual fan art search for tv recordings it downloads only 1 background. Is it possible to get more than 1? Also is this tool supposed to also download Banners? I know they aren't supported yet, but i keep waiting for Ben to pull something awesome together to get a banner type view for recordings.

Anyway, works great, thanks for all the hard work!!!

~ Brian

[stuckless]

Originally Posted by VikingCrown

Sean,

Got this up and running this morning and noticed that when using the manual fan art search for tv recordings it downloads only 1 background. Is it possible to get more than 1? Also is this tool supposed to also download Banners? I know they aren't supported yet, but i keep waiting for Ben to pull something awesome together to get a banner type view for recordings.

Anyway, works great, thanks for all the hard work!!!

~ Brian

Biran, if it's only downloading 1 background, it's because there was only a single background returned in the details. I recently added code that would limit the # of images downloaded, but it's default is 5. Also, the banners is an issue in the xbmc scraper... I have a bug opened for it... but I'm sure if I'm going to continue to use the tvdb scraper or simply build a direct integration to the thetvdb.com using their api.

[tmiranda]

61 Enabled plugin to support ShowTitle-airingid.mpg titles
Not fully tested, but it should try to find an airing for the file, and if it's
there, then it will use the airing series title for the lookup... otherwise, it will
continue on with the normal plugin operation.

Sean,

I'm sorry but I still can't get this to work using the latest 2.1.1 release. For example, AmericanIdol-5665432-0.mpg comes up with:

"Search Results AmericanIdol 5665432 0" and no matches.

I'm using the following command line:

java -jar MetadataTool.jar --fanartFolder=c:\Temp\FanArt --recurse --fanartOnly --tv=true \\NASLite\Disk-1

Thanks,

Tom

[KJake]

That was tagged for 2.1.2, but hasn't been released yet.

http://code.google.com/p/customsaget...il?id=61&can=1

[stuckless]

There's no new bug fixes.

I've added --report option that that requires that the Sage Remote APIs be installed on your sage server in order to use it.

--report takes 3 possible values
quick - produces a quick report, checking your configuration on the server
detailed - produces a file on the server, phoenix-diagnostics.txt, which contains information about your configuration and every file in your library.

The 3rd options for --report is the fully path to a sagetv mediafile. This will return a quick report containing fanart information about that 1 file.

The --report option is meant to help you track down "why" things are not working. It requires the sage remote apis because the the report is actually run inside the side environment... bmt just triggers it.

To run the report..

# java -jar MetadataTool.jar --report=quick
or
# java -jar MetadataTool.jar --report=detailed
or
# java -jar MetadataTool.jar --report="/media/home/FileServer/Media/Videos/VideoCollection/Movies/Thriller/Saw_(2004)_DVDRip_DivX.avi"

A Sample report looks something like this....

Batch MetaData Tools (2.1-2)
Requesting a Fanart report: /media/home/FileServer/Media/Videos/VideoCollection/Movies/Thriller/Saw_(2004)_DVDRip_DivX.avi on the SageTV Server.
SageAPI Provider is not set, will try to find the server...
Sage Provider Implementation: sagex.remote.rmi.RMISageAPI; rmi://mediaserver:1098
         Phoenix Diagnostic Report - Date: Apr 10, 2009 6:11:01 PM         


                          === Version Checks ===                           
               Phoenix Version: 1.19
             Sagex.api Version: 6.5.9-7
                  Sage Version: 6.5.13.1

                   === Metadata/Fanart Configuration ===                   
        Custom Metadata Fields: MediaProviderDataID;MediaTitle;MediaType;OriginalAirDate;EpisodeTitle;EpisodeNumber;SeasonNumber;DiscNumber;UserRating
    MediaFile Metadata Plugins: org.jdna.sage.MetadataUpdaterPlugin
Manual Metadata Lookups Enabled: true

                 === Phoenix Metadata/Fanart Settings ===                  
phoenix/mediametadata/fanartEnabled: true
phoenix/mediametadata/fanartCentralFolder: /home/FileServer/Media/Fanart
phoenix/mediametadata/parseMediaFileForTVSeries: false
phoenix/mediametadata/tvSeriesRegex: null
phoenix/mediametadata/tvSeasonRegex: null
phoenix/mediametadata/fanartSupportClass: sagex.phoenix.fanart.PhoenixFanartSupport
phoenix/mediametadata/mediaMetadataSupportClass: bmt.BMTMetadataSupport


BEGIN MediaFile /media/home/FileServer/Media/Videos/VideoCollection/Movies/Thriller/Saw_(2004)_DVDRip_DivX.avi
                 Display Title: Saw 4

                        --- RAW Metadata Fields ---                        
                    MediaTitle: Saw 4
                     MediaType: Movie
                  SeasonNumber: 

                    --- Calculated Metadata Fields ---                     
                    MediaTitle: Saw 4
                     MediaType: MOVIE
                  SeasonNumber: 0

                           --- Fanart Paths ---                            
               Background Path: /home/FileServer/Media/Fanart/Movies/Saw 4/Backgrounds
                   Banner Path: /home/FileServer/Media/Fanart/Movies/Saw 4/Banners
                   Poster Path: /home/FileServer/Media/Fanart/Movies/Saw 4/Posters

                   --- Fanart Single Files and Times ---                   
                    Background: /home/FileServer/Media/Fanart/Movies/Saw 4/Backgrounds/1280_saw4-wallpaper4.jpg
          Background Time (ms): 1
                        Banner: null
              Banner Time (ms): 1
                        Poster: /home/FileServer/Media/Fanart/Movies/Saw 4/Posters/saw4.jpg
              Poster Time (ms): 1
END MediaFile /media/home/FileServer/Media/Videos/VideoCollection/Movies/Thriller/Saw_(2004)_DVDRip_DivX.avi

[theringnebula]

I am using 2.1-2 and I am still getting the Fata Error :1:1: Premature end of file

[Nick_W]

This is what's happening for TV series (not ones recorded by Sage).

BEGIN MediaFile \\NAS1\Video\TV\24\Season 7\24 S07E10.mkv
                 Display Title: 24 S07E10

                        --- RAW Metadata Fields ---                        
                    MediaTitle: 
                     MediaType: 
                  SeasonNumber: 

                    --- Calculated Metadata Fields ---                     
                    MediaTitle: 24 S07E10
                     MediaType: MOVIE
                  SeasonNumber: 0

                           --- Fanart Paths ---                            
               Background Path: \\NAS1\FanArt\Movies\24 S07E10\Backgrounds
                   Banner Path: \\NAS1\FanArt\Movies\24 S07E10\Banners
                   Poster Path: \\NAS1\FanArt\Movies\24 S07E10\Posters

                   --- Fanart Single Files and Times ---                   
                    Background: null
          Background Time (ms): 0
                        Banner: null
              Banner Time (ms): 0
                        Poster: null
              Poster Time (ms): 0
END MediaFile \\NAS1\Video\TV\24\Season 7\24 S07E10.mkv

[stuckless]

Originally Posted by theringnebula

I am using 2.1-2 and I am still getting the Fata Error :1:1: Premature end of file

Did you delete the existing cache directory in your sagetv root folder. I was seeing the premature end of file, but i thought that I had fixed it in 2.1-1. I haven't seen the premature end of file since that build.

[stuckless]

Nick, at the beginning of that report, there should have been some information about the versions that you are using. Did it report any warning/errors about the versions?

Typically if you are not seeing any data for the RAW Metadata Fields, then this is usually because you are not running the correct version of sagetv server, or you haven't configured the custom metadata fields, or you haven't rescanned since you've upgraded to the latest sagetv server version?

[Nick_W]

Hi,

This is the beginning of the file:

          Phoenix Diagnostic Report - Date: 11-Apr-2009 15:00:58           


                          === Version Checks ===                           
               Phoenix Version: 1.19
             Sagex.api Version: 6.5.9-7
                  Sage Version: 6.5.12.208

                   === Metadata/Fanart Configuration ===                   
        Custom Metadata Fields: 
    MediaFile Metadata Plugins: org.jdna.sage.MetadataUpdaterPlugin
Manual Metadata Lookups Enabled: true

                 === Phoenix Metadata/Fanart Settings ===                  
phoenix/mediametadata/fanartEnabled: true
phoenix/mediametadata/fanartCentralFolder: \\NAS1\FanArt
phoenix/mediametadata/parseMediaFileForTVSeries: false
phoenix/mediametadata/tvSeriesRegex: null
phoenix/mediametadata/tvSeasonRegex: null
phoenix/mediametadata/fanartSupportClass: sagex.phoenix.fanart.PhoenixFanartSupport
phoenix/mediametadata/mediaMetadataSupportClass: bmt.BMTMetadataSupport

Doesn't look like there are errors.

What to you mean about a rescan, the normal SageTV media scan or something else. If it's something else, then I haven't done it!

TIA,

Nick.

[stuckless]

See the new reporting is working already....

=== Metadata/Fanart Configuration ===
Custom Metadata Fields:
MediaFile Metadata Plugins: org.jdna.sage.MetadataUpdaterPlugin
Manual Metadata Lookups Enabled: true

You are missing the Custom Metadata Fields (although for some reason, I'm not reporting it as an error, so I'll update the check)

I think in the bmt builds, I include a .properties.sample file that includes the custom_metadata_fields that you need to add to you sage server's Sage.properties. Once those properties are configured, then you'll need to rescan your collection (set the sage reindex property) and then those new metadata fields will start to get populated.

I'm not at home right now, or else I would have posted the full custom metadata fields line here.

[Nick_W]

Hi,

Yes, I found that file, so I add that to sage.properties (not the client properties)?

custom_metadata_properties=MediaProviderDataID;MediaTitle;MediaType;OriginalAirDate;EpisodeTitle;EpisodeNumber;SeasonNumber;DiscNumber;UserRating

And then rescan with your tool?

TIA,

Nick.

[stuckless]

Personally, I would do a couple of small tests with 24 and see if its picking up the new metadata fields. You can rescan using my tool, or EP's tool. Both support the new metadata fields.

[theringnebula]

Originally Posted by stuckless

Did you delete the existing cache directory in your sagetv root folder. I was seeing the premature end of file, but i thought that I had fixed it in 2.1-1. I haven't seen the premature end of file since that build.

Hi, I am running the tool standalone in it's own folder and I do delete the cache when the error occurs. This seems to help it but them randomly after a while it comes back. It happens in 2.1-1 and 2.1-2. I installed the tool fresh in it's own folder to make sure.

[stuckless]

Originally Posted by theringnebula

Hi, I am running the tool standalone in it's own folder and I do delete the cache when the error occurs. This seems to help it but them randomly after a while it comes back. It happens in 2.1-1 and 2.1-2. I installed the tool fresh in it's own folder to make sure.

Ok.... i'll dig deeper.

[sflamm]

I had SageTV configured to automatically import the "dvd profiler" collection.xml. I wanted to try this new great tool.

I took the following steps:

1. Left the "dvd profiler path" and "meta data xml" psettings alone under SageMC options... (this was working with just the import dvd profiler capability)
2. I turned off the "meta data options" --> "auto load dvd profiler meta data" under the Video library (was set to 'enabled')
3. I loaded the BMT files into the SageTV directory (after shutting down the service etc)
4. I restarted everything and then loaded the STVi from SageMC options
5. I configued the 'metadata/fanart sources' to use "dvd profiler" for meta data (added) and positioned it into the 1st slot (at the top)
6. I 'enabled' the "automatic metadata/fanart"
7. I left fanart 'disabled'
8. I put the "force_... = true" into my sage.properties (after stopping service etc...)
9. restarted everything

It does not fill in meta data for any of my movies from the "dvd profiler" collection xml.

My movies are in directories which are either 1) standard dvd 2) blu-ray (directory formats)

Can someone guide me to what I did wrong?

I know the plugin is active because I can right click on a movie and it brings up a menu with the option to search for the meta data...


Running SageMC 6.3.9 and SageTV 6.5.9

[Nick_W]

It works!

[sflamm]

I've done more experiments - even when I tell the BMT plug-in that the only source of metadata is the "dvd profiler" -- somehow it sometimes pulls data from the moviedb.org and imdb????!

A History of Violence.properties

#Sage Video Metadata for file:////NAS/Videos/A%20History%20of%20Violence/
#Mon Apr 13 00:54:57 PDT 2009
Actor=Viggo Mortensen -- Tom Stall;\nMaria Bello -- Edie Stall;\nHeidi Hayes -- Sarah Stall;\nAshton Holmes -- Jack Stall;\nWilliam Hurt -- Richie Cusack;\nEd Harris -- Carl Fogerty;\nPeter MacNeill -- Sheriff Sam Carney;\nStephen McHattie -- Leland;\nGreg Bryk -- Billy;\nKyle Schmid -- Bobby;\nSumela Kay -- Judy Danvers;\nGerry Quigley -- Mick;\nDeborah Drakeford -- Charlotte;\nBill MacDonald -- Frank Mulligan;\nAidan Devine -- Charlie Roarke;
Description=A David Cronenberg film about a small town man who becomes a hero after brutally killing two robbers in his diner. The incident is blown up in the media and questions of his identity are raised as he tries to protect what\u2019s most important to him - his family.\nUser Rating\: 7\n
Director=David Cronenberg;
Genre=Mainstream
MediaProviderDataID=themoviedb\:59
MediaTitle=A History of Violence
MediaType=Movie
OriginalAirDate=2005-09-23
RunningTime=5520000
Title=A History of Violence
UserRating=7
Writer=Josh Olsen;
Year=2005
x-Fanart-BackgroundUrl=http\://www.themoviedb.org/image/backdrops/113/tt0399146.jpg
x-Fanart-PosterUrl=http\://www.themoviedb.org/image/posters/1217/History_of_Violence.jpg
x-MetadataProviderDataUrl=http\://api.themoviedb.org/2.0/Movie.getInfo?id\=59&api_key\=
x-MetadataProviderId=themoviedb.org
x-ser-Cast=2|David Cronenberg|null|http\://www.themoviedb.org/person/224;99|David Cronenberg|producer|http\://www.themoviedb.org/person/224;0|Viggo Mortensen|Tom Stall|http\://www.themoviedb.org/person/110;0|Maria Bello|Edie Stall|http\://www.themoviedb.org/person/49;0|Heidi Hayes|Sarah Stall|http\://www.themoviedb.org/person/226;0|Ashton Holmes|Jack Stall|http\://www.themoviedb.org/person/225;0|William Hurt|Richie Cusack|http\://www.themoviedb.org/person/227;0|Ed Harris|Carl Fogerty|http\://www.themoviedb.org/person/228;0|Peter MacNeill|Sheriff Sam Carney|http\://www.themoviedb.org/person/229;0|Stephen McHattie|Leland|http\://www.themoviedb.org/person/230;0|Greg Bryk|Billy|http\://www.themoviedb.org/person/231;0|Kyle Schmid|Bobby|http\://www.themoviedb.org/person/232;0|Sumela Kay|Judy Danvers|http\://www.themoviedb.org/person/233;0|Gerry Quigley|Mick|http\://www.themoviedb.org/person/234;0|Deborah Drakeford|Charlotte|http\://www.themoviedb.org/person/235;0|Bill MacDonald|Frank Mulligan|http\://www.themoviedb.org/person/236;0|Aidan Devine|Charlie Roarke|http\://www.themoviedb.org/person/237;99|Chris Bender|producer|http\://www.themoviedb.org/person/298;99|J. C. Spink|producer|http\://www.themoviedb.org/person/299;1|Josh Olsen|null|http\://www.themoviedb.org/person/305;99|John Wagner|author|http\://www.themoviedb.org/person/306;99|Peter Suschitzky|director_of_photography|http\://www.themoviedb.org/person/307;99|Ronald Sanders|editor|http\://www.themoviedb.org/person/310;99|Howard Shore|original_music_composer|http\://www.themoviedb.org/person/117;99|Vince Locke|author|http\://www.themoviedb.org/person/4484
x-ser-Description=A David Cronenberg film about a small town man who becomes a hero after brutally killing two robbers in his diner. The incident is blown up in the media and questions of his identity are raised as he tries to protect what\u2019s most important to him - his family.
x-ser-Genres=Mainstream;Thriller;Drama Film;Family Drama;Marital Tragedy;Literary Fiction;Comic

After the Wedding.properties

#Sage Video Metadata for file:////NAS/Videos/After%20the%20Wedding/
#Mon Apr 13 00:54:57 PDT 2009
Description=\nUser Rating\: \n
MediaProviderDataID=imdb\:tt1340083
MediaTitle=After the Wedding
MediaType=Movie
Title=After the Wedding
Year=2010
x-MetadataProviderDataUrl=http\://www.imdb.com/title/tt1340083/
x-MetadataProviderId=themoviedb.org-2

And it absolutely isnt recognizing BDMV folder structures at all...


Is there something wrong with having the following for the "dvd profiler":

meta data xml = \\NAS\SageTV\DVD Profiler\Collection.xml
dvd profiler path = \\NAS\SageTV\DVD Profiler\Databases\Default

I do not have "DVD Profiler" installed locally. I am using it on another machine to write the outputs in the correct directories.
Do I need to install it locally on the server for this to work?


Can someone tell me what's going on?