Metadata Tools 4.0 Beta Thread (aka BMT 4.0)

[stuckless]

Originally Posted by tmiranda

OK, thanks for that. Where is the documentation for the API? I'd like to update the STV as well because I like to manually look up fanart. I read somewhere in this massive thread that the STV for version 3 will not work for version 4.

Tom... The API for this is in phoenix. You can grab the javadoc from here.

Basically the API is defined in the MediaMetadataAPI class, and to use the api, you just phoenix_api_ in front the method that you are going to call. BTW... I know Tiki was working on something at one point as well.. I don't know how far he got with it. If you do create something, then let me know, and I can include it in the future builds. And, if you have issues, you can email directly.

Originally Posted by PiX64

I have some odd BMT behavior going on and was wondering if anyone else is having any issues like this.

I have the auto plugin of the latest beta BMT build 21 turned off because it was causing me some serious pain and suffering with my metadata.

What is happening now is whatever the last file which i used BMT to find the metdata for and save it, it will DEFAULT for all new recordings to use this fanart, and even show names...

Example:

Deadliest Catch recorded last night.

I looked it up using bmt web and save the file info and fanart using bmt web.

Now my wife is upstairs watching a few shows, and as i look at them through the UI on y HD200 i see that they are showing up as Deadliset Catch..which they of course are not.

Strange, but any ideas, or more info i can provide to help you out?

This, unfortunately, is a long standing issue... since 3.x, that I have yet to get my head around. I have no idea, yet, why this happens to some people. Some people can reproduce it, but I've never been able to myself But the steps are usually the same... scan using the web ui... and then recorded shows have metadata of the last scanned file Could you send me a listing of all the files in your recordings directory, include .properties files?

[medwynd]

I was wondering if I am perhaps not naming my files properly for tv disc sets I have ripped to get metadata for them.

For example, Firefly has 4 discs so I named each rip
Firefly S01D01
...
Firefly S01D04

Same with Jericho and 2 seasons of True Blood.

Any advice on how to get metadata and art for tv disc collections?

[stuckless]

Originally Posted by medwynd

I was wondering if I am perhaps not naming my files properly for tv disc sets I have ripped to get metadata for them.

For example, Firefly has 4 discs so I named each rip
Firefly S01D01
...
Firefly S01D04

Same with Jericho and 2 seasons of True Blood.

Any advice on how to get metadata and art for tv disc collections?

Right now, it's broken for TV disc sets. It's being worked on, but I have no ETA.

[medwynd]

Ah ok. Is the naming convention I am using going to be fine or do you know what will be the desired naming scheme when you get it working? Also is there a good way to manually add the metadata if I go and just grab it from somewhere in the meantime?

[stuckless]

Originally Posted by medwynd

Ah ok. Is the naming convention I am using going to be fine or do you know what will be the desired naming scheme when you get it working? Also is there a good way to manually add the metadata if I go and just grab it from somewhere in the meantime?

The naming is fine... and 3.x did support SxxDxx sets... but in 4.x I broke it when I added validation to ensure that I didn't grab "series" related info for shows where it failed to find a valid episdoe. ie, sometiimes it would overwrite specific show information the the generic series info. The are 2 possible fixes for this... 1 to make it work as it did in 3.x, or 2, to add in specific support for Series only information. I'm opting for the latter, but unforuntately, I haven't hit it on my list yet

[Tiki]

Originally Posted by stuckless

BTW... I know Tiki was working on something at one point as well.. I don't know how far he got with it. If you do create something, then let me know, and I can include it in the future builds. And, if you have issues, you can email directly.

Yes, I do have an updated STVi that works with BMT4.0 beta. I could probably release it this weekend if people are eager for it.

[broconne]

Can BMT be run from inside of SJQ?

I ask because I seem to get different results when it is run inside of vs. outside of SJQ.

Here is my SJQ Confiugration:

BMT {

   # CPU priority to be used for this task process; one of LOW, NORMAL, HIGH (case sensitive)
   :CPU "LOW"   # Default is NORMAL if not specified

   "C:/Program Files/Java/jre6/bin/java.exe -jar \"C:/Program Files/SageTV/SageTV/Metadatatool.jar\" --auto=true --prompt=false --touch --notifySageTV --overwrite \"%c%\""
}

Result:

Executing command line: C:/Program Files/Java/jre6/bin/java.exe -jar "C:/Program Files/SageTV/SageTV/Metadatatool.jar" --auto=true --prompt=false --touch --notifySageTV --overwrite "E:\TheSimpsons-ChiefofHearts-47814-0.mpg"
Batch MetaData Tools (4.0-beta16)
Processing Media Files...
Processing: TheSimpsons-ChiefofHearts-47814-0.mpg
         Updated: 0 items
Failed to Update: 1 items
  File: E:\TheSimpsons-ChiefofHearts-47814-0.mpg
Reason: Failed to find a metadata match for title
---------------------------------
Notifying Sage to Refresh Imported Media

Which seems to indicate that meta data for "The Simpsons" cannot be located.
But if I run with the same parameters outside of SJQ I get a different result.

C:\Program Files\SageTV\SageTV>java.exe -jar "C:/Program Files/SageTV/SageTV/Met
adatatool.jar" --auto=true --prompt=false --touch --notifySageTV --overwrite "E:
\TheSimpsons-ChiefofHearts-47814-0.mpg
Batch MetaData Tools (4.0-beta16)
*** filter by: mediatype
*** Adding Filter To Presenter: mediatype; tvseason
*** filter by: title
*** Adding Filter To Presenter: title; filtertest
*** filter by: missingmetadata
*** Adding Filter To Presenter: missingmetadata; missingmetadataview
Processing Media Files...
Processing: TheSimpsons-ChiefofHearts-47814-0.mpg
         Updated: 1 items
Failed to Update: 0 items
Notifying Sage to Refresh Imported Media

Does anyone successfully run BMT inside of SJQ? If so, how do you do it?

[stuckless]

@broconne - While I've never run SJQ... that is is interesting. I'd need to see the log output of the SJQ attempt to see what is actually going wrong.

[broconne]

Originally Posted by stuckless

@broconne - While I've never run SJQ... that is is interesting. I'd need to see the log output of the SJQ attempt to see what is actually going wrong.

Stuckless, I can run it again. I don't see any --log option. How do I create log output from the command line?

[stuckless]

Originally Posted by broconne

Stuckless, I can run it again. I don't see any --log option. How do I create log output from the command line?

you should see a bmt.log in the logs directory in the sagetv home dir.

[broconne]

Originally Posted by stuckless

you should see a bmt.log in the logs directory in the sagetv home dir.

Looks like I need a way to specify the absolute path for the Phoenix.xml

0 ERROR [main] sagex.phoenix.configuration.XmlMetadataProvider - Missing Configuration File: C:\sjqc\sjqc_winntsvc\bin\.\STVs\Phoenix\Configuration\Phoenix.xml

[stuckless]

Originally Posted by broconne

Looks like I need a way to specify the absolute path for the Phoenix.xml

0 ERROR [main] sagex.phoenix.configuration.XmlMetadataProvider - Missing Configuration File: C:\sjqc\sjqc_winntsvc\bin\.\STVs\Phoenix\Configuration\Phoenix.xml

Unfortunately that is really only an error if you are running the full phoenix build (which you can't do ). This is a common "error" (more like a warning), for other tools that use the phoenix apis, such as bmt.

[broconne]

Originally Posted by stuckless

Unfortunately that is really only an error if you are running the full phoenix build (which you can't do ). This is a common "error" (more like a warning), for other tools that use the phoenix apis, such as bmt.

Interesting, I don't have a bmt.log in my SageTV directory and that is the only entry in the bmt.log in my SJQ client directory.

[razrsharpe]

Originally Posted by broconne

I don't have a bmt.log in my SageTV directory

check SageTV Directory\logs\bmt.log

[broconne]

Originally Posted by razrsharpe

check SageTV Directory\logs\bmt.log

Ok, the BMT log in there is empty.. I upgraded to the latest beta (sorry, I thought I was already there). After doing that, restarting everything, and rerunning I seem to have a fully formed bmt.log in my sqjc directory:

2010-04-23 11:30:23,825 [main] WARN  org.jdna.metadataupdater.BMTSageAPIProvider - No Sage Properties found, using defaults.
2010-04-23 11:30:23,875 [main] INFO  bmt.BMT - ========= BEGIN BATCH METADATA TOOLS ENVIRONMENT ==============
2010-04-23 11:30:23,875 [main] INFO  bmt.BMT -     BMT Version:  4.0-beta21
2010-04-23 11:30:24,246 [main] INFO  bmt.BMT - Phoenix Version:  1.71
2010-04-23 11:30:24,246 [main] INFO  bmt.BMT -   Sagex Version:  6.6.9-beta
2010-04-23 11:30:24,246 [main] INFO  bmt.BMT -    Java Version:  1.6.0_19
2010-04-23 11:30:24,246 [main] INFO  bmt.BMT -  Java Classpath:  C:/Program Files/SageTV/SageTV/Metadatatool.jar
2010-04-23 11:30:24,246 [main] INFO  bmt.BMT - ========= END BATCH METADATA TOOLS ENVIRONMENT ==============
2010-04-23 11:30:24,246 [main] INFO  bmt.BMT - Registering URL Cache Cleaner Process
2010-04-23 11:30:24,246 [main] INFO  org.jdna.url.CachedUrlCleanupTask - Url Cleanup Task Created
2010-04-23 11:30:24,246 [Timer-0] INFO  org.jdna.url.CachedUrlCleanupTask - Begin URL Cache Cleanup
2010-04-23 11:30:24,256 [Timer-0] INFO  org.jdna.url.CachedUrlCleanupTask - Finished URL Cache Cleanup; Cleaned 0 items.
2010-04-23 11:30:24,296 [main] INFO  org.jdna.media.metadata.MediaMetadataFactory - Adding MetaDataProvider: thetvdb.com
2010-04-23 11:30:24,296 [main] INFO  org.jdna.media.metadata.MediaMetadataFactory - Adding MetaDataProvider: IMDb
2010-04-23 11:30:24,296 [main] WARN  org.jdna.media.metadata.MediaMetadataFactory - No Class Implementation for provider: org.jdna.media.metadata.impl.nielm.NielmIMDBMetaDataProvider
2010-04-23 11:30:24,296 [main] INFO  org.jdna.media.metadata.MediaMetadataFactory - Adding MetaDataProvider: DVD Profiler
2010-04-23 11:30:24,296 [main] INFO  org.jdna.media.metadata.MediaMetadataFactory - Adding MetaDataProvider: themoviedb.org
2010-04-23 11:30:24,306 [main] INFO  org.jdna.media.metadata.MediaMetadataFactory - Adding MetaDataProvider: MyMovies
2010-04-23 11:30:24,306 [main] WARN  org.jdna.media.metadata.MediaMetadataFactory - Mising or Unknown Provider: imdb-2
2010-04-23 11:30:24,306 [main] INFO  org.jdna.media.metadata.impl.composite.CompositeMetadataProvider - Composite Provider Created with id: imdb-2; search: imdb; details: themoviedb.org; mode: 1
2010-04-23 11:30:24,306 [main] INFO  org.jdna.media.metadata.MediaMetadataFactory - Adding MetaDataProvider: IMDb + themoviedb.org
2010-04-23 11:30:24,306 [main] WARN  org.jdna.media.metadata.MediaMetadataFactory - Mising or Unknown Provider: dvdprofiler-2
2010-04-23 11:30:24,306 [main] INFO  org.jdna.media.metadata.impl.composite.CompositeMetadataProvider - Composite Provider Created with id: dvdprofiler-2; search: dvdprofiler; details: themoviedb.org; mode: 1
2010-04-23 11:30:24,306 [main] INFO  org.jdna.media.metadata.MediaMetadataFactory - Adding MetaDataProvider: DVD Profiler + themoviedb.org
2010-04-23 11:30:24,306 [main] WARN  org.jdna.media.metadata.MediaMetadataFactory - Mising or Unknown Provider: mymovies-2
2010-04-23 11:30:24,306 [main] INFO  org.jdna.media.metadata.impl.composite.CompositeMetadataProvider - Composite Provider Created with id: mymovies-2; search: mymovies; details: themoviedb.org; mode: 1
2010-04-23 11:30:24,306 [main] INFO  org.jdna.media.metadata.MediaMetadataFactory - Adding MetaDataProvider: MyMovies + themoviedb.org
2010-04-23 11:30:24,306 [main] WARN  org.jdna.media.metadata.MediaMetadataFactory - Mising or Unknown Provider: themoviedb.org-2
2010-04-23 11:30:24,306 [main] INFO  org.jdna.media.metadata.impl.composite.CompositeMetadataProvider - Composite Provider Created with id: themoviedb.org-2; search: imdb; details: themoviedb.org; mode: 1
2010-04-23 11:30:24,306 [main] INFO  org.jdna.media.metadata.MediaMetadataFactory - Adding MetaDataProvider: IMDb + themoviedb.org
2010-04-23 11:30:24,306 [main] INFO  org.jdna.media.metadata.MediaMetadataFactory - Added Provider: imdb-2 to the Provider Search Container
2010-04-23 11:30:24,306 [main] INFO  org.jdna.media.metadata.MediaMetadataFactory - Added Provider: themoviedb.org to the Provider Search Container
2010-04-23 11:30:24,306 [main] WARN  org.jdna.media.metadata.MediaMetadataFactory - Mising or Unknown Provider: imdb.xml
2010-04-23 11:30:24,306 [main] WARN  org.jdna.media.metadata.MediaMetadataFactory - Skipping Provider because it does not exist: imdb.xml
2010-04-23 11:30:24,326 [main] WARN  org.jdna.media.metadata.TVFileNameUtils - No TV Scraper Files: C:\sjqc\sjqc_winntsvc\bin\scrapers\xbmc\tvfilenames
2010-04-23 11:30:24,326 [main] WARN  org.jdna.media.metadata.MovieFileNameUtils - No Movies Scraper Files: C:\sjqc\sjqc_winntsvc\bin\scrapers\xbmc\moviefilenames
2010-04-23 11:30:24,326 [main] WARN  org.jdna.media.metadata.TVFileNameUtils - No TV Scrapers were loaded
2010-04-23 11:30:24,326 [main] WARN  org.jdna.media.metadata.MovieFileNameUtils - Failed to parse move title using scrapers for: E:\TheSimpsons-ChiefofHearts-47814-0.mpg, will use the following movie title: TheSimpsons-ChiefofHearts-47814-0
2010-04-23 11:30:24,336 [main] INFO  org.jdna.url.URLSaxParser - Parsing Url: http://www.imdb.com/find?s=tt&q=TheSimpsons-ChiefofHearts-47814-0&x=0&y=0
2010-04-23 11:30:24,336 [main] INFO  org.jdna.url.CachedUrlFactory - Caching URL Factory in use.
2010-04-23 11:30:25,437 [main] WARN  org.jdna.media.metadata.impl.themoviedb.TheMovieDBMetadataProvider - TheMovieDB Item didn't contain a title: Your query didn't return any results.
2010-04-23 11:30:25,437 [main] INFO  org.jdna.url.URLSaxParser - Parsing Url: http://www.imdb.com/find?s=tt&q=TheSimpsons+ChiefofHearts+47814+0&x=0&y=0
2010-04-23 11:30:26,228 [main] WARN  org.jdna.media.metadata.impl.themoviedb.TheMovieDBMetadataProvider - TheMovieDB Item didn't contain a title: Your query didn't return any results.
2010-04-23 11:30:26,228 [main] WARN  org.jdna.process.MetadataProcessor - Failed to find a metadata match for FileMediaFile[Title: 'TheSimpsons-ChiefofHearts-47814-0.mpg', File: 'E:\TheSimpsons-ChiefofHearts-47814-0.mpg']

Looks like I need to be able to specify the FQN for the scrappers.. Or I need a way in BMT to set my working directory.

[stuckless]

ok.. now we are getting somewhere BMT assumes that you are going to run it from the sagetv home dir, and it attempts to load it's scrapers relative to that location. So, is there a way in SJQ to tell it to use a particular working dir...if so, then set that to the sagetv dir. If not, then you may need to create a .bat file and set up the environment there... or you can extract the bmt zip file to the sjq home dir and run it from there...

[broconne]

Originally Posted by stuckless

ok.. now we are getting somewhere BMT assumes that you are going to run it from the sagetv home dir, and it attempts to load it's scrapers relative to that location. So, is there a way in SJQ to tell it to use a particular working dir...if so, then set that to the sagetv dir. If not, then you may need to create a .bat file and set up the environment there... or you can extract the bmt zip file to the sjq home dir and run it from there...

Stuckless - Thanks for all the help. SJQ doesn't support setting the working directory, so I did it inside a batch file. Thanks agian.

[stuckless]

Originally Posted by broconne

Stuckless - Thanks for all the help. SJQ doesn't support setting the working directory, so I did it inside a batch file. Thanks agian.

Glad you have it working.

[toricred]

@broconne when you run it like this from SJQ are you successfully getting it to update Sage with the metadata? I've been trying to do it using the notifySage parameter and it doesn't seem to be getting updated, at least the Season and Episode don't update in TV Explorer. The automatic plugin works well for me except during prime-time for some reason. I'm just looking for a way to work around the problem during prime-time and SJQ might be the solution.

[broconne]

Originally Posted by toricred

@broconne when you run it like this from SJQ are you successfully getting it to update Sage with the metadata? I've been trying to do it using the notifySage parameter and it doesn't seem to be getting updated, at least the Season and Episode don't update in TV Explorer. The automatic plugin works well for me except during prime-time for some reason. I'm just looking for a way to work around the problem during prime-time and SJQ might be the solution.

@toricred - It certainly seems to update SageTV. Have you installed the Stuckless's remote APIs in his signature? They are required for the update to work AFAIK.

Here is my setup:

SJQ Server:

if [IsObjMediaFile == true && $.IsTVFile{} == true && FileExists != "%d%/%p%.properties"]{
   :PRIORITY 5
   BMT
}

Client Setup:

BMT {

   # CPU priority to be used for this task process; one of LOW, NORMAL, HIGH (case sensitive)
   :CPU "LOW"   # Default is NORMAL if not specified

   # Comskip returns 1 on success instead of the universally accepted zero; tell SJQ that
   # a return code of 1 means success instead of the default value of zero
   #:RETURNCODE 1

   "\"C:/Program Files/SageTV/SageTV/BMT.bat\" \"%c%\""
}

Here is my batch file:

@echo off
cd c:\Program Files\SageTV\SageTV
java.exe -jar Metadatatool.jar --auto=true --prompt=false --touch --notifySageTV
 --overwrite %1

Let me know if you need any more help getting this to go.