How to figure out why metadata isn't located?

[broconne]

Checked the wiki.. Didn't see any steps on how to debug this. Is there a guide to figure out why metadata is not located for a specific video?

I have a set of videos that it seems like BMT can't find data for. However, if I
go into the individual recording, select find metadata, manually select TV, then manually enter the season and episode numbers it matches it correctly, and it finds the metadata...

However, this show is named the exact same as others that it can find meta data for.

Is there a specific log that I should look into? I see this in the phoenix log:

2010-08-05 18:00:41,293 [Thread-773] WARN  phoenix.log - AutomaticMetadataVisitor(): lookup failed with an error for DecoratedItem: [Resource[Id: TMP7955871, Title: Snuff Box - S01E05]]
MetadataException [query=SearchQuery; Type: TV; SEASON:01;RAW_TITLE:Snuff Box -;CLEAN_TITLE:Snuff Box;FILE:\\stafford\tv\Snuff Box\Snuff Box - S01E05.avi;EPISODE_DATE:2009-08-24;DISC:;EPISODE:05;QUERY:Snuff Box;, ]
	at sagex.phoenix.metadata.MetadataManager.getMetdata(MetadataManager.java:476)
	at sagex.phoenix.metadata.MetadataManager.automaticUpdate(MetadataManager.java:556)
	at sagex.phoenix.metadata.MetadataManager.automaticUpdate(MetadataManager.java:526)
	at sagex.phoenix.metadata.AutomaticMetadataVisitor.visit(AutomaticMetadataVisitor.java:23)
	at sagex.phoenix.vfs.DecoratedMediaFile.accept(DecoratedMediaFile.java:48)
	at sagex.phoenix.vfs.DecoratedMediaFolder.accept(DecoratedMediaFolder.java:61)
	at sagex.phoenix.metadata.PhoenixMetadataSupport$1.run(PhoenixMetadataSupport.java:110)
	at sagex.phoenix.progress.ProgressTrackerManager$1.run(ProgressTrackerManager.java:48)
2010-08-05 18:00:41,293 [Thread-773] WARN  sagex.phoenix.metadata.search.TVFileNameUtils - Scraper sagex.phoenix.scrapers.xbmc.XbmcScraper@a756cf failed to parse year for: \\stafford\tv\Snuff Box\Snuff Box - S01E06.avi
2010-08-05 18:00:41,293 [Thread-773] INFO  sagex.phoenix.metadata.MetadataManager - search(): tvdb; SearchQuery; Type: TV; SEASON:01;RAW_TITLE:Snuff Box -;CLEAN_TITLE:Snuff Box;FILE:\\stafford\tv\Snuff Box\Snuff Box - S01E06.avi;EPISODE_DATE:2009-10-07;DISC:;EPISODE:06;
2010-08-05 18:00:41,293 [Thread-773] INFO  sagex.phoenix.metadata.MetadataManager - Searching: Snuff Box - using TVDBMetadataProvider[MetadataProviderInfo [id=tvdb, fanartId=null, mediaTypes=[TV], name=thetvdb.com]]
2010-08-05 18:00:41,293 [Thread-773] INFO  sagex.phoenix.metadata.provider.tvdb.TVDBSearchParser - TVDB Search: http://www.thetvdb.com/api/GetSeries.php?seriesname=Snuff+Box+-
2010-08-05 18:00:41,293 [Thread-773] INFO  sagex.phoenix.metadata.MetadataManager - Searching Using Cleaned Title: Snuff Box using TVDBMetadataProvider[MetadataProviderInfo [id=tvdb, fanartId=null, mediaTypes=[TV], name=thetvdb.com]]
2010-08-05 18:00:41,293 [Thread-773] INFO  sagex.phoenix.metadata.provider.tvdb.TVDBSearchParser - TVDB Search: http://www.thetvdb.com/api/GetSeries.php?seriesname=Snuff+Box
2010-08-05 18:00:41,293 [Thread-773] WARN  phoenix.log - AutomaticMetadataVisitor(): lookup failed with an error for DecoratedItem: [Resource[Id: TMP22416447, Title: Snuff Box - S01E06]]
MetadataException [query=SearchQuery; Type: TV; SEASON:01;RAW_TITLE:Snuff Box -;CLEAN_TITLE:Snuff Box;FILE:\\stafford\tv\Snuff Box\Snuff Box - S01E06.avi;EPISODE_DATE:2009-10-07;DISC:;EPISODE:06;QUERY:Snuff Box;, ]
	at sagex.phoenix.metadata.MetadataManager.getMetdata(MetadataManager.java:476)
	at sagex.phoenix.metadata.MetadataManager.automaticUpdate(MetadataManager.java:556)
	at sagex.phoenix.metadata.MetadataManager.automaticUpdate(MetadataManager.java:526)
	at sagex.phoenix.metadata.AutomaticMetadataVisitor.visit(AutomaticMetadataVisitor.java:23)
	at sagex.phoenix.vfs.DecoratedMediaFile.accept(DecoratedMediaFile.java:48)
	at sagex.phoenix.vfs.DecoratedMediaFolder.accept(DecoratedMediaFolder.java:61)
	at sagex.phoenix.metadata.PhoenixMetadataSupport$1.run(PhoenixMetadataSupport.java:110)
	at sagex.phoenix.progress.ProgressTrackerManager$1.run(ProgressTrackerManager.java:48)

I am running Sage 7.0.13 and the latest BMT.

[stuckless]

The problem is that bmt has to use a fuzzy logic search in order to determine if "Snuff Box" is similar to "Berry & Fulcher's Snuff Box". While to you and I, this looks close enough, but to bmt, this is not close enough

You have options...
1. (recommended) Try to name your filenames as close to the show names in thetvdb.com as possible.
2. Add an entry to the MediaTitles.xml that will map your name to the tvdb id for the show. (little more advanced)

The location for the MediaTiltes.xml file should be STVs/Phoenix/scrapers/ and there is a sample file in there. Right now, if you edit that file, you will need to restart the sagetv server

[jusjoken]

Could someone provide a <match> example to handle the lookup of my video files in MediaTitles.xml?

Two that I am having troubles with that need an entry are as follows...

"SATC [2x02] The Awful Truth.avi" = 76648 on tvdb

"HeartLand S02E03 Gift Horse.avi" = 82701 on tvdb

What would the entries be in MediaTitles.xml ?

k

[stuckless]

Originally Posted by jusjoken

Could someone provide a <match> example to handle the lookup of my video files in MediaTitles.xml?

Two that I am having troubles with that need an entry are as follows...

"SATC [2x02] The Awful Truth.avi" = 76648 on tvdb

"HeartLand S02E03 Gift Horse.avi" = 82701 on tvdb

What would the entries be in MediaTitles.xml ?

k

I haven't confirmed this... but something like this should work

	<match>
		<regex>[\\/]SATC</regex>
		<metadata type="tv" name="tvdb">76648</metadata>
	</match>
	<match>
		<regex>[\\/]HeartLand</regex>
		<metadata type="tv" name="tvdb">82701</metadata>
	</match>

I'm not sure the format SATC naming format (ie, SATC [2x02]) will work, the Heartland naming is the ideal naming.

Keep in mind, that if you modify the STVs/Phoenix/scrapers/MediaTitles.xml file, then you need to restart the sagetv server for the changes to take effect.

[jusjoken]

Originally Posted by stuckless

I haven't confirmed this... but something like this should work

	<match>
		<regex>[\\/]SATC</regex>
		<metadata type="tv" name="tvdb">76648</metadata>
	</match>
	<match>
		<regex>[\\/]HeartLand</regex>
		<metadata type="tv" name="tvdb">82701</metadata>
	</match>

I'm not sure the format SATC naming format (ie, SATC [2x02]) will work, the Heartland naming is the ideal naming.

Keep in mind, that if you modify the STVs/Phoenix/scrapers/MediaTitles.xml file, then you need to restart the sagetv server for the changes to take effect.

For Heartland it is grabbing the metadata from tvdb = 70598 and not 82701 even though I have this match in place and restarted the sage service?

Here is a sample error row from the log...

2010-08-16 19:58:28,891 - ERROR; \\storage\volume_1\series\Heartland\Season 2\Heartland S02E17 Full Circle.avi; Heartland; 196868; No metadata for: DecoratedItem: [Resource[Id: 196868, Title: Heartland]]

And here is one for SATC...

2010-08-16 20:05:54,904 - ERROR; \\storage\volume_1\series\Sex and the City\Season 1\SATC [1x02] Models And Mortals.avi; SATC [1x02] Models And Mortals; 1959; Search Failed for SearchQuery; Type: TV; QUERY:SATC;RAW_TITLE:SATC;EPISODE:02;SEASON:1;FILE:\\storage\volume_1\series\Sex and the City\Season 1\SATC [1x02] Models And Mortals.avi;CLEAN_TITLE:SATC;EPISODE_DATE:2008-04-03;PROVIDER:tvdb;ID:76648;DISC:;

And here is the contents of my MediaTitles.xml file...

<titles>
	<!--
	A Match can contain a regex that will be used to match against the path.  If it matches, then it will
	then set the fields, title, year, or id, into the search query.
	-->
	<match>
		<regex>[\\/]SATC</regex>
		<metadata type="tv" name="tvdb">76648</metadata>
	</match>
	<match>
		<regex>[\\/]HeartLand</regex>
		<metadata type="tv" name="tvdb">82701</metadata>
	</match>
</titles>

Thoughts?

k

[stuckless]

After looking at your output, it doesn't look like it's picking up your MediaTitles.xml file changes.

Could you post the full path of your MediaTitles.xml file? Also, take the latest build, 2.0.9, of phoenix-core, which has a bunch of fixes for MediaTitles.xml.

[jusjoken]

Originally Posted by stuckless

After looking at your output, it doesn't look like it's picking up your MediaTitles.xml file changes.

Could you post the full path of your MediaTitles.xml file? Also, take the latest build, 2.0.9, of phoenix-core, which has a bunch of fixes for MediaTitles.xml.

Here is the full path...

C:\Program Files (x86)\SageTV\SageTV\STVs\Phoenix\scrapers\MediaTitles.xml

I have to believe that the file is being read as the SATC entry worked.

PS: I have tried this with 2.09

Here is one of the error lines in metadata.log

2010-08-18 17:23:13,463 - ERROR; \\storage\volume_1\series\Heartland\Season 2\HeartLand S02E07 Sweatheart of the Rodeo.avi; Heartland; 126905; No metadata for: DecoratedItem: [SageMediaFile [sageId=126905, sageObject=sage.b.p@1d144a4]]

Here is a section from phoenix.log

2010-08-18 17:23:18,017 [Thread-42] INFO  sagex.phoenix.metadata.provider.tvdb.TVDBSearchParser - TVDB Search: http://www.thetvdb.com/api/GetSeries.php?seriesname=Heartland
2010-08-18 17:23:18,019 [Thread-42] INFO  sagex.phoenix.metadata.MetadataManager - Fetching Metadata for MediaSearchResult [extraArgs=CLEAN_TITLE: Heartland,ID: 82701,YEAR: 1989,EPISODE_TITLE: Heartland,RAW_TITLE: Heartland,FILE: \\storage\volume_1\series\Heartland\Season 2\Heartland S02E18 Step by Step.avi,PROVIDER: tvdb,EPISODE_DATE: 2009-04-14,, id=70598, imdbId=null, metadata=null, providerId=tvdb, score=1.0, title=Heartland, type=TV, url=70598, year=1989]
2010-08-18 17:23:18,019 [Thread-42] INFO  sagex.phoenix.metadata.provider.tvdb.TVDBItemParser - TVDB Series: http://www.thetvdb.com/api/5645B594A3F32D27/series/70598/en.xml
2010-08-18 17:23:18,020 [Thread-42] INFO  sagex.phoenix.metadata.provider.tvdb.TVDBItemParser - TVDB date: http://thetvdb.com/api/GetEpisodeByAirDate.php?apikey=5645B594A3F32D27&seriesid=70598&airdate=2009-04-14
2010-08-18 17:23:18,021 [Thread-42] INFO  sagex.phoenix.util.url.CachedUrl - Removing Cached Url File: cache\url\43638f9fdb98a4ac71834cc81df89e6b.cache
2010-08-18 17:23:18,100 [Thread-42] INFO  sagex.phoenix.metadata.provider.tvdb.TVDBItemParser - TVDB Episode: http://www.thetvdb.com/api/5645B594A3F32D27/series/70598/default/-1/-1/en.xml
2010-08-18 17:23:18,250 [Thread-42] WARN  sagex.phoenix.metadata.provider.tvdb.TVDBItemParser - Failed to get season/episode specific information for 70598; Season: null; episode: null
2010-08-18 17:23:18,250 [Thread-42] INFO  sagex.phoenix.metadata.provider.tvdb.TVDBItemParser - TVDB Title: http://www.thetvdb.com/api/5645B594A3F32D27/series/70598/all/en.xml
2010-08-18 17:23:18,251 [Thread-42] INFO  sagex.phoenix.metadata.provider.tvdb.TVDBItemParser - Unable to match a direct title for: Heartland
2010-08-18 17:23:18,252 [Thread-42] WARN  sagex.phoenix.metadata.provider.tvdb.TVDBItemParser - Failed while parsing series: MediaSearchResult [extraArgs=CLEAN_TITLE: Heartland,ID: 82701,YEAR: 1989,EPISODE_TITLE: Heartland,RAW_TITLE: Heartland,FILE: \\storage\volume_1\series\Heartland\Season 2\Heartland S02E18 Step by Step.avi,PROVIDER: tvdb,EPISODE_DATE: 2009-04-14,, id=70598, imdbId=null, metadata=null, providerId=tvdb, score=1.0, title=Heartland, type=TV, url=70598, year=1989]
java.lang.Exception: Cannot process TV without a valid season; Result: MediaSearchResult [extraArgs=CLEAN_TITLE: Heartland,ID: 82701,YEAR: 1989,EPISODE_TITLE: Heartland,RAW_TITLE: Heartland,FILE: \\storage\volume_1\series\Heartland\Season 2\Heartland S02E18 Step by Step.avi,PROVIDER: tvdb,EPISODE_DATE: 2009-04-14,, id=70598, imdbId=null, metadata=null, providerId=tvdb, score=1.0, title=Heartland, type=TV, url=70598, year=1989]
	at sagex.phoenix.metadata.provider.tvdb.TVDBItemParser.getMetadata(TVDBItemParser.java:102)
	at sagex.phoenix.metadata.provider.tvdb.TVDBMetadataProvider.getMetaData(TVDBMetadataProvider.java:27)
	at sagex.phoenix.metadata.MetadataManager.getMetdata(MetadataManager.java:418)
	at sagex.phoenix.metadata.MetadataManager.getMetdata(MetadataManager.java:478)
	at sagex.phoenix.metadata.MetadataManager.automaticUpdate(MetadataManager.java:556)
	at sagex.phoenix.metadata.MetadataManager.automaticUpdate(MetadataManager.java:526)
	at sagex.phoenix.metadata.AutomaticMetadataVisitor.visit(AutomaticMetadataVisitor.java:24)
	at sagex.phoenix.vfs.DecoratedMediaFile.accept(DecoratedMediaFile.java:48)
	at sagex.phoenix.vfs.DecoratedMediaFolder.accept(DecoratedMediaFolder.java:61)
	at sagex.phoenix.metadata.PhoenixMetadataSupport$1.run(PhoenixMetadataSupport.java:110)
	at sagex.phoenix.progress.ProgressTrackerManager$1.run(ProgressTrackerManager.java:48)
2010-08-18 17:23:18,252 [Thread-42] WARN  phoenix.log - AutomaticMetadataVisitor(): lookup failed with an error for DecoratedItem: [SageMediaFile [sageId=228060, sageObject=sage.b.p@1ce9085]]
MetadataException [file=DecoratedItem: [SageMediaFile [sageId=228060, sageObject=sage.b.p@1ce9085]], ]
	at sagex.phoenix.metadata.MetadataManager.updateMetadata(MetadataManager.java:492)
	at sagex.phoenix.metadata.MetadataManager.automaticUpdate(MetadataManager.java:556)
	at sagex.phoenix.metadata.MetadataManager.automaticUpdate(MetadataManager.java:526)
	at sagex.phoenix.metadata.AutomaticMetadataVisitor.visit(AutomaticMetadataVisitor.java:24)
	at sagex.phoenix.vfs.DecoratedMediaFile.accept(DecoratedMediaFile.java:48)
	at sagex.phoenix.vfs.DecoratedMediaFolder.accept(DecoratedMediaFolder.java:61)
	at sagex.phoenix.metadata.PhoenixMetadataSupport$1.run(PhoenixMetadataSupport.java:110)
	at sagex.phoenix.progress.ProgressTrackerManager$1.run(ProgressTrackerManager.java:48)

Thanks for checking this out
k

[stuckless]

For some reason, for Hartland, it's not using the season and episode that is in the filename, which is odd. The filename pattern looks correct, but I'll create the file here and do some testing.

[stuckless]

I just tested your filename on my system (updated to 2.0.9), using your MediaTitles.xml and it found the correct the show. Without the MediaTitles.xml it finds a different Heartland show for a different year.

Are you using any custom filename scrapers? Also, remove your cache directory (should be a cache directory in the root of your sagetv home directory)

[jusjoken]

I deleted the cache, uninstalled BMT/Phoenix restarted sage service, reinstalled... and still no luck.

I have no scrapper customizations at all.

I really appreciate all the help but this show is not worth it. BMT has worked for all my other shows so far so we should just move on... I can go through each episode in the Web UI and manually search and select the right series and be done with this.

Thanks again... great tool.

k