Need help with scraper.

[adone36]

I use MCE and Tivo to record via cablecards and import these to Sage so Sage handles everything.

I have software which decrypts the originals and converts them to mpg, comskips, etc. These programs also allow for file renaming using metadata. I originally used "ShowName--EpisodeTitle".mpg and this was working fine until I ran into how lame MCE guide info and recording capabilities are. The guide in MCE will frequently have shows with generic metadata. Like 10 showings of "Mythbusters" where the description says "Two guys do stuff". MCE will record these even though set for "new" show only in the series and the episode title will then be blank. This gives a bunch of conversions with the same title:
"Mythbusters----".mpg. To fix this I have to add record date and time to prevent duplicate files, "Mythbusters--Bouncing Bullet--05242012-2000".mpg

I don't get metadata when BMT scrapes now, although I get fanart. I believe the scraper loojs for the -- and says everything to the left is Show name and to the right Episode name, which doesn't work. How can I change the syntax in the scraper to find only the Episode name? Ideally i would like to also have broadcast date and time since BMT uses file creation dates for these and that causes other little problems with display.

Both conversion programs allow me to format the file name anyway i want with month day year hour and minute so I can set the easiest thing to parse. If there was a scraper parsing multiple variables I could look at, I might be able to construct one, but so far what I've tried doesn't work.

[stuckless]

The scrapers for tv filenames are here...
http://code.google.com/p/sagephoenix...%2Ftvfilenames

You can see that there is a separate file for each filename type that bmt/phoenix supports.

If you create your own scraper (which is basically an XBMC regex scraper) then you drop it into the scraper directory, reload the configurations, and then it should pick up the new scraper.

A scraper is basically made of a "functions" that know how to parse out certain key pieces of information from a filename.

For example, the "Series--Episode" scraper looks like this.

<?xml version="1.0" encoding="UTF-8"?>
<!-- 
   TV Filename Scraper.  Used to scrape shows with the format Show dash dash Episode
   NOTE: Show and Episode MUST be separated by 2 dashes 
   
   contributed by evilpenguin
-->
<scraper name="title-show-episode" content="filename" thumb="thumb.png">
        <!--    input:          $1=complete file uri -->
        <!--    returns:        series name -->
        <GetShowName dest="3">
                <RegExp input="$$1" output="\1" dest="3">
                        <expression>.*[/\\]([^/\\-]+)--([^/\\]+)\.[a-zA-Z0-9]+$</expression>
                </RegExp>
        </GetShowName>

        <!--    input:          $1=complete file uri -->
        <!--    returns:        Episode Title -->
        <GetEpisodeTitle dest="3">
                <RegExp input="$$1" output="\2" dest="3">
                        <expression>.*[/\\]([^/\\-]+)--([^/\\]+)\.[a-zA-Z0-9]+$</expression>
                </RegExp>
        </GetEpisodeTitle>
</scraper>

There is a GetShowName (ie Series) and a GetEpisodeTitle function in this scraper.  I use the same "regex" for both, but I change the "output" to select either group 1 or group 2.

If you understand xml and regex, then this is pretty trivial to build a new scraper... if you don't then it's going to be a painful experience :(

[stuckless]

btw... changing the regex to this... might actually work for you...

.*[/\\]([^/\\-]+)--([^-]+)--.*

And this would find shows like..
Series--Episode--OTHER DATA

If you want to include a date, then you need to implement a <GetAiredDate dest="3"> function in your scraper that parses out the date in the format YYYY-MM-DD.

You can look at the Title-AiredDate scraper to see how it pulls out the date.

And keep in mind, you can have all these things in your filename, and scraper, as long as the scraper knows how to parseit out...

Series--EpisodeTitle--YYYY-MM-DD OTHER DATA.avi

[nyplayer]

adone36,

Have you check out MC TVConverter. It will rename automatically and compress etc.. using the WMC metdata. I use this to rename the files .. I import them into sage... and Stucklesses BMT does the rest.

[adone36]

Thanks Sean! I'll give it a try. I did notice that in shows where there is a epi name, the existing scraper is picking it up often. I believe you said BMT uses each scraper until it gets a "hit". Is there a hierarchy to that? Does it try in any specific order??

NYPlayer,

I use MCE-TVconverter for MCE and kttmg for Tivo. The major problem is the poor metadata in MCE forces me to use the above naming convention to prevent bunches of duplicate file names. I convert to MPG because this is v fast since these formats are basically encrypted MPG containers. I suppose I could use mp4 since it can store the original metadata, but I haven't tested that to see how BMT or Sage would handle those.

[stuckless]

Originally Posted by adone36

Thanks Sean! I'll give it a try. I did notice that in shows where there is a epi name, the existing scraper is picking it up often. I believe you said BMT uses each scraper until it gets a "hit". Is there a hierarchy to that? Does it try in any specific order??

I don't think there is an order, or if there is, it's probably just based on alphabetical filename. So, if you make a scraper, be sure to call it "adone_tv.xml" and that might put it at the front the on line, since I don't think there are other scrapers that start with a