New XMLTV Import Tool

[StephaneM]

Originally Posted by rv55

Hi Stephane,
here is my log
20090301 14:21:35.375 - Error - Unexpected error : Region name '' is not supported.

Ok this will be fixed in the upcoming release (this week)

Regards,
Stéphane.

[rv55]

Originally Posted by StephaneM

Ok this will be fixed in the upcoming release (this week)

Thank you, I'll keep my eye out for it.

Rocco.

[rv55]

I have another problem. This is still on Windows 7 with the new 3.9 version of the Sagetv Importer.

I set it up to run my xmltv data grabber (Webget1.4) before import but when it runs at the scheduled time it hangs while running the grabber.

Here are my grabber settings. I tested it in a batch file so they are correct.
Grabber: C:\xml\webget.exe
Arguments: "http://iceguide.icetv.com.au/cgi-bin/epg/iceguide.cgi?op=xmlguide" -u xxxxxx -p xxxxxx -o "c:\xml\icetv.xml"

When it hangs, if I check the task manager, webget is running but icetv.xml does not get updated and only the following 2 lines appear in the log;
20090308 16:54:11.161 - Info - Import Started
20090308 16:54:11.255 - Info - Launching XMLTV grabber 'C:\xml\webget.exe'

Any help would be appreciated.

Edit: I've discovered that if I delete the icetv.xml file before the scheduled task runs then it works perfectly. I think the problem has something to do with webget not being able to get access to the icetv.xml file when run from Xmltv Importer. Maybe a credentials problem? Hope that helps.

Edit2: Actually, when I deleted the xml file first it didn't hang but there was an error message in the log file.
20090308 17:33:31.700 - Info - Import Started
20090308 17:33:31.933 - Info - Launching XMLTV grabber 'C:\xml\webget.exe'
20090308 17:33:40.978 - Info - Processing XMLTV Source: icetv Source
20090308 17:33:40.980 - Info - Loading XMLTV File: C:\xml\icetv.xml
20090308 17:33:42.749 - Info - Processing Lineup: icetv Lineup
20090308 17:33:42.827 - Info - Processing Channel: 7-Digital
20090308 17:33:42.931 - Error - Unexpected error :Object reference not set to an instance of an object.
at LMGestion.XMLTVImporter.XMLTVImporter.GetSageTVRating(String xmltvRating, String& extendedRating)
at LMGestion.XMLTVImporter.XMLTVImporter.GetProgramInfo(XmlNode programNode, ProgramInfo& programInfo)
at LMGestion.XMLTVImporter.XMLTVImporter.AddChannelPrograms(ChannelInfo channelInfo, DateTime importDate)
at LMGestion.XMLTVImporter.XMLTVImporter.ProcessChannels(DateTime importDate)
at LMGestion.XMLTVImporter.XMLTVImporter.DoImport()

[StephaneM]

Originally Posted by rv55

I set it up to run my xmltv data grabber (Webget1.4) before import but when it runs at the scheduled time it hangs while running the grabber.

The Importer will wait until the grabber process terminate to continue, if the process doesn't stop, the Importer will also.

I've discovered that if I delete the icetv.xml file before the scheduled task runs then it works perfectly. I think the problem has something to do with webget not being able to get access to the icetv.xml file when run from Xmltv Importer. Maybe a credentials problem? Hope that helps.

Yes, you'll have to make sure that the XMLTV file as the right security setting (for instance, give "Everyone" the right to write on this file, this should do the trick.)

20090308 17:33:42.931 - Error - Unexpected error :Object reference not set to an instance of an object.

You'll have to send me your XMLTV file zipped as well as the content of the Importer Config & Log folder and I'll see what is wrong in your config (there is an error when translating the ratings for your shows)

Regards,
Stéphane.

[rv55]

Originally Posted by StephaneM

Yes, you'll have to make sure that the XMLTV file as the right security setting (for instance, give "Everyone" the right to write on this file, this should do the trick.)

That seems to have fixed it. Looks like Windows 7 defaulted to only giving read access to unauthenticated users. This is strange, though, because the task runs with my current user credentials which has full access. Oh well, this isn't the first time I've had problems because Windows 7 doesn't act as expected.

Thanks again Stephane.

By the way the error did not reappear.

[scanner95]

Hello,

I'm trying to setup your wonderful importer, and on some stage this started to appear when I try to download my linup into Sage:
17-03-2009 09:53:23,162 Start EPG update for lineup n°1
17-03-2009 09:53:23,162 Reading Channels File
17-03-2009 09:53:23,178 Creating channels array (147)
17-03-2009 09:53:23,178 Unexpected error for 'updateGuide'
java.lang.NullPointerException
at xmltv.XMLTVImportPlugin.updateGuideEx(XMLTVImportPlugin.java:226)
at xmltv.XMLTVImportPlugin.updateGuide(XMLTVImportPlugin.java:87)
at sage.ab.t(Unknown Source)
at sage.az.d(Unknown Source)
at sage.a6.dn(Unknown Source)
at sage.ab.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)

I have creating several lineups, trying to localize the problem: some are quite small, some are big. No luck.
What shall I do?

Thanks a lot!

[StephaneM]

Hi,

Originally Posted by scanner95

on some stage this started to appear when I try to download my linup into Sage:
17-03-2009 09:53:23,178 Unexpected error for 'updateGuide'
java.lang.NullPointerException
at xmltv.XMLTVImportPlugin.updateGuideEx(XMLTVImportPlugin.java:226)

One of you channels doesn't have a Call-Sign, this is the cause of this error.

Add a call-sign for all channels and start the Import again and it should be fine.

Regards,
Stéphane.

[scanner95]

Thanks Stéphane.
Can call-signs have spaces?

Cheers,
Yuly

[michaeldjcox]

Are start and stop times in XMLTV normally expected to be in local time or GMT?

What does the +0000 at the end of start and stop time normally mean?

Does anyone know please.

Thanks,

Michael

[StephaneM]

Originally Posted by michaeldjcox

Are start and stop times in XMLTV normally expected to be in local time or GMT?

Usually it's in local time, though each grabber can do what it wants.

What does the +0000 at the end of start and stop time normally mean?

+XXXX is the numbers of hours / minutes that were added (or substracted if it is -XXXX) to the UTC time to get the time that is given. So +0000 mean that the given time is UTC.

Regards,
Stéphane.

[michaeldjcox]

Many thanks Stephane for the above.

One further question.

I'm generating some XMLTV for radio stations and using the XMLTV importer to import those schedules into SageTV.

I haven't really addressed the issue of categories yet and currently my radio programmes fall into the "Other" category on sageTV.

Is there a set list of allowed categories or can you make up your own both from an XMLTV point of view and from a SageTV point of view?

Many thanks in advance.

Michael

[StephaneM]

Originally Posted by michaeldjcox

Is there a set list of allowed categories or can you make up your own both from an XMLTV point of view and from a SageTV point of view?

You can use the XMLTV Importer category editor to organize your categories: you can create any number of SageTV categories / sub categories (SageTV only support 1 main and 1 sub) and rearrange the XMLTV categories.

[voidpt]

Anybody have a tip about this Warning/Info in log:

...
20090331 11:49:46.881 - Info - The following categories could not be mapped to one of your categories:
20090331 11:49:46.974 - Info - Import done

These are the two last lines in the log. The problem is that the 'Info' about categories results in a Warning through the e-mail logic in XMLTV. So each day I get an e-mail telling me that I have a problem with Warning on this entry. I've gone through all the categories in my system, all are mapped. I've also browsed through my 'raw' XML data and could not find any categories that are unknown.

What am I looking for here? What is the log trying to tell me. Should there be a warning at all for this 'Info' statement?

[StephaneM]

Originally Posted by voidpt

The problem is that the 'Info' about categories results in a Warning through the e-mail logic in XMLTV. So each day I get an e-mail telling me that I have a problem with Warning on this entry.

I'll fix this in a upcoming release.

What is the log trying to tell me. Should there be a warning at all for this 'Info' statement?

This "Info" event is dumped in the e-mail so that you can add new XMLTV categories when the Importer encounter them. It is not an error or a warning, just a meaningfull info (in your case this event should not be fired at all)

Regards,
Stéphane.

[voidpt]

Originally Posted by StephaneM

I'll fix this in a upcoming release.

Thanks. Good enough for me Very flexible tool you've created here. And I do like the e-mail feature, just don't want it to 'cry wolf' too much

[plawlor]

Hi Stephane,

Another great plugin!

I've now got the importer up and running for my existing line-ups and have the whole grab and import function automated. Now it's time to tackle the whole reason for moving to your plugin in the first place - my DVB card channel line-up. This will be a bit more complicated... First of all, I have a motorized dish and need to get to a single line-up with channels from about 10 different satellites. Some lineups I can get from Globecast and some from various local OTA lineups. However, some I'd like to take right from the DVB EPG. I see that your plugin supports lineups from the DVB Viewer-Recorder plugin, which I also use. What does this do? Does it extract EPG data or just the channel info? Also, my DVB Viewer-Recorder setup is on another server. Can I configure the xmltv importer to see it or do they have to exist on the same box?

Thanks!

[StephaneM]

Originally Posted by plawlor

I see that your plugin supports lineups from the DVB Viewer-Recorder plugin, which I also use. What does this do?

It get the channels lineup from the DVBViewer Recorder config file. It doesn't extract EPG, it is only a way to build the lineup without having to type channel name and numbers.

Can I configure the xmltv importer to see it or do they have to exist on the same box?

They have to exist on the same box. Though you can copy back the DVBViewer Recorder settings to the XMLTV PC. The folder you must copy is C:\Documents And Settings\All Users\Application Data\LM Gestion\DVBViewer Recorder (or C:\ProgramData\LM Gestion\DVBViewer Recorder on Vista/7)

To get the EPG from DVB, use the DVBViewer Recorder features that let you save the DVB EPG to an XMLTV file. You can schedule this from DVBViewer Recorder: pick a channel on your lineup, select time slot to "grab" the EPG (DVBViewer Recorder will ask DVBViewer to tune to this channel, then waits for the time you specified and finally save the EPG DVBViewer managed to get from DVB Stream)

Regards,
Stéphane.

[plawlor]

Originally Posted by StephaneM

...select time slot to "grab" the EPG (DVBViewer Recorder will ask DVBViewer to tune to this channel, then waits for the time you specified and finally save the EPG DVBViewer managed to get from DVB Stream).

Is this time, specified in minutes, the amount of time you are giving DVBViewer to get the EPG data for the upcoming day, week, etc., or are you telling it to get x minutes worth of EPG data with this setting?

What if I need to get EPG data from more than one channel? How do I do this? Can I do this?

Also, I realize that this is a DVB question and not a DVB Viewer-Recorder question, but I figured you'd know - how do I know which channel provides the EPG data for a given package of channels?

Thanks.

[StephaneM]

Originally Posted by plawlor

Is this time, specified in minutes, the amount of time you are giving DVBViewer to get the EPG data for the upcoming day, week, etc.,

This is the time to allow for DVBViewer to be able to grab data from DVBStream (5 to 15 minutes is enough)

What if I need to get EPG data from more than one channel? How do I do this? Can I do this?

Usually when you tune to one channel you get EPG for other ones. If this is not the case, you can create bogus lineups to have the ability to schedule grabs on other channels.

how do I know which channel provides the EPG data for a given package of channels?

It depends on the provider; in DVBViewer there is a frequencies list for EPG. You can add frequencies in there if needed (take a look at Kingofsat web site to find if a EPG service is available for the sat providers you are using).

Regards,
Stéphane.

[plawlor]

Thanks for your help Stephane. I now have the combination of your DVB Viewer-Recorder and xmltv import tool working fairly well and automated to grab and import every night. I'm still not very happy with the amount of EPG data I'm getting...or not getting...from DVB Viewer, but at least your plug-in gives me the flexibility to go out and find various sources to splice together into a single lineup. I just didn't have that capability without this plugin.

One of my struggles is that I think I'm doing something that is not very common and as a result, has not really been solved before. Most DVB resources I've come across are geared entirely for the European satellites where people purchase subscriptions from specific providers. This way, they either get a nice clean and complete EPG from the DVB stream by tuning to channel xyz or can use a single xmltv lineup. What I'm doing is using a motorized setup to tune to 5 true FTA channels on 79w, another 7 or so on 83w, the Globecast channels that are clear on 97w, PBS feeds on 103w, the local networks on 123w, and so on and so on... The EPG data from the DVB stream is just not that good for these one-off channels. As a result, I can see myself splicing together a couple of channels from 30 different xmltv sources. My biggest limitation is the fact that I can only have 4 line-ups for my Schedules Direct account. I'd setup multiple accounts, but at $25/yr, that will get pricey.

Wish me luck!