Plugin: Sage Recording Extender (SRE)

[Slugger]

Originally Posted by spacecadet

A couple notes on the upgrade to 2.x....

1) The uninstall instructions reference deleting: JARs\*sre*.jar, However, the file on my system was actually named: JARs\*sage-recording-extender*.jar (I think the name changed above a certain version?)

2) I like having a link to the SRE from neilm's webserver, so I also updated webserver\webroot\sage\menu_items.js to point to the new location of SRE on jetty (I also removed the reference to the SRE servlet from webserver\servlets.properties for completeness)

Will update the wiki, thanks.

Initial feedback:

1) I thought the uninstall/upgrade was very easy. I think the ability to hot deploy is really cool. I also like that there are few, if any, manual steps to install 2.x other than to add jetty to the load at startup property in Sage.properties.

2) Since I like to link to SRE from neilm's webserver, I miss having the "Back to home" link at the bottom of the SRE web site. I suppose I can use the back button on the browser, but that is not as much fun

Issue opened for this - I have a couple ideas on how to handle this.

3) I noticed that the SageTV icon at the top of the page is clickable, but clicking it attempts to link to sage/home, which is a path that doesn't exist under my jetty server, so I get a 404 error.

Issue opened.

4) Since I link to SRE from neilm's webserver, I get prompted for my username/password a 2nd time when navigating to SRE (since they run using different ports). Perhaps there is a way that I am not aware of to proxy the webserver through jetty or visa-versa?

Not sure how plausible this will be, but issue opened and I'll see what can be done.

5) Last Run on the About tab reports "Unavailable", even though the log shows that SRE is actively monitoring.

When you initially load SRE it will say unavailable, but the UI polls the server for the info - initially every 10 seconds or so then every 2 mins and updates the label. Can you reload SRE and give it 10-30 seconds and see if it doesn't update? Let me know if it doesn't - I haven't had any problems with it refreshing, but obviously that info is critical to have so do please let me know if it's not updating properly.

[spacecadet]

Originally Posted by Slugger

When you initially load SRE it will say unavailable, but the UI polls the server for the info - initially every 10 seconds or so then every 2 mins and updates the label. Can you reload SRE and give it 10-30 seconds and see if it doesn't update? Let me know if it doesn't - I haven't had any problems with it refreshing, but obviously that info is critical to have so do please let me know if it's not updating properly.

Edited (accidentally pushed submit instead of preview *whoops*)....

It still says Unavailable for me, but based on the logs, SRE is still polling:

2008-09-10 15:03:00 No active recordings found.
2008-09-10 14:58:00 No active recordings found.
2008-09-10 14:53:00 No active recordings found.
etc.

[Slugger]

Originally Posted by spacecadet

Edited (accidentally pushed submit instead of preview *whoops*)....

It still says Unavailable for me, but based on the logs, SRE is still polling:

2008-09-10 15:03:00 No active recordings found.
2008-09-10 14:58:00 No active recordings found.
2008-09-10 14:53:00 No active recordings found.
etc.

I don't suppose you use Firefox with firebug installed? I just can't reproduce this on IE6, IE7, FF2 nor FF3. Are you using a browser other than one of those? In all of these browsers when I load the app in the browser it starts off saying "Unavailable", which is expected, then 2-3 seconds later it fills it in with the data received from the server. It might take up to 10 seconds depending on how fast your hardware is.

If you happen to be using FF and have firebug installed I'm interested to know if the ajax requests for /sre/SRE?sub=lastRun are returning a 500 or 40x response code (or anything other than 200 [OK]).

[Slugger]

The NCAA football parser is broken in all versions of SRE 1.x and will not be fixed in the 1.x stream.

Unfortunately, the way ESPN changed the page means that SRE will always attach the first game listed on the scoreboard to any NCAA football recording. The effect of this is that SRE will not think a game is over until every game on the scoreboard is over! You do not want to be running any version of SRE 1.x to monitor NCAA football effective immediately.

A fix has been checked into svn for the 2.x stream - you will want to grab the latest snapshot build and apply it (fix was delivered in revision 14).

Details for installing SRE 2.x are available here. If you don't want to upgrade to 2.x then I highly recommend removing SRE 1.x from your system if there's any chance you'll be using SRE to monitor NCAA football.

[spacecadet]

Originally Posted by Slugger

I don't suppose you use Firefox with firebug installed? I just can't reproduce this on IE6, IE7, FF2 nor FF3. Are you using a browser other than one of those? In all of these browsers when I load the app in the browser it starts off saying "Unavailable", which is expected, then 2-3 seconds later it fills it in with the data received from the server. It might take up to 10 seconds depending on how fast your hardware is.

If you happen to be using FF and have firebug installed I'm interested to know if the ajax requests for /sre/SRE?sub=lastRun are returning a 500 or 40x response code (or anything other than 200 [OK]).

Yeah. I'm a dope. This is working. Sorry for the false alarm.

[spacecadet]

Originally Posted by spacecadet

2) Since I like to link to SRE from neilm's webserver, I miss having the "Back to home" link at the bottom of the SRE web site. I suppose I can use the back button on the browser, but that is not as much fun

3) I noticed that the SageTV icon at the top of the page is clickable, but clicking it attempts to link to sage/home, which is a path that doesn't exist under my jetty server, so I get a 404 error.

4) Since I link to SRE from neilm's webserver, I get prompted for my username/password a 2nd time when navigating to SRE (since they run using different ports). Perhaps there is a way that I am not aware of to proxy the webserver through jetty or visa-versa?

I played around with this tonight and was able to get a good solution by using Apache's mod_proxy to act as the frontend to both neilm's webserver and SRE on jetty.

Since I already have Apache running on my server, I enabled mod_proxy and added the following bits of config:

<IfModule proxy_module>
  ProxyRequests Off

  <Proxy *>
    Order deny,allow
    Allow from all
  </Proxy>

  # SRE
  ProxyPass /sre http://localhost:8082/sre
  ProxyPassReverse /sre http://localhost:8082/sre

  # Sage TV Web Server
  ProxyPass /sage http://localhost:8081/sage
  ProxyPassReverse /sage http://localhost:8081/sage 
</IfModule>

This solved issues #2 & 3 above, because now that the webserver are hosted off of the same port (Apache's port), I was able to use the SageTV icon in SRE to link back to the webserver.

To solve the login problem (#4 above), I had to go one step further - in addition to the reverse proxy, the logon Realm used by the webserver and SRE also need to match in order for the browser to reuse the cached credentials. To do this, I had to edit sre.context.xml and change the userRealm from "MyWebApp Realm" to "SageTV Web Interface". Once that change was in place, I could go back and forth between the webserver and SRE without re-logging in.

[Slugger]

SRE v2.0.0 is now available.

[rsagetv99]

Not sure if anyone else has had the problem, but SRE has not been working for me during the World Series. I get the following error:

2008-10-27 23:02:00 MLB Baseball --> Invalid monitor; parser may be obsolete

[Slugger]

Originally Posted by rsagetv99

Not sure if anyone else has had the problem, but SRE has not been working for me during the World Series. I get the following error:

2008-10-27 23:02:00 MLB Baseball --> Invalid monitor; parser may be obsolete

Are you using v2.0.0? v2.0.0 is able to find and monitor the World Series games for me, however, I have had to create an override for each game because the EPG data does not list the teams playing. All of the games have had EPG data like:

Team TBA at Philadelphia

SRE requires that both teams be listed in the episode information. Therefore, you'd need to create an override and tell SRE who's playing. The format must be:

Tampa Bay at Philadelphia

SRE will accept some other formats, which are all described in the SRE documentation at http://sagetv-addons.googlecode.com

[rsagetv99]

Originally Posted by Slugger

Are you using v2.0.0? v2.0.0 is able to find and monitor the World Series games for me, however, I have had to create an override for each game because the EPG data does not list the teams playing. All of the games have had EPG data like:

Team TBA at Philadelphia

SRE requires that both teams be listed in the episode information. Therefore, you'd need to create an override and tell SRE who's playing. The format must be:

Tampa Bay at Philadelphia

SRE will accept some other formats, which are all described in the SRE documentation at http://sagetv-addons.googlecode.com

That is probably what happened. Can you create an override before the game begins?

[Slugger]

Originally Posted by rsagetv99

That is probably what happened. Can you create an override before the game begins?

Yes, and actually it needs to be done before the game starts. Simply setup the recording in SageTV then load the SRE UI, go to the Overrides tab, find the listing, double click it and the rest should be self explanatory.

[Slugger]

SRE v2.0.1 is now available.

This version fixes the NBA parser just in time for the start of the NBA regular season and also enhances the MLB monitor to recognize suspended games as games that are done and can stop recording.

The NBA monitor is broken in v2.0.0 and all snapshot builds numbered lower than 29 as the NBA parser was fixed (today) in SVN revision 29.

[wayner]

I installed SRE but it did not work until I restarted Sage. Is there any point in having a maximum extension time more than 1 hour until hockey playoffs start? I will only be using SRE for NHL and NBA. Any chance of adding PGA golf to the list of sports covered?

p.s. - This comes just in time as the last two Leafs games went over their allotted 2:30 on TSN.

[Slugger]

Originally Posted by wayner

I installed SRE but it did not work until I restarted Sage. Is there any point in having a maximum extension time more than 1 hour until hockey playoffs start? I will only be using SRE for NHL and NBA. Any chance of adding PGA golf to the list of sports covered?

p.s. - This comes just in time as the last two Leafs games went over their allotted 2:30 on TSN.

I assume you're using 2.0.0 or above? Was it an upgrade or an initial install? Upgrades (on Windows) may be affected by an issue I'm investigating with the Jetty plugin.

You're right in that NHL games will rarely go more than 30 mins beyond the EPG listings during the regular season so you could lower it if you wanted. On the other hand, as long as the parsers are working (and I test them automatically on a daily basis) then leaving it high is safer and shouldn't cause any problems. The choice is yours.

PGA is tough for a number of reasons. First, I have never been able to find a web source with (near) real time scoring. And if such a source is found it must be easy to determine when the round is over (i.e. every golfer is off the course - it's only when we know this that we know it'd be safe to stop recording). If you can find an online source that can provide the information then adding it to SRE as a monitored event is rather trivial for me. This goes for any type of event - if you find the online source that I can parse, I don't have any issues adding it to SRE. I've had a few requests for NASCAR, but no one's been able to find parsable, real time data to use for monitoring.

[wayner]

It's a new install, I just downloaded it last night, but I do have the Sage Mobile Web tool also running and I know that they both use the jetty code.

Doesn't pgatour.com do the trick - it has realtime scoring? They only problem is that they may not have all of the info for the major tournaments as they are not held by the PGA tour. They have also gone to newer web technology that may be harder for you to scrape.

[Slugger]

Originally Posted by wayner

It's a new install, I just downloaded it last night, but I do have the Sage Mobile Web tool also running and I know that they both use the jetty code.

Doesn't pgatour.com do the trick - it has realtime scoring? They only problem is that they may not have all of the info for the major tournaments as they are not held by the PGA tour. They have also gone to newer web technology that may be harder for you to scrape.

Weird with the install. I don't suppose you have any debug output from Jetty?

As for pgatour.com, I'll have a look when I get a few moments to see what's there.

[Slugger]

The latest snapshot build of SRE contains two important fixes:

1) Fix a bug I introduced into the NBA parser that prevents monitoring of any games involving New Orleans.

2) Fix the broken NCAA football parser. Seems ESPN.com is doing some weird things with some of their scoreboards right now. This latest drop of the NCAA football parser works around the latest ESPN.com changes. My daily automated parser tests show that the other (in-season) parsers (NBA, NHL) are still working just fine (except for #1 above).

If either of these issues affect you, please grab the latest snapshot build and upgrade SRE. This latest snapshot will probably become official 2.0.2, but I don't have time to give a full regression test before I upload so I'll probably make the official release early next week. This also gives me a few more days to see if ESPN.com is going to make any other changes to its scoreboards that will need fixing.

[wayner]

Originally Posted by Slugger

Weird with the install. I don't suppose you have any debug output from Jetty?

What logs should I be loking for?

[wayner]

Originally Posted by Slugger

As for pgatour.com, I'll have a look when I get a few moments to see what's there.

A couple of things to keep in mind here - coverage of the first three rounds, but especially the third round, can end before the play is done as on Saturday the TV networks don't like to go over the 6 pm deadline. First and Second round play is on The Golf Channel and I believe they stay until play is done. For the final round they stay until play is done but occasionally, maybe once per year, the final round is played earlier in the day due to weather concerns therefore play may actually end before the telecast starts. But that wouldn't matter as long as you didn't have it end early.

Note that none of the above would apply for any of the four major tournaments.

[Slugger]

Originally Posted by wayner

What logs should I be loking for?

If you enable logging in SageTV then Jetty will spit out data to the logs. Also, there is an option to enable debug output in the Jetty plugin. I've been using the hot deploy extensively while working on SJQ 2.0.0 and haven't seen any problems with it (other than the above documented bug). If you have problems the next time you upgrade then turn on the debug options and see if they say anything.