Plugin: SJQv4

[stanger89]

Hey all, long story short, I just restored my Sage PC from an image and then restored my SageTV setup from a backup and now I am unable to get SJQ (server/plugin) to start, it keeps reporting as Failed in the SageTV plugin manager. This reminds me of the trouble I had where SJQ and Squeezebox server would conflict with each other, so I wonder if it's a port issue now that I have the Windows Firewall enabled for SageDCT. So anyone have any ideas on any ports I need to make sure are enabled for SJQ or anything else to check to get it running again?

[Slugger]

Check the sagetv_0.txt log file... if the plugin failed to start, the exception that caused the failure should be logged there.

[stanger89]

I'm not seeing anything obvious in the logs, though right now the plugin itself shows as enabled but the UI hangs whenever I try and do anything with SJQ. Which IIRC is exactly like when I had Squeezecenter installed and they had conflicting ports.

[Slugger]

Originally Posted by stanger89

I'm not seeing anything obvious in the logs, though right now the plugin itself shows as enabled but the UI hangs whenever I try and do anything with SJQ. Which IIRC is exactly like when I had Squeezecenter installed and they had conflicting ports.

If that's the case then change the port that the H2 Database plugin listens on - that's the plugin/port that conflicts with the squeezebox server.

[stanger89]

Except I don't have squeezebox server installed anymore. I tried adding 9092 to the firewall as an allowed port but that didn't make any difference.

[Slugger]

Any clues in the sjq log files? SageTV\plugins\sjq4\*.log

If it's just the Sage UI for SJQ that's failing then it might be having problems of its own. I believe all of that is logged to the sage tv debug log, but I can't remember (tmiranda would be able to confirm). You can isolate it to a Sage UI only issue by installed the web UI addition for SJQ and seeing if that loads data from the sjq db, if it does then SJQ is working properly and you can focus on the UI plugin.

[stanger89]

You know what it was, apparently (probably due to hooking up my HVR1950) Windows decided to add a "Microsoft TV/Video Connection" and it seem SJQ/H2 was binding to that instead of my real nic.

http://support.microsoft.com/kb/303302

Magically restarting (which I thought I'd done, but maybe not) seems to have fixed it.

[Slugger]

Oh Microsoft...

[stanger89]

Switching to Cable, getting a cablecard tuner and trying to get SageDCT to work is turning out to be one of the bigger mistakes I've ever made in my system.

[Skirge01]

I'm planning to move to SJQ4 when I migrate to my VM of SageTV. Since I only have limited time to work on that (production system, swapping removable OS drives), I'd like to get as much info in advance as possible for next weekend's efforts. I haven't installed any SJQ in the VM yet, but I have read through the user guide, the metadata doc, the comskip tutorial, and even the comskip_test.groovy example. As proof, I offer up this minor typo from the script example:

   println "ERROR: Invalid environment data passed to scritpt!"

As I prepare to jump into this next weekend, is there a script or something I could reference for calling comskip based on the channel it's recorded on? From what I've read so far, it would appear that I'll need a separate groovy script for each channel I want to comskip. I suspect I will probably need to modify this code to do the channel check, correct?

if(checkRecordingType && fileType != null && fileType.length() > 0 && !fileName.endsWith("." + fileType)) {
   println "Recording is not of specified type '${fileType}', skipping comskip!"
   return 2
}

I've got no problem spending time figuring out how to do this, as I want to actually understand what I'm doing here, but let me know if I'm on the right track or way off.

For comskip.exe, this will also require calling a unique comskip.ini file for each channel and that's where I'm getting lost, as I don't see any ini file being called in the example groovy script. I suspect that may be because the writer of the tutorial was actually using Show Analyzer, yes? Or, could I just append the correct comskip.ini to either the "Executable" or "Executable Arguments" lines in the UI? As the tutorial only references variables from the SJQ4metadata doc, I wasn't sure if those were the only variables acceptable on the Executable Arguments line.

Thanks!

[Taddeusz]

Here is my code for doing Show Analyzer and Comskip. I am going to be transitioning to using Comskip so things are a little confusing. However, you can see how I handle channel filtering.

Object mediaFile = MediaFileAPI.GetMediaFileForID(SJQ4_METADATA.get("SJQ4_ID").toInteger())
String channel = AiringAPI.GetAiringChannelName(mediaFile)
/*String file = Tools.mapDir(SJQ4_METADATA.get("SJQ4_PATH") + "\\") + SJQ4_METADATA.get("SJQ4_LAST_SEGMENT")*/
String file = SJQ4_METADATA.get("SJQ4_PATH") + SJQ4_METADATA.get("SJQ4_LAST_SEGMENT")
String fileType = SJQ4_METADATA.get("SJQ4_LAST_SEGMENT_TYPE")

if(fileType == "mpg") {
   if(channel ==~ /KETA.*/) {
      println "Doesn't need comercials detected"
   }
   /*else if(channel ==~ /KFOR|KFORDT/) {
      println "Running SAKFOR"
      println file
      def command = "\"C:/Program Files (x86)/Dragon Global/ShowAnalyzer/ShowAnalyzer.exe\" -channelnumber 704 \"${file}\"".execute()
      command.consumeProcessOutput()
      command.waitFor()
      if (command.exitValue()) {
         return 1
      }
      else {
         return 0
      }
   }*/
   else {
      println "Running Comskip"
      println file
      /*def command = "\"C:/Program Files (x86)/Dragon Global/ShowAnalyzer/ShowAnalyzer.exe\" \"${file}\"".execute()*/
      def command = "\"C:/comskip/old/comskip.exe\" \"${file}\"".execute()
      command.consumeProcessOutput()
      command.waitFor()
      if (command.exitValue()) {
         //return 1
         return 0
      }
      else {
         //return 0
         return 1
      }
   }
}

if(fileType == "ts") {
   if(channel ==~ /KETA.*|ENC.*|EPIX|EPIXHD|TCM/) {
      println "Doesn't need commercials detected"
      return 0
   }
   else if(channel ==~ /KFOR|KFORDT/) {
      println "Running SAV1KFOR"
      println file
      def command = "\"C:/Program Files (x86)/Dragon Global/ShowAnalyzerSuite/ShowAnalyzerEngine.exe\" --profile kfor \"${file}\"".execute()
      command.consumeProcessOutput()
      command.waitFor()
      if (command.exitValue()) {
         return 1
      }
      else {
         return 0
      }
   }
   else {
      println "Running Comskip"
      println file
      def command = "\"C:/Program Files (x86)/Dragon Global/ShowAnalyzerSuite/ShowAnalyzerEngine.exe\" \"${file}\"".execute()
      /*def command = "\"C:/comskip/comskip.exe\" \"${file}\"".execute()*/
      command.consumeProcessOutput()
      command.waitFor()
      if (command.exitValue()) {
         return 1
         //return 0
      }
      else {
         return 0
         //return 1
      }
   }
}

[Skirge01]

Originally Posted by Taddeusz

Here is my code for doing Show Analyzer and Comskip. I am going to be transitioning to using Comskip so things are a little confusing. However, you can see how I handle channel filtering.

Actually, even with my admittedly "hobbyist" programming experience, that's making pretty good sense to me. Thanks for that! I'll examine it a little more closely and see what I can do with it.

[PLUCKYHD]

Originally Posted by Taddeusz

Here is my code for doing Show Analyzer and Comskip. I am going to be transitioning to using Comskip so things are a little confusing. However, you can see how I handle channel filtering.

GMENT_TYPE")

if(fileType == "mpg") {
   if(channel ==~ /KETA.*/) {
      println "Doesn't need comercials detected"
   }
   /*else if(channel ==~ /KFOR|KFORDT/) {
      println "Running SAKFOR"
      println file
 
}

WOAH those channel call signals look familiar Never met another sage brain that lived so close to me coffee might be in order

[Taddeusz]

Originally Posted by PLUCKYHD

WOAH those channel call signals look familiar Never met another sage brain that lived so close to me coffee might be in order

I know of at least one other SageTV user who lives in Oklahoma. There aren't many.

[Skirge01]

I took my first stab at this code and came up with some of my own, but then I compared it to the code here and noticed quite a bit more work being done in the test script. Was this just a portion of your code and I need to incorporate it into the test script? This probably sounds like a really dumb question, doesn't it?

I think I'm just missing how your code fits in with this tutorial.

[Taddeusz]

Originally Posted by Skirge01

I took my first stab at this code and came up with some of my own, but then I compared it to the code here and noticed quite a bit more work being done in the test script. Was this just a portion of your code and I need to incorporate it into the test script? This probably sounds like a really dumb question, doesn't it?

I think I'm just missing how your code fits in with this tutorial.

That wasn't my test script. I think I got my test script from the sample on the web site. I just kind of modified it to my own needs. The key part of the whole thing are the configured values. Everything else is the same. The other script I posted is the actual script.

/*
           Title: Comskip Tester for SJQv4
          Author: Derek Battams <derek AT battams DOT ca>
    Last Updated: 31 May 2011

    Use this groovy script as the test for your SJQv4 comskip tasks.  This version of the script allows you
    to skip running comskip if:

        * The recording file extension does not match the first command line argument passed to this script
        * If an edl (or equivalent) already exists in the same directory as the recording

    You can also configure this script to delay starting of comskip until the recording is completed.

    All of these settings are configured in the block below.  Do not edit below the line specified unless you
    know what you're doing (and if you do then send me your bug fix patches, please).
*/

/*************** CONFIGURE VALUES IN THIS BLOCK ONLY! ***************/

def checkRecordingType = false // Check the recording is of the type specified on the command line (i.e. only process mpg recordings)
def checkForEdl = true        // If true, mark the task as skipped if an edl already exists
def edlType = "edl"           // The edl extension (i.e. some people use .txt comskip files instead of .edl files)
def comskipLive = true       // If false, this test will push the task back to the queue while the recording is in progress
def ignoreLiveTv = false       // If true, live tv recordings will never be added to the queue

/********************************************************************/

/************************* DO NOT EDIT BELOW!! **********************/

// But if you do edit below to fix a bug, then email me the patch! ;)

def idStr = SJQ4_METADATA.get("SJQ4_ID")
if(!(idStr ==~ /\d+/)) {
   println "SJQ4_ID is not present in metadata; marking task as SKIPPED!"
   return 2
}

def objType = SJQ4_METADATA.get("SJQ4_TYPE")
if(objType != "MediaFile") {
   println "This script expects to run on a MediaFile object, but received '$objType'; marking task as SKIPPED!"
   return 2
}

def mf = MediaFileAPI.GetMediaFileForID(Integer.parseInt(idStr))
def path = new File(SJQ4_METADATA.get("SJQ4_PATH"))
def fileName = SJQ4_METADATA.get("SJQ4_LAST_SEGMENT")
def fileType
if(SJQ4_ARGS.length > 0)
   fileType = SJQ4_ARGS[0]
else
   fileType = null

if(mf == null || path == null || path.getAbsolutePath().length() == 0 || fileName == null || fileName.length() == 0) {
   println "ERROR: Invalid environment data passed to scritpt!"
   return 2
}

def edl = fileName.substring(0, fileName.lastIndexOf('.')) + ".${edlType}"
def edlFile = new File(path, edl)
if(edlFile.exists()) {
   println "An edl already exists for this recording, skipping comskip!"
   println "Found '${edlFile.getAbsolutePath()}'"
   return 2
}

if(checkRecordingType && fileType != null && fileType.length() > 0 && !fileName.endsWith("." + fileType)) {
   println "Recording is not of specified type '${fileType}', skipping comskip!"
   return 2
}

if(ignoreLiveTv && AiringAPI.IsNotManualOrFavorite(mf)) {
   println "Recording is live TV or IR recording, skipping comskip!"
   return 2
}

if(!comskipLive && MediaFileAPI.IsFileCurrentlyRecording(mf)) {
   println "Recording in progress, waiting..."
   return 1
}

return 0

[Skirge01]

Let me try asking the question differently. How does the script you provided in this thread get used by SJQ? Is this called via the "Test Script" parameter shown in the "Edit SJQ Task" screenshot of the guide, where the screenshot shows "//sagetv/SharedDocs/SageScripts/comskip_test.groovy"? In other words, your code would need to be in that folder and named "comskip_test.groovy", right?

Assuming that's correct, I also assume that all your favorites would simply have this groovy code assigned to them (manually?*)? In this way, you only need a single piece of code, which does all the work for you (checking channels & file types) and no need to mess with multiple groovy files. Still correct? Additionally, there's no need to check for an edl file, since this would only be triggered either when the recording starts or stops, unlike with SJQ3, whose "rules" could potentially be triggered during every run of the queue loader. Hopefully, I'm still on the right track here. Thanks for the patience!

*Is there a way to get this to be automatically set for all recordings, whether they be manual recordings or favorites?

[Taddeusz]

In no way is this manual for me. It all works automatically and is run for each and every recording.

The second script is the test script. The first script is the executable. The executable script It's run by adding "script:" before the path to the file. The test script only needs the path and filename of the script.

Basically, the test script compares a set of attributes of each recording to make sure they match before proceeding to execute.

Once you have the task created you go to Assign Tasks To Events. I have my "SAUNIFIED" task assigned to RecordingStarted. That way every time a recording begins it automatically begins detecting ads. If live detection is not your thing you assign the task to Recording Stopped.

[KarylFStein]

I do this a little differently. I run the media_file_scanner.groovy script every five minutes to see if anything needs to be run through comskip. The script has places in there to check channel names, (e.g. ignore HBO, etc.), and other things. If it finds a file that needs to be run through comskip, it triggers the following separate comskip.groovy script:

 
def cmd = "C:\\comskip\\comskip.exe"
def failed = false
 
for (int i = 0; i <= SJQ4_METADATA["SJQ4_MAX_SEGMENT_INDEX"].toInteger(); ++i) {
   def segment = SJQ4_METADATA["SJQ4_PATH"] + "/" + SJQ4_METADATA["SJQ4_SEGMENT_${i}"]
   def exe = [cmd, segment]
   def p = exe.execute()
   p.consumeProcessOutput(System.out, System.err)
   p.waitFor()
   def rc = p.exitValue()
   if(rc < 0 || rc > 1) // Task failed, but run against the rest of the segments anyways...
      failed = true
}
return failed ? 1 : 0

(Note that I didn't write any of this--someone else earlier in the thread did.)

[Skirge01]

Originally Posted by Taddeusz

In no way is this manual for me. It all works automatically and is run for each and every recording.

The second script is the test script. The first script is the executable. The executable script It's run by adding "script:" before the path to the file. The test script only needs the path and filename of the script.

Basically, the test script compares a set of attributes of each recording to make sure they match before proceeding to execute.

Once you have the task created you go to Assign Tasks To Events. I have my "SAUNIFIED" task assigned to RecordingStarted. That way every time a recording begins it automatically begins detecting ads. If live detection is not your thing you assign the task to Recording Stopped.

I think I understood that. The tutorial doesn't cover this "script:" prefix, but I think I'm right in where I believe it goes. Hopefully everything else I've written has been correct. If so, this shouldn't be too difficult.

Originally Posted by KarylFStein

I do this a little differently. I run the media_file_scanner.groovy script every five minutes to see if anything needs to be run through comskip. The script has places in there to check channel names, (e.g. ignore HBO, etc.), and other things. If it finds a file that needs to be run through comskip, it triggers the following separate comskip.groovy script:

That's a pretty good example of what Slugger described in the tutorial: that there are many ways to accomplish the same task. However, that particular script seems like unnecessary overhead. Scanning all recordings every 5 minutes seems like overkill. I like the simplicity of having it run only when each recording starts.