Plugin: SJQv4

[jbuszkie]

Oh... and I can reproduce this by triggering on the start of recording and then it returns with a "recording in progress" and waits.. by the time it comes around again, the file was deleted..

[jbuszkie]

ok.. After looking to the groovy script, should it return a 2 instead of a 1 where it checks for bad data? So it doesn't re-queue??

This is the comskip groovy file...

Jim

[billmedia]

update - the task is back
here is the line from the log
2010-12-18 20:30:07,079 INFO [TvRecordingTaskLoader]: Added task 'COMPRESS' to queue! [135]

This 'COMPRESS' task was removed and does not show in any files or interfaces I can locate. Where are the 'Assign tasks to Event' tasks from the sage client plugin stored?

[Slugger]

Originally Posted by billmedia

I have sjq4 running, using sage client plugin, and enjoying the potential. Working on my groovy scripts now. In my early attempts to create tasks on the client, I created a task which I cannot remove. It does not show when I open the client and click supported tasks. Nothing shows in chron tab either. However, this task keeps popping in the queued tasks - waiting for client. I tried uninstalling the plugins, and reinstall, yet the tasks remain. How can I remove this task, can I open the h2 db? If so how.
Go figure, I have been trying to sort this out for days, all the while removing the tasks from the queued tasks. I finally decide to make a post, and now it is resolved. I am still interested in where the tasks were coming from, if created as chron tasks, is that stored in db or chrontab file? If event triggered, where is that persisted?

All event triggers are persisted in the H2 db:

http://localhost:8082/

The crontab file for scheduled events is in SageTV\plugins\sjq\crontab

Without a copy of the H2 db and a copy of your crontab along with the sjq.log and sjqagent.log files, I could not tell you why any task was ending up in the queue.

[Slugger]

Originally Posted by phelme

Sorry for the confusion, I know those aren't errors, the errors are in the sjq.log file, like this:

12-17 19:39:15,153 INFO  [TaskQueue]: Scheduling queue processor for ~8 seconds from now!
2010-12-17 19:39:15,153 INFO  [Handler]: CMD: QUIT :: PEER: /10.0.1.35
2010-12-17 19:39:23,153 INFO  [TaskQueue]: Running queue processor now!
2010-12-17 19:39:23,168 INFO  [TaskQueue]: Assigned task 26 of type 'SDCOMSKIP' to Client[host=10.0.1.35:23344,state=ONLINE,lastUpdate=Fri Dec 17 19:39:23 PST 2010]
2010-12-17 19:39:23,168 INFO[ListenerClient]: Disconnected from 10.0.1.35:23344
2010-12-17 19:39:25,778 INFO[Listener]: Received connection from: /10.0.1.35
2010-12-17 19:39:28,106 ERROR [Handler]: IOError
java.net.SocketException: Connection reset
	at java.net.SocketInputStream.read(Unknown Source)
	at java.net.SocketInputStream.read(Unknown Source)
	at java.io.ObjectInputStream$PeekInputStream.peek(Unknown Source)
	at java.io.ObjectInputStream$BlockDataInputStream.readBlockHeader(Unknown Source)
	at java.io.ObjectInputStream$BlockDataInputStream.refill(Unknown Source)
	at java.io.ObjectInputStream$BlockDataInputStream.read(Unknown Source)
	at java.io.DataInputStream.readUnsignedShort(Unknown Source)
	at java.io.ObjectInputStream$BlockDataInputStream.readUnsignedShort(Unknown Source)
	at java.io.ObjectInputStream$BlockDataInputStream.readUTF(Unknown Source)
	at java.io.ObjectInputStream.readUTF(Unknown Source)
	at com.google.code.sagetvaddons.sjq.listener.Handler.run(Handler.java:62)
	at java.lang.Thread.run(Unknown Source)
2010-12-17 19:39:28,106 INFO[Listener]: Received connection from: /10.0.1.35
2010-12-17 19:39:28,106 INFO  [Handler]: CMD: LOGTEST :: PEER: /10.0.1.35

what I'm not sure is what is causing the IOError and there seems to be little indication as to the cause from that log file. I thought maybe there would be something in the sjqagent.log file that might help, but nothing much happens there as you can see.

The IOError is the connection reset exception, which can be ignored.

[Slugger]

Originally Posted by jbuszkie

Oh... and I can reproduce this by triggering on the start of recording and then it returns with a "recording in progress" and waits.. by the time it comes around again, the file was deleted..

Originally Posted by jbuszkie

ok.. After looking to the groovy script, should it return a 2 instead of a 1 where it checks for bad data? So it doesn't re-queue??

This is the comskip groovy file...

Jim

Yes, return a 2 instead of 1 to prevent it from requeuing.

[Slugger]

Originally Posted by jbuszkie

I'm getting this too.. my guess is it's trying to run on a file that's already been deleted. How do we fix this.. the queue won't seem to proceed when this error is there...

Jim

Delete the offending task from the active queue to allow others to proceed. I'll have to take a look at the groovy script to figure out how to account for deleted media files (anyone wanting to patch it before I do is more than welcome to post a patch). I'm travelling to Ottawa tomorrow so probably won't be looking at it until Monday.

[Slugger]

Originally Posted by wayner

I am just getting up and running now on V4 on a new server. Sorry if I missed this, but how do you do internal tasks the way that you did in previous versions, specifically starting a conversion to a different format where the output file is in a different folder and is renamed with the episode title?

Or should I use an external task to do the transcode, like the Mediashrink? In some instances I may want to also run Comskip as well before transcoding.

You can call the SageTV transcoder queue from a groovy script. I have no example of doing it, but if you take a look at the archive script I'm using it may be able to get you pointed in the right direction.

Instead of just moving the recording, you'll want to make calls to the TranscodAPI, etc.

[wayner]

Originally Posted by Slugger

You can call the SageTV transcoder queue from a groovy script. I have no example of doing it, but if you take a look at the archive script I'm using it may be able to get you pointed in the right direction.

Instead of just moving the recording, you'll want to make calls to the TranscodAPI, etc.

Is there a reference doc somewhere that shows what Sage procedure I call and what parameters you pass to it - such as SageTranscode(SourceFile, Destfile, TranscodeType, DeleteOriginalFile)?

[Slugger]

Originally Posted by wayner

Is there a reference doc somewhere that shows what Sage procedure I call and what parameters you pass to it - such as SageTranscode(SourceFile, Destfile, TranscodeType, DeleteOriginalFile)?

http://download.sage.tv/api/

Specifically, the TranscodeAPI and then look for the AddTranscodeJob method.

[wayner]

Although it is totally up to Slugger I think there should be a web tool for SJQv4.

One of the reasons is that it will be easier to maintain SJQV4 for multiple UIs.

I personally do not like the default UI, even the V7 default UI so I continue to use SageMC (and I am not the only one). I do not believe there is any way to use the SJQv4 UI from SageMC - I have to switch back to the default UI. (Note that I generally do use the default UI on my server which isn't really used for watching Sage).

And consider what will happen if we do get several improved UIs for SageV7 such as Phoenix, Ortus (assuming it is not dead), etc. Will you guys be wanting to maintain the UI for all of them? I believe there were similar issues with maintaining plugins on early versions of Sage for SageMC and the default UI.

[tmiranda]

I just submitted an update to the UI Mod Plugin. It addresses the incompatibility with other Plugins that add items to the Setup menu and it fixes the text input dialog. There are a few other tweaks in there as well but nothing earth shattering.

[tmiranda]

Originally Posted by wayner

And consider what will happen if we do get several improved UIs for SageV7 such as Phoenix, Ortus (assuming it is not dead), etc. Will you guys be wanting to maintain the UI for all of them?

It all depends on what happens with these other UIs. I can't see myself porting the UI to all of them, but if one rises above the rest I can see supporting that. I'm just in wait and see mode.

[tmiranda]

I've been toying with the idea of adding "status" icons to the main header so you can see at a glance what SJQ is up to no matter what menu you are viewing. This is not meant to replace the status messages that are sent by the SJQ Engine, but rather provide some quick visual clues to what is happening. I'd like some feedback on this idea.

I thought about adding icons for the following:
- Task is running.
- Task has succeeded or failed.
- Client is OFFLINE.

I have not figured out all of the details such as how to show multiple tasks and and how long to show the status icon before removing it.

Does this make sense? Anything other "status" items you'd like to see in the header?

[billmedia]

Originally Posted by Slugger

All event triggers are persisted in the H2 db:

http://localhost:8082/

The crontab file for scheduled events is in SageTV\plugins\sjq\crontab

Without a copy of the H2 db and a copy of your crontab along with the sjq.log and sjqagent.log files, I could not tell you why any task was ending up in the queue.

I attempted opening the sjq4.h2.db - what would user/password be?

Here are my files.
The COMPRESS task gets queued whenever a record event happens.

[Slugger]

Originally Posted by billmedia

I attempted opening the sjq4.h2.db - what would user/password be?

Here are my files.
The COMPRESS task gets queued whenever a record event happens.

admin/admin

If the task is queued on any recording then that's from the assign tasks to events menu. If it's only for a specific fav then it's a property of that fav and won't be in the SJQ db. Instead edit the property for that fav.

[billmedia]

Thanks for the response, I saw the COMPRESS task in the db. On a hunch I created a new task named COMPRESS and once I did this it showed up in the associate task to event screens. I deselected and all is well, the task no longer queues. SJQ4 is running great, I have created a script to launch mediashrink on selected shows, as long as no extender connected and current show not recording. I love the client plugin as well.

[barney B.A.]

Has anyone else noticed that there may be a possible memory leak.
I uninstalled tmiranda's great comskip plugins and installed the new sjq4 including tmiranda's ui tool and one client on the main server. I consulted the online guide for setting up sjq4 using the comskip example which actually works quite well. (not quite as good as tmiranda's comskip but pretty well). However I noticed that for the first time ever I am getting java memory leaks. It hits the ceiling at 768K and eventually freezes. This seems to happen after it processes a few comskip tasks.

[Slugger]

Originally Posted by barney B.A.

Has anyone else noticed that there may be a possible memory leak.
I uninstalled tmiranda's great comskip plugins and installed the new sjq4 including tmiranda's ui tool and one client on the main server. I consulted the online guide for setting up sjq4 using the comskip example which actually works quite well. (not quite as good as tmiranda's comskip but pretty well). However I noticed that for the first time ever I am getting java memory leaks. It hits the ceiling at 768K and eventually freezes. This seems to happen after it processes a few comskip tasks.

During development I feared there was a memory leak caused by SJQ. Further testing lead me to believe that wasn't the case, but was caused by other plugin(s). Before releasing beta one, I stripped my system down to the core + SJQ and could not reproduce the memory leaks I was seeing after 7 days of up time. With that result, I accounted for the memory issues as being caused by some other plugins I had installed during v4 development. I have not been able to reproduce the heap exhaustion since removing the other plugins I suspected. Is your system core + SJQ only (i.e. no other plugins besides SJQ and its dependencies)? With that said, I'm certainly not saying a mem leak in SJQ isn't possible, but so far I have no evidence that one exists (as caused by SJQv4).

[barney B.A.]

I have lots of plugins. I suppose it could be one of them, however I only ever had issues since installing sjq4. Could it be that there is another plugin not playing nicely with sjq4? I am willing to help any way I can. Be warned though that I am not a programmer and the extent of my scripting abilities ends with the dos prompt and notepad.