SageTV Community  

Go Back   SageTV Community > SageTV Development and Customizations > SageTV v7 Customizations
Forum Rules FAQs Community Downloads Today's Posts Search

Notices

SageTV v7 Customizations This forums is for discussing and sharing user-created modifications for the SageTV version 7 application created by using the SageTV Studio or through the use of external plugins. Use this forum to discuss plugins for SageTV version 7 and newer.

Reply
 
Thread Tools Search this Thread Display Modes
  #1  
Old 07-23-2012, 12:10 PM
dinki's Avatar
dinki dinki is offline
Sage Expert
 
Join Date: Mar 2006
Posts: 682
Is there an easy way to delete orphan support files?

Hey guys. I'm using the SAD (Sage Artifact Deletion) plugin to remove supporting files (mostly comskip related files) from shows I manually delete. This is great but I've found that I've got a ton of orphaned .incommercial, .logo.txt, .edl, etc files that I'd really like to delete.

Does anyone know of an easy way to check if an mpg does not exist for a list of the above extensions and if it doesn't then have those files deleted?
__________________
Intel Core i5-2500, 16GB RAM, OMV Linux 4.17, 3 TB of Data
SageTV 9 Docker, Open DCT Docker
Silicondust HDHomeRun Duo + Quatro
Sage Mini Client on Amazon Fire Sticks and Android TVs
Reply With Quote
  #2  
Old 07-23-2012, 12:43 PM
nyplayer nyplayer is offline
SageTVaholic
 
Join Date: Sep 2005
Posts: 4,997
Use Dirmon2
__________________
Channels DVR UBUNTU Server 2 Primes 3 Connects TVE SageTV Docker with input from Channels DVR XMLTV and M3U VIA Opendct.
Reply With Quote
  #3  
Old 07-23-2012, 01:49 PM
tmiranda's Avatar
tmiranda tmiranda is offline
SageTVaholic
 
Join Date: Jul 2005
Location: Central Florida, USA
Posts: 5,851
If your using CommercialDetector just add those extensions to the list of files to cleanup. That will take care of the future. You'll have to manually delete the existing orphans.
__________________

Sage Server: 8th gen Intel based system w/32GB RAM running Ubuntu Linux, HDHomeRun Prime with cable card for recording. Runs headless. Accessed via RD when necessary. Four HD-300 Extenders.
Reply With Quote
  #4  
Old 07-23-2012, 02:28 PM
dinki's Avatar
dinki dinki is offline
Sage Expert
 
Join Date: Mar 2006
Posts: 682
Quote:
Originally Posted by nyplayer View Post
Oh yeah, forgot I used to use that to launch comskip. I'll have to see if I can remember how to set it up again.

Quote:
Originally Posted by tmiranda View Post
If your using CommercialDetector just add those extensions to the list of files to cleanup. That will take care of the future. You'll have to manually delete the existing orphans.
That's the weird part. I'm using CD but it doesn't appear to delete anything. I just checked and I've got it set to delete all of the files (and more) that I listed above.
__________________
Intel Core i5-2500, 16GB RAM, OMV Linux 4.17, 3 TB of Data
SageTV 9 Docker, Open DCT Docker
Silicondust HDHomeRun Duo + Quatro
Sage Mini Client on Amazon Fire Sticks and Android TVs
Reply With Quote
  #5  
Old 07-24-2012, 06:16 AM
tmiranda's Avatar
tmiranda tmiranda is offline
SageTVaholic
 
Join Date: Jul 2005
Location: Central Florida, USA
Posts: 5,851
Quote:
Originally Posted by dinki View Post
That's the weird part. I'm using CD but it doesn't appear to delete anything. I just checked and I've got it set to delete all of the files (and more) that I listed above.
Set the debug log level to Trace and send me a logfile to look it. I've never seen this issue so I'd like to see why it's not working. I'm debating releasing a CD update and if this turns out to be a bug that needs fixing the debate will be over
__________________

Sage Server: 8th gen Intel based system w/32GB RAM running Ubuntu Linux, HDHomeRun Prime with cable card for recording. Runs headless. Accessed via RD when necessary. Four HD-300 Extenders.
Reply With Quote
  #6  
Old 07-24-2012, 07:04 AM
dinki's Avatar
dinki dinki is offline
Sage Expert
 
Join Date: Mar 2006
Posts: 682
Quote:
Originally Posted by tmiranda View Post
Set the debug log level to Trace and send me a logfile to look it. I've never seen this issue so I'd like to see why it's not working. I'm debating releasing a CD update and if this turns out to be a bug that needs fixing the debate will be over
So I turned it on and of course it appears to be working fine. I know that I had problems with this in the past and ended up installing SAD to try and fix what CD wasn't deleting. I'm looking a bit closer at my recordings directory now and see a few files that are orphaned from yesterday:

Code:
AntiquesRoadshow-VintagePittsburgh-7380562-0.logo.txt
SesameStreet-GoodbyePacifier-7374856-0.logo.txt
VegasStrip-S01E03-7366332-0.mpg.properties
Now I don't know why these are still hanging on. All of these were live tv and not scheduled recordings. Also, I set up a job with dirmon to delete artifacts yesterday so I could very well be stepping on things with dirmon, CD and SAD all trying to delete orphans. I'll disable dirmon and SAD and see what happens.

*EDIT* All seems to be working fine. Now I just need to get rid of my orphaned files from the past and keep an eye on live recording clean ups. I edited my sage.properties file and changed:

Code:
commercial_debug_logging=trace
Is that right? If so, where does the log show up?
__________________
Intel Core i5-2500, 16GB RAM, OMV Linux 4.17, 3 TB of Data
SageTV 9 Docker, Open DCT Docker
Silicondust HDHomeRun Duo + Quatro
Sage Mini Client on Amazon Fire Sticks and Android TVs

Last edited by dinki; 07-24-2012 at 07:23 AM.
Reply With Quote
  #7  
Old 07-24-2012, 12:03 PM
tmiranda's Avatar
tmiranda tmiranda is offline
SageTVaholic
 
Join Date: Jul 2005
Location: Central Florida, USA
Posts: 5,851
Don't edit the properties file to turn on debugging, it won't work. Go to the CommercialDetector settings and turn it on from there.

The cleanup is triggered when the core sends a "MediaFileDeleted" event. Sometimes this event is not sent right away so some delay between ending live TV and deleting the orphans can happen.
__________________

Sage Server: 8th gen Intel based system w/32GB RAM running Ubuntu Linux, HDHomeRun Prime with cable card for recording. Runs headless. Accessed via RD when necessary. Four HD-300 Extenders.
Reply With Quote
  #8  
Old 07-24-2012, 12:57 PM
dinki's Avatar
dinki dinki is offline
Sage Expert
 
Join Date: Mar 2006
Posts: 682
Gotcha. Set to trace and will report back if I see any more orphans. Thanks!
__________________
Intel Core i5-2500, 16GB RAM, OMV Linux 4.17, 3 TB of Data
SageTV 9 Docker, Open DCT Docker
Silicondust HDHomeRun Duo + Quatro
Sage Mini Client on Amazon Fire Sticks and Android TVs
Reply With Quote
  #9  
Old 07-25-2012, 09:03 AM
dinki's Avatar
dinki dinki is offline
Sage Expert
 
Join Date: Mar 2006
Posts: 682
Found one orphan from last night:

Code:
AmericasGotTalent-S07E20-7383002-0.logo.txt
Can you tell me where I can find the log file? checked in the logs subdir but didn't see it.
__________________
Intel Core i5-2500, 16GB RAM, OMV Linux 4.17, 3 TB of Data
SageTV 9 Docker, Open DCT Docker
Silicondust HDHomeRun Duo + Quatro
Sage Mini Client on Amazon Fire Sticks and Android TVs
Reply With Quote
  #10  
Old 07-25-2012, 10:04 AM
nyplayer nyplayer is offline
SageTVaholic
 
Join Date: Sep 2005
Posts: 4,997
Quote:
Originally Posted by dinki View Post
Found one orphan from last night:

Code:
AmericasGotTalent-S07E20-7383002-0.logo.txt
Can you tell me where I can find the log file? checked in the logs subdir but didn't see it.
Why not just cleanup in comskip the logo file. That way it will be gone when comskip is finished.

in ini
delete_logo_file=1
__________________
Channels DVR UBUNTU Server 2 Primes 3 Connects TVE SageTV Docker with input from Channels DVR XMLTV and M3U VIA Opendct.

Last edited by nyplayer; 07-25-2012 at 10:09 AM.
Reply With Quote
  #11  
Old 07-25-2012, 10:09 AM
dinki's Avatar
dinki dinki is offline
Sage Expert
 
Join Date: Mar 2006
Posts: 682
Quote:
Originally Posted by nyplayer View Post
Why not just cleanup in comskip the logo file.

in ini
delete_logo_file=1
Double checked and I already have this value set.
__________________
Intel Core i5-2500, 16GB RAM, OMV Linux 4.17, 3 TB of Data
SageTV 9 Docker, Open DCT Docker
Silicondust HDHomeRun Duo + Quatro
Sage Mini Client on Amazon Fire Sticks and Android TVs
Reply With Quote
  #12  
Old 07-25-2012, 10:30 AM
nyplayer nyplayer is offline
SageTVaholic
 
Join Date: Sep 2005
Posts: 4,997
Quote:
Originally Posted by dinki View Post
Double checked and I already have this value set.
That leads me to believe that comskip did not fully complete for that show... must have failed somehow and did not get cleaned up.
__________________
Channels DVR UBUNTU Server 2 Primes 3 Connects TVE SageTV Docker with input from Channels DVR XMLTV and M3U VIA Opendct.
Reply With Quote
  #13  
Old 07-25-2012, 10:46 AM
dinki's Avatar
dinki dinki is offline
Sage Expert
 
Join Date: Mar 2006
Posts: 682
Perhaps. This was a live tv viewing and not a scheduled recording. May have switched channels before the program finished. Trying to figure out some way to reliably get rid of all these extra files.
__________________
Intel Core i5-2500, 16GB RAM, OMV Linux 4.17, 3 TB of Data
SageTV 9 Docker, Open DCT Docker
Silicondust HDHomeRun Duo + Quatro
Sage Mini Client on Amazon Fire Sticks and Android TVs
Reply With Quote
  #14  
Old 07-25-2012, 10:53 AM
tmiranda's Avatar
tmiranda tmiranda is offline
SageTVaholic
 
Join Date: Jul 2005
Location: Central Florida, USA
Posts: 5,851
The logfile is the Sage logfile on the server, located in the same directory as sage.exe. sagetv_0.txt.

If you have delete_logo_file=1 in the comskip.ini probably one of two things is happening:
- You're unknowingly using a different .ini file. CommercialDetector will look for custom .ini files based on show name and channel.
- comskip.exe is crashing (or hanging) and never cleaning up after itself.

I should be able to tell by looking at the logfile.
__________________

Sage Server: 8th gen Intel based system w/32GB RAM running Ubuntu Linux, HDHomeRun Prime with cable card for recording. Runs headless. Accessed via RD when necessary. Four HD-300 Extenders.
Reply With Quote
  #15  
Old 07-25-2012, 10:58 AM
dinki's Avatar
dinki dinki is offline
Sage Expert
 
Join Date: Mar 2006
Posts: 682
Thanks for looking. Here's the log file
Attached Files
File Type: zip sagetv_0.zip (672.4 KB, 116 views)
__________________
Intel Core i5-2500, 16GB RAM, OMV Linux 4.17, 3 TB of Data
SageTV 9 Docker, Open DCT Docker
Silicondust HDHomeRun Duo + Quatro
Sage Mini Client on Amazon Fire Sticks and Android TVs
Reply With Quote
  #16  
Old 07-25-2012, 12:57 PM
tmiranda's Avatar
tmiranda tmiranda is offline
SageTVaholic
 
Join Date: Jul 2005
Location: Central Florida, USA
Posts: 5,851
Quote:
Originally Posted by dinki View Post
Thanks for looking. Here's the log file
Nothing unusual in there. I don't see where "America's Got Talent" was processed, it's probably in an earlier log. Look for logfiles sagetv_1.txt and sagetv_2.txt and see if there are references to "AmericasGotTalent".

If you can't find that then do some channel surfing until you reproduce the problem and then send that logfile.

Thanks,

Tom
__________________

Sage Server: 8th gen Intel based system w/32GB RAM running Ubuntu Linux, HDHomeRun Prime with cable card for recording. Runs headless. Accessed via RD when necessary. Four HD-300 Extenders.
Reply With Quote
  #17  
Old 08-25-2013, 12:27 PM
NoodleNT NoodleNT is offline
Sage Advanced User
 
Join Date: Mar 2011
Location: DC
Posts: 197
Thanks, this should be defaulted to on

Just cleaned up over 9k files from my system!
Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
SageTV Orphan Mpg's any easy way to find them? perfessor101 SageTV Customizations 4 01-16-2007 11:46 AM
Is processing my files just as easy as xml files? dvd_maniac SageTV Customizations 9 11-05-2005 04:38 PM
Delete Orphan Files snoopy SageTV Customizations 6 08-05-2005 10:12 PM
Easy way to delete a watched show? wot_fan SageTV Software 15 06-02-2005 05:04 PM
An easy way to support STB -> Firewire? idea! eobiont Hardware Support 3 02-23-2005 04:56 PM


All times are GMT -6. The time now is 01:21 PM.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2023, vBulletin Solutions Inc.
Copyright 2003-2005 SageTV, LLC. All rights reserved.