Moving files to another NAS - Timeline Glitch

[bill321]

I am having a problem that I know I did not have before when moving files.

I have always been able to just move a recorded TV SageTV TS file from one NAS to another and after running a "scan imported media" have the file show up just as before.

Now when I do this, the file has a weird timeline and the playing starts about 5 minutes into the file. The end of the timeline is about 5 minutes of "red". The program plays fine but I have to rewind to get to the beginning of the program and it won't restart at the right spot until after I play it past the vertical yellow timeline that is at about the 5 minute mark.

I am at a loss, and I want to clean out an old NASLITE NAS to allow for repurposing that box.

Any help would be greatly appreciated.

Bill

[BobPhoenix]

Originally Posted by bill321

I am having a problem that I know I did not have before when moving files.

I have always been able to just move a recorded TV SageTV TS file from one NAS to another and after running a "scan imported media" have the file show up just as before.

Now when I do this, the file has a weird timeline and the playing starts about 5 minutes into the file. The end of the timeline is about 5 minutes of "red". The program plays fine but I have to rewind to get to the beginning of the program and it won't restart at the right spot until after I play it past the vertical yellow timeline that is at about the 5 minute mark.

I am at a loss, and I want to clean out an old NASLITE NAS to allow for repurposing that box.

Any help would be greatly appreciated.

Bill

Use the web server and adjust the start time back by however much you want to.

I see this all the time and have finally found out what I've been doing that causes it - for me at least. When I move the file SageTV needs to see it gone from the original location first then see it in the new location. When it does a scan for me and sees it missing from one and added to the other on the same scan I get what you describe. So I've started to do 2 scans. The first one after I remove the file from its original location. Then a second scan (after the first completes) with the file in it's new location. Of course YMMV and I haven't been doing it that way very long so it is possible that I'm wrong but so far it works for me.

[bill321]

Originally Posted by BobPhoenix

Use the web server and adjust the start time back by however much you want to.

Thanks for your help. I tried your suggestion to do two scans, but it didn't seem to fix the problem.

I have tried moving files from another NAS (a synology) to another synology, and the problem doesn't seem to happen. Perhaps it is an issue with the Naslite to Synology transfer. Or maybe it just happens on some files (I've only tried half a dozen or so both ways.) I'm stumped.

When you say use the web server to adjust the files, is this in the meta data editor in the web interface? If so, I can't find the field that I should adjust.

thanks again

Bill

[will]

Originally Posted by bill321

I have tried moving files from another NAS (a synology) to another synology, and the problem doesn't seem to happen. Perhaps it is an issue with the Naslite to Synology transfer. Or maybe it just happens on some files (I've only tried half a dozen or so both ways.) I'm stumped.

I have seen this issue too when I move around files but it only happened a few times and I think only on my pre-v7 recordings (I think) - I haven't moved stuff since I did storage space upgrade.

Have you tried shutting down Sage, moving the files, then putting Sage in a recovery scan mode and starting it up. This information may help.

[nyplayer]

Originally Posted by bill321

I am having a problem that I know I did not have before when moving files.

I have always been able to just move a recorded TV SageTV TS file from one NAS to another and after running a "scan imported media" have the file show up just as before.

Now when I do this, the file has a weird timeline and the playing starts about 5 minutes into the file. The end of the timeline is about 5 minutes of "red". The program plays fine but I have to rewind to get to the beginning of the program and it won't restart at the right spot until after I play it past the vertical yellow timeline that is at about the 5 minute mark.

I am at a loss, and I want to clean out an old NASLITE NAS to allow for repurposing that box.

Any help would be greatly appreciated.

Bill

By any chance do you have a 5 minute padding on these recordings? If you do then it will always happen... if not have you tried robocopy to move the files it copies over all attributes and timestamps.

movefile.bat You can drag and drop files onto batchfile.

Rem ********* Checks to make sure file is not in use
move "%~f1" "%~d1%~p1"
set checkuse=%ERRORLEVEL%
if %checkuse% NEQ 0 exit 1
Rem ********* Checks to make sure file is not in use

Rem ********* Moves files and assets
set origpath=%~d1%~p1%
set origipath="%origpath:~0,-1%"
robocopy %origipath% "\\NAS-BE-B8-48\backup\SAGEJANKEEP" "%~n1**" /mov
Rem ********* Moves files and assets
exit 0

[bill321]

Originally Posted by will

I have seen this issue too when I move around files but it only happened a few times and I think only on my pre-v7 recordings (I think) - I haven't moved stuff since I did storage space upgrade.

Have you tried shutting down Sage, moving the files, then putting Sage in a recovery scan mode and starting it up. This information may help.

All of the files were created by a HDPVR using the latest version 7 of Sage.

I tried the advanced mode of moving files a few weeks ago - there was no difference. I will try it again, though, later today when I can shutdown sage.

thanks

Bill

[bill321]

Originally Posted by nyplayer

By any chance do you have a 5 minute padding on these recordings? If you do then it will always happen... if not have you tried robocopy to move the files it copies over all attributes and timestamps.

Thanks for the batch file - I will try it.

The files have a minute of padding at the beginning and the end.

Bill

[nyplayer]

There is no need to Shutdown Sage run the batchfile and refresh.

[Skirge01]

Originally Posted by nyplayer

There is no need to Shutdown Sage run the batchfile and refresh.

I'm having the same issue ever since I started moving recordings on a daily basis using task scheduler. Any idea how I could incorporate such a check into my own batch file?

robocopy \\W7-Server\1_1\SageRecs "\\W7-Server\Recordings (DVR)" *.txt /mov /zb /xo /v /fp /np /log+:c:\scripts\txtmovelog.txt
robocopy \\W7-Server\1_1\SageRecs "\\W7-Server\Recordings (DVR)" *.log /mov /zb /xo /v /fp /np /log+:c:\scripts\logmovelog.txt
robocopy \\W7-Server\1_1\SageRecs "\\W7-Server\Recordings (DVR)" *.csv /mov /zb /xo /v /fp /np /log+:c:\scripts\csvmovelog.txt
robocopy \\W7-Server\1_1\SageRecs "\\W7-Server\Recordings (DVR)" *.data /mov /zb /xo /v /fp /np /log+:c:\scripts\datamovelog.txt
robocopy \\W7-Server\1_1\SageRecs "\\W7-Server\Recordings (DVR)" *.jpg /mov /zb /xo /v /fp /np /log+:c:\scripts\jpgmovelog.txt
robocopy \\W7-Server\1_1\SageRecs "\\W7-Server\Recordings (DVR)" *.properties /mov /zb /xo /v /fp /np /log+:c:\scripts\propertiesmovelog.txt
robocopy \\W7-Server\1_1\SageRecs "\\W7-Server\Recordings (DVR)" *.edl /zb /xo /v /fp /np /log+:c:\scripts\edlmovelog.txt
robocopy \\W7-Server\1_1\SageRecs "\\W7-Server\Recordings (DVR)" *.mpg /mov /mt:1 /zb /xo /v /fp /np /log+:c:\scripts\mpgmovelog.txt
robocopy \\W7-Server\1_1\SageRecs "\\W7-Server\Recordings (DVR)" *.ts /mov /mt:1 /zb /xo /v /fp /np /log+:c:\scripts\tsmovelog.txt

[nyplayer]

Originally Posted by Skirge01

I'm having the same issue ever since I started moving recordings on a daily basis using task scheduler. Any idea how I could incorporate such a check into my own batch file?

robocopy \\W7-Server\1_1\SageRecs "\\W7-Server\Recordings (DVR)" *.txt /mov /zb /xo /v /fp /np /log+:c:\scripts\txtmovelog.txt
robocopy \\W7-Server\1_1\SageRecs "\\W7-Server\Recordings (DVR)" *.log /mov /zb /xo /v /fp /np /log+:c:\scripts\logmovelog.txt
robocopy \\W7-Server\1_1\SageRecs "\\W7-Server\Recordings (DVR)" *.csv /mov /zb /xo /v /fp /np /log+:c:\scripts\csvmovelog.txt
robocopy \\W7-Server\1_1\SageRecs "\\W7-Server\Recordings (DVR)" *.data /mov /zb /xo /v /fp /np /log+:c:\scripts\datamovelog.txt
robocopy \\W7-Server\1_1\SageRecs "\\W7-Server\Recordings (DVR)" *.jpg /mov /zb /xo /v /fp /np /log+:c:\scripts\jpgmovelog.txt
robocopy \\W7-Server\1_1\SageRecs "\\W7-Server\Recordings (DVR)" *.properties /mov /zb /xo /v /fp /np /log+:c:\scripts\propertiesmovelog.txt
robocopy \\W7-Server\1_1\SageRecs "\\W7-Server\Recordings (DVR)" *.edl /zb /xo /v /fp /np /log+:c:\scripts\edlmovelog.txt
robocopy \\W7-Server\1_1\SageRecs "\\W7-Server\Recordings (DVR)" *.mpg /mov /mt:1 /zb /xo /v /fp /np /log+:c:\scripts\mpgmovelog.txt
robocopy \\W7-Server\1_1\SageRecs "\\W7-Server\Recordings (DVR)" *.ts /mov /mt:1 /zb /xo /v /fp /np /log+:c:\scripts\tsmovelog.txt

Not sure how to check for file use as you are mass moving files? Robocopy will issue an exit code of 1 if the file is in use but it will still copy it. That is why I have my own check.

I have wget and added the line below to the bottom of my batchfile to refresh the library. The sagewebserver has to be installed.

c:\wget\wget.exe --delete-after --tries=1 --directory-prefix="c:\wget" "http://Username:Password@SERVERNAME:8080/sage/GlobalCommand?command=UpdateMediaLibrary"


PS I do not have Sage to auto refresh ... it is set to manual. This way Sage will not refresh while a file move is in progress.

[BobPhoenix]

Originally Posted by bill321

Thanks for your help. I tried your suggestion to do two scans, but it didn't seem to fix the problem.

Two scans won't fix the problem if it already exists. It will only prevent it from happening (at least for me) on future moves.

[Skirge01]

Originally Posted by nyplayer

Not sure how to check for file use as you are mass moving files? Robocopy will issue an exit code of 1 if the file is in use but it will still copy it. That is why I have my own check.

I have wget and added the line below to the bottom of my batchfile to refresh the library. The sagewebserver has to be installed.

c:\wget\wget.exe --delete-after --tries=1 --directory-prefix="c:\wget" "http://Username:Password@SERVERNAME:8080/sage/GlobalCommand?command=UpdateMediaLibrary"


PS I do not have Sage to auto refresh ... it is set to manual. This way Sage will not refresh while a file move is in progress.

I'll give the wget method a try. Thanks!

[wayner]

Originally Posted by nyplayer

There is no need to Shutdown Sage run the batchfile and refresh.

You're saying that if I fix the timestamp on the file that Sage will fix the timeline recordings automatically? I will have another look at this but I swear that in the past that I had to move recordings out of a Sage monitored TV/Video library folder, do a scan, and then move the files back and do a second scan that totally reloads all of the file info before I can fix these timeline problems.

FYI - I am working on some SJQ code that will go through your files and check to see if the Last Modified attribute of the media file is the same as the Recording End time from the metadata. If not it will update the Last Modified attribute to correct it. Does anyone want me to post this?

[nyplayer]

Originally Posted by BobPhoenix

Use the web server and adjust the start time back by however much you want to.

I see this all the time and have finally found out what I've been doing that causes it - for me at least. When I move the file SageTV needs to see it gone from the original location first then see it in the new location. When it does a scan for me and sees it missing from one and added to the other on the same scan I get what you describe. So I've started to do 2 scans. The first one after I remove the file from its original location. Then a second scan (after the first completes) with the file in it's new location. Of course YMMV and I haven't been doing it that way very long so it is possible that I'm wrong but so far it works for me.

What I did after seeing this post is using the webserver and the MediafileID I was able to issue a delete of the old file from the DB once the new file was created by using the webserver this eliminated those temporary entries of 0 meg files. with the same name diff extension... this picks up the new file right away.

I hope to put something together but I am looking for a better way to get the MediafileID. Right now I am parsing through the Individual XML files created by Nielm sagexml to get the MediafileID.

[wayner]

Do you use SJQ? It is pretty easy to get a list of filename and mediafile ID -you can just write them to a text file.

[nyplayer]

Originally Posted by wayner

Do you use SJQ? It is pretty easy to get a list of filename and mediafile ID -you can just write them to a text file.

Thanks wayne

Right now I am also writing them to a text file along side the file using SJQ3 ... But I would like to Include in my batch job outside of SJQ as an alternative.

below is a sample of my delete using the file created by SJQ3.

American Horror Story Coven - S03E12 - Go to Hell -10626521-0.mpg.mediafileid (contents Below)
mediafileid=10445237

set /p mediafileid=<"%~f1.mediafileid"
set mediafileid=%mediafileid:~12%
echo %mediafileid%
C:\SAGETOOLS\wget\wget.exe --tries=3 --directory-prefix=C:\temp "http://user:ppassword@servername:8080/sage/AiringCommand?command=DeleteFile&MediaFileId=%mediafileid%&confirm=yes"
rem **********************************************************************************************************************************************************************************

rem Archive
rem Unarchive
rem SetWatched
rem ClearWatched
rem SetDontLike
rem convert

[wayner]

Originally Posted by nyplayer

Right now I am also writing them to a text file along side the file using SJQ3 ... But I would like to Include in my batch job outside of SJQ as an alternative.

SJQv4 uses Groovy and Slugger was kind enough to make a Groovy Dev environment so you can run your code without having to initiate it from a job in SJQ. The Groovy code is also pretty much the same as Java so you could also probably run the code in Java with very few changes since it uses the SageTV Java API.

[nyplayer]

Originally Posted by wayner

SJQv4 uses Groovy and Slugger was kind enough to make a Groovy Dev environment so you can run your code without having to initiate it from a job in SJQ. The Groovy code is also pretty much the same as Java so you could also probably run the code in Java with very few changes since it uses the SageTV Java API.

I will look into I never really got into being "Groovy". I just need an option that does not require additional Installs not for me but some of the users I support.. I like to keep them as simple as possible.

[wayner]

Originally Posted by nyplayer

I will look into I never really got into being "Groovy"

It's Feelin;' Groovy

Slow down, you move too fast.
You've got to make the moment last just,
kickin' down the cobblestones

[graywolf]

Originally Posted by wayner

FYI - I am working on some SJQ code that will go through your files and check to see if the Last Modified attribute of the media file is the same as the Recording End time from the metadata. If not it will update the Last Modified attribute to correct it. Does anyone want me to post this?

YES please