ffmpeg error creating thumbnail

[jusjoken]

I am now running a 64bit Ubuntu Linux SageTV Server running that latest deb package of 9.0.4.220

I am getting a number of repeating errors for thumbnail creation in my logs...

Sat 2/6 20:36:41.480 [ThumbnailGen@445660e9] MediaFile creating thumbnail to /opt/sagetv/server/GeneratedThumbnails/varmediavideosseriesMrRobotMrRobotS01E01eps10hellofriendmovmp4.jpg for MediaFile[id=94798 A[94810,94809,"Mr. Robot",0@0905.20:25,64,V] mask=V host=sagelinux encodedBy= format=Quicktime 1:04:51 742 kbps [#0 Video[H.264 23.98 fps 852x480 progressive]#1 Audio[AAC 48000 Hz 2 channels  idx=1 eng]{ScrapedBy=Phoenix, IMDBID=tt4652838, MediaType=TV, ScrapedDate=1454730967752, Trivia=, MediaProviderDataID=289590, MediaTitle=Mr. Robot, SeriesInfoID=0, TagLine=, DiscNumber=0, UserRating=86, Quotes=, MediaProviderID=tvdb, TrailerUrl=}] /var/media/videos/series/Mr Robot/Mr. Robot S01E01 eps1.0_hellofriend.mov.mp4, Seg0[Sat 9/5 20:25:08.910-Sat 9/5 21:30:00.000]]
Sat 2/6 20:36:41.489 [FinalRender-0023a500036b@f9508a3] MiniClient did not succeed with menu hint change to:menuName:Detailed Info - Video File, popupName:null, hasTextInput:false, errcode=1
Sat 2/6 20:36:41.981 [ThumbnailGen@445660e9] Error creating thumbnail from video file:MediaFile[id=94798 A[94810,94809,"Mr. Robot",0@0905.20:25,64,V] mask=V host=sagelinux encodedBy= format=Quicktime 1:04:51 742 kbps [#0 Video[H.264 23.98 fps 852x480 progressive]#1 Audio[AAC 48000 Hz 2 channels  idx=1 eng]{ScrapedBy=Phoenix, IMDBID=tt4652838, MediaType=TV, ScrapedDate=1454730967752, Trivia=, MediaProviderDataID=289590, MediaTitle=Mr. Robot, SeriesInfoID=0, TagLine=, DiscNumber=0, UserRating=86, Quotes=, MediaProviderID=tvdb, TrailerUrl=}] /var/media/videos/series/Mr Robot/Mr. Robot S01E01 eps1.0_hellofriend.mov.mp4, Seg0[Sat 9/5 20:25:08.910-Sat 9/5 21:30:00.000]] res=FFmpeg version git-1d682b5, Copyright (c) 2000-2008 Fabrice Bellard, et al.
  configuration: --disable-ffserver --disable-ffplay --enable-gpl --enable-pthreads --enable-nonfree --enable-libfaac --enable-libx264 --enable-libxvid --disable-devices --disable-demuxer=msnwc_tcp --enable-libfaad --extra-cflags=-I. -I/vagrant/sagetv/third_party/codecs/faad2/include -I/vagrant/sagetv/third_party/codecs/faac/include -I/vagrant/sagetv/third_party/codecs/x264 -I/vagrant/sagetv/third_party/codecs/xvidcore/src --extra-ldflags=-L/vagrant/sagetv/third_party/codecs/faac/libfaac/.libs -L/vagrant/sagetv/third_party/codecs/faad2/libfaad/.libs -L/vagrant/sagetv/third_party/codecs/x264 -L/vagrant/sagetv/third_party/codecs/xvidcore/build/generic/=build
  libavutil version: 49.6.0
  libavcodec version: 51.50.1
  libavformat version: 52.7.0
  libavdevice version: 52.0.0
  built on Jan 30 2016 23:03:52, gcc: 4.8.4
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x9389d0]edit list not starting at 0, a/v desync might occur, patch welcome
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/var/media/videos/series/Mr Robot/Mr. Robot S01E01 eps1.0_hellofriend.mov.mp4':
  Duration: 01:04:51.9, start: 0.000000, bitrate: 742 kb/s
    Stream #0.0(und): Video: h264, yuv420p, 852x480, progressive, 23.98 fps(r)
    Stream #0.1(eng): Audio: mpeg4aac, 48000 Hz, stereo
/opt/sagetv/server/ffmpeg: unrecognized option '-vf'

I am not at all familiar with what this log entry means however 1 item that does stand out to me is that "-I/vagrant/sagetv/third_party/..." and similar command line params are referenced a number of times and although /vagrant does exist there is no /vagrant/sagetv subfolder so if this was somehow supposed to be created as part of the deb package install it was not.

Is there another process I need to follow to create these entries so these codecs and libs can be located ? Or am I miss-reading the error ?

k

[troll5501]

I'm seeing the same error. I don't think those "/vagrant/sagetv" paths are an issue because they were just used in the build process. The problem seems to be:

/opt/sagetv/server/ffmpeg: unrecognized option '-vf'

But that seems strange since we are using the ffmpeg that is customized for Sage. Why would Sage be using a command-line option that is not available?

The full message I get is very similar to yours:

Sun 2/7 7:01:55.390 [ThumbnailGen@7dd4f719] MediaFile creating thumbnail to /opt/sagetv/server/GeneratedThumbnails/sagedataNewDaySunday372713330ts.jpg for MediaFile[id=37490839 A[37271333,17597315,"New Day Sunday",58646@0207.06:00,60,T] mask=TV host=sagelinux encodedBy=Hauppauge HD PVR 00A475E3 HDPVR Max Constant Rate format=MPEG2-TS 0:00:00 2948 kbps [#0 Video[H.264 29.97003 fps 1920x1080 16:9 interlaced id=1011]#1 Audio[AC3 48000 Hz 6 channels 448 kbps MAIN idx=1 id=1100]] /sagedata/NewDaySunday-37271333-0.ts, Seg0[Sun 2/7 6:00:00.002-Sun 2/7 7:00:00.004]]
Sun 2/7 7:01:55.748 [ThumbnailGen@7dd4f719] Error creating thumbnail from video file:MediaFile[id=37490839 A[37271333,17597315,"New Day Sunday",58646@0207.06:00,60,T] mask=TV host=sagelinux encodedBy=Hauppauge HD PVR 00A475E3 HDPVR Max Constant Rate format=MPEG2-TS 0:00:00 2948 kbps [#0 Video[H.264 29.97003 fps 1920x1080 16:9 interlaced id=1011]#1 Audio[AC3 48000 Hz 6 channels 448 kbps MAIN idx=1 id=1100]] /sagedata/NewDaySunday-37271333-0.ts, Seg0[Sun 2/7 6:00:00.002-Sun 2/7 7:00:00.004]] res=FFmpeg version git-1d682b5, Copyright (c) 2000-2008 Fabrice Bellard, et al.
  configuration: --disable-ffserver --disable-ffplay --enable-gpl --enable-pthreads --enable-nonfree --enable-libfaac --enable-libx264 --enable-libxvid --disable-devices --disable-demuxer=msnwc_tcp --enable-libfaad --extra-cflags=-I. -I/vagrant/sagetv/third_party/codecs/faad2/include -I/vagrant/sagetv/third_party/codecs/faac/include -I/vagrant/sagetv/third_party/codecs/x264 -I/vagrant/sagetv/third_party/codecs/xvidcore/src --extra-ldflags=-L/vagrant/sagetv/third_party/codecs/faac/libfaac/.libs -L/vagrant/sagetv/third_party/codecs/faad2/libfaad/.libs -L/vagrant/sagetv/third_party/codecs/x264 -L/vagrant/sagetv/third_party/codecs/xvidcore/build/generic/=build
  libavutil version: 49.6.0
  libavcodec version: 51.50.1
  libavformat version: 52.7.0
  libavdevice version: 52.0.0
  built on Jan 30 2016 23:03:52, gcc: 4.8.4
[h264 @ 0xc71100]error while decoding MB 40 18, bytestream (-68)
Input #0, mpegts, from '/sagedata/NewDaySunday-37271333-0.ts':
  Duration: 01:00:00.4, start: 4794.435044, bitrate: 14222 kb/s
  Program 1
    Stream #0.0[0x1011]: Video: h264, yuv420p, 1920x1080, AR: 16:9, progressive, 29.97 fps(r)
    Stream #0.1[0x1100]: Audio: ac3, 48000 Hz, stereo, 192 kb/s
/opt/sagetv/server/ffmpeg: unrecognized option '-vf'

[troll5501]

The calling code appears to be coming from MediaFile.java:

    // New version of FFMPEG requires using libavfilter for cropping
    if (!Sage.EMBEDDED)
    {
      args.add("-vf");
      args.add("crop=0:8:0:0,scale=" + width + ":" + height);
    }
    args.add("-vframes");
    args.add("1");
    if (Sage.EMBEDDED)
    {
      args.add("-s");
      args.add(width + "x" + height);
    }

But the error output from ffmpeg does not mention libavfilter:

  libavutil version: 49.6.0
  libavcodec version: 51.50.1
  libavformat version: 52.7.0
  libavdevice version: 52.0.0

[SageWizdom]

I've been chasing a similar problem on transcoding. Does anyone know of easy ways to adjust the command line options? I found that -wpred and another (which I currently forget) were causing extra problems.

[troll5501]

As a test, I updated the Java code (above) to use the "-s" option instead of "-vf" and now thumbnail creation is working fine.

Is it possible that a newer ffmpeg that supported "-vf" was used at some point in time maybe for Google Fiber, but when SageTV became open source an older ffmpeg was included instead? If so, maybe we just need to update SageTV to always use "-s".

Are Windows V9 users seeing this same issue or is it specific to Linux?

[HelenWeathers]

I am running the latest install of V9 on Win10 and searched my sage-0.txt for "thumbnail" and saw no creation errors.

[Narflex]

I commented in another thread about this...apparently the FFMPEG version is GitHub is a slightly newer version than the one that we distributed for V7. So some changes will need to be made to the Java code regarding passing invalid parameters...feel free to submit the changes.

[troll5501]

Originally Posted by HelenWeathers

I am running the latest install of V9 on Win10 and searched my sage-0.txt for "thumbnail" and saw no creation errors.

Did you install V9 from scratch, or did you upgrade V7 by replacing the Sage.jar and STV files?

[HelenWeathers]

Originally Posted by troll5501

Did you install V9 from scratch, or did you upgrade V7 by replacing the Sage.jar and STV files?

New/Clean install EDIT using Windows installer 9.0.4.224 beta 003 32 bit.

[troll5501]

Originally Posted by HelenWeathers

New/Clean install EDIT using Windows installer 9.0.4.224 beta 003 32 bit.

So now I'm wondering if the "other" (Sage V7) version of ffmpeg is somehow being included in the V9 Windows installer.

I can make the code change to switch from using "-vf" back to "-s" which works with the GitHub version of ffmpeg and fixes the issue on my system, but if anyone is using the V7 ffmpeg I'm concerned they will start to see errors.

[jusjoken]

Originally Posted by troll5501

So now I'm wondering if the "other" (Sage V7) version of ffmpeg is somehow being included in the V9 Windows installer.

I can make the code change to switch from using "-vf" back to "-s" which works with the GitHub version of ffmpeg and fixes the issue on my system, but if anyone is using the V7 ffmpeg I'm concerned they will start to see errors.

That is correct. As I have no way of building these binaries I am currently using the versions and MPlayer and FFMPEG that the windows version uses (SageTVPlayer.exe and SageTVTranscoder.exe respectively) from V7. I have them placed in the build/elf folder where I believe they would get built based on some of the build files I reviewed.

So any source changes you make will not impact or get into the Windows Installer version until we figure a way to consistently build these and then make them available for an installer build.

k

[stuckless]

Might need to add a if Sage.Linux check, since it's likely the windows binaries won't be rebuilt for some time

[troll5501]

Originally Posted by stuckless

Might need to add a if Sage.Linux check, since it's likely the windows binaries won't be rebuilt for some time

Yep, exactly what I was going to say. This way the Linux issue will be fixed without impacting Windows. And we can revisit this again later if/when the ffmpeg is able to be rebuilt on Windows.

I'll work on the changes and submit a pull request for this.

[troll5501]

I'm going to submit the fix/workaround for this issue today...looking forward to any feedback.

Instead of checking the OS type, I am calling ffmpeg to check the supported options and making a decision based on that. My concern is that we don't know for sure which version of ffmpeg someone has. I checked my old (archived) 7.1.9 Linux 32-bit installation and that ffmpeg actually did support -vf but the one included in V9 does not. So depending on how someone upgrades to V9 on Linux they could potentially have either one.

I also noticed that the older ffmpeg version does not support the skip non-keyframe options that SageTV is trying to use during the first attempt to create the thumbnail, so I'm checking that too in order to handle it more gracefully than just executing ffmpeg and having it fail. SageTV tries twice to create the thumbnail, using different options each time (and without the skip options the second time).

I tested the fix on Linux 64-bit (clean V9 install) and Windows (upgraded from 7.1.9 using JAR and STV) and it's working fine.

[Narflex]

Update for everyone. I've found the proper version of FFMPEG and am working on getting that into GitHub. That will resolve this issue and this workaround won't be needed. Hopefully I'll be able to get that done today.

[troll5501]

Originally Posted by Narflex

Update for everyone. I've found the proper version of FFMPEG and am working on getting that into GitHub. That will resolve this issue and this workaround won't be needed. Hopefully I'll be able to get that done today.

Thanks for all of your help and research on this issue!

[Narflex]

No problem...thanks for your contributions as well.

FFMPEG is now updated in GitHub (and x264 as well, to a much newer version since ffmpeg required that and I found the proper one we used before).

[jusjoken]

Originally Posted by troll5501

Thanks for all of your help and research on this issue!

Do you have a way of building the windows ffmpeg exe? If so, do you care to document the process or how to set up an environment for building it as i would like to incorporate it into the installer.... or build it and put the binary on BinTray.

k

[Narflex]

Originally Posted by jusjoken

Do you have a way of building the windows ffmpeg exe? If so, do you care to document the process or how to set up an environment for building it as i would like to incorporate it into the installer.... or build it and put the binary on BinTray.

k

I used to build it on Windows using msys. The configure commands and dependencies for it are basically the same as on Linux. If I were to build it from the open source code right now...I'd end up with the exact same executable that's in the V7 installer; so you can just take that one for now.

The script I used for building it (and other dependencies of it) is already in GitHub here: https://github.com/google/sagetv/blo...dwin/mbuild.sh

The paths in it aren't correct anymore since we moved directories around for the open source version; but fixing those shouldn't be hard at all.

[jusjoken]

Originally Posted by Narflex

but fixing those shouldn't be hard at all.

Famous last words I thought a windows installer couldn't be that hard either

Anyway, I will investigate and give it a try.

Thanks
k