SageTV Community  

Go Back   SageTV Community > General Discussion > General Discussion
Forum Rules FAQs Community Downloads Today's Posts Search

Notices

General Discussion General discussion about SageTV and related companies, products, and technologies.

Reply
 
Thread Tools Search this Thread Display Modes
  #1  
Old 02-06-2011, 03:21 AM
sdsean's Avatar
sdsean sdsean is offline
Sage Expert
 
Join Date: Jul 2008
Posts: 571
Anybody here understand the details of transcoding video?

So I've gotten pretty handy at using eac3 and handbrake.
I'm able to convert blu-ray videos fairly easily into mkvs that are smaller (although having to sift through the playlists in blu-ray folders to figure out what files are needed for the main movie is a huge pain).

Anyway typically what I do once I know what the structure of the files is to use eacto to take all the m2ts files and demux / concat the h264/vc1 file into one big file (video), and the same for the dtshd (audio).

Then I remux these to files into one giant ts file.

Then I use handbrake to conver the video (even if its vc1) to h264 at ~3000 bit rate (video), and convert the audio to ac3 (b/c I could care less about dtshd and my HD200 doesn't support it anyway).

The process works great but is of course pretty time consuming. Extracting/figuring out the files takes anywhere from 5 minutes to 30 depending on the disk structure.

Demux/Concat of video and audio takes ~20 minutes with eacto.
Remux takes about ~10 minutes

But then the transcode and creation of the mkv takes a whopping 3 hours or so .. . I usually force the handbrakecli process to only use 4 (out of 8) cores, and "Below Normal" priority, just so my CPU isn't completely pegged.

But this is pretty stout machine / processor and I'm suprised that it takes that long. . . I mean I know these files are huge, but still. . .

handbrakecli runs at around 9-15 fps. If I let it go full throttle then its more like 15-22.

I guess I was wondering if there is anything I can do to speed up the process. Especially the handbrake part. Handbrake seems to only use the CPU for the transcoding. . .could it not use the video card as well?

Thoughts?
__________________
AMD Ryzen 9 3900XT 12 Core+HT, 64GB DDR5, GeForce 1060, MSI Prestige x570 Creation Mobo, SIIG 4 port Serial PCIe Card, Win10, 1TB M.2 SSD OS HDD, 1 URay HDMI Network Encoder, 3 HD-PVR, 4 DirecTV STB serial tuned


Reply With Quote
  #2  
Old 02-06-2011, 09:26 AM
stanger89's Avatar
stanger89 stanger89 is offline
SageTVaholic
 
Join Date: May 2003
Location: Marion, IA
Posts: 15,188
There really isn't anything you can do to speed the video encoding process, unless you look for something like Badaboom or another that use CUDA for the video encoding. Though there's some debate that the GPU accellerated encoding is not a high quality as x264's H.264 encoding.
Reply With Quote
  #3  
Old 02-06-2011, 10:44 AM
sdsean's Avatar
sdsean sdsean is offline
Sage Expert
 
Join Date: Jul 2008
Posts: 571
yeah kinda what i figured...well if anyone knows how automatically extract the correct list of m2ts files for a main movie with some tool like handbrake that would at least save me the manual step of weeding through the playlists... right now that step is manual for me, so that i can have one big string list of the correct files to hand into eacto

besides i have an ati card anyway so CUDA is out...
__________________
AMD Ryzen 9 3900XT 12 Core+HT, 64GB DDR5, GeForce 1060, MSI Prestige x570 Creation Mobo, SIIG 4 port Serial PCIe Card, Win10, 1TB M.2 SSD OS HDD, 1 URay HDMI Network Encoder, 3 HD-PVR, 4 DirecTV STB serial tuned


Reply With Quote
  #4  
Old 02-06-2011, 10:47 AM
stanger89's Avatar
stanger89 stanger89 is offline
SageTVaholic
 
Join Date: May 2003
Location: Marion, IA
Posts: 15,188
You might want to try Staxrip, it can transcode Blu-ray directly, though I've never tried that functionality.
Reply With Quote
  #5  
Old 02-06-2011, 01:15 PM
sdsean's Avatar
sdsean sdsean is offline
Sage Expert
 
Join Date: Jul 2008
Posts: 571
Ok cool. . .i also just realized that I could use BDInfo to at least make the playlist discovery easier. . (duh don't know why I didn't think about that before).

I did try to use Handbrakes "main movie" feature, but for Blu-Rays it doesn't seem to work very well so I have to still do seperate tasks with eac and what not. . . but I'll try staxrip. . .see what I can find
__________________
AMD Ryzen 9 3900XT 12 Core+HT, 64GB DDR5, GeForce 1060, MSI Prestige x570 Creation Mobo, SIIG 4 port Serial PCIe Card, Win10, 1TB M.2 SSD OS HDD, 1 URay HDMI Network Encoder, 3 HD-PVR, 4 DirecTV STB serial tuned


Reply With Quote
  #6  
Old 02-06-2011, 01:44 PM
Fuzzy's Avatar
Fuzzy Fuzzy is offline
SageTVaholic
 
Join Date: Sep 2005
Location: Jurupa Valley, CA
Posts: 9,957
MakeMKV and TSMuser also both make the playlist slection easy, and automatically gather up just the tracks you want, and output them to single files (MKV or M2TS, respectively). Then just take that file and do whatever transcoding you want to do with it.
__________________
Buy Fuzzy a beer! (Fuzzy likes beer)

unRAID Server: i7-6700, 32GB RAM, Dual 128GB SSD cache and 13TB pool, with SageTVv9, openDCT, Logitech Media Server and Plex Media Server each in Dockers.
Sources: HRHR Prime with Charter CableCard. HDHR-US for OTA.
Primary Client: HD-300 through XBoxOne in Living Room, Samsung HLT-6189S
Other Clients: Mi Box in Master Bedroom, HD-200 in kids room
Reply With Quote
  #7  
Old 02-06-2011, 02:54 PM
sdsean's Avatar
sdsean sdsean is offline
Sage Expert
 
Join Date: Jul 2008
Posts: 571
I don't see how tsmuxer helps with figuring out which playlist/files to use, perhaps I just don't know how to use it properly? I just use it to figure out the streams inside each m2ts and what not, or to remux back. But I hate that I can't drag/drop multiple files. . .

So evidently cyberlinks media espresso is the only thing out there worth a crap that will hardware accellerate that transcoding process with ATI video cards (found that out via this: http://www.tomshardware.com/reviews/...pgpu,2335.html)

I'm testing it now, it does appear to be blindly fast. . . a 2 hour 30 minute blu-ray takes an hour too transcode using 3000kps that I use. Handbrake is taking me like 3-5 hours.

But we will see what the quality is like. . . plus media espresso costs money, and I can't output to mkv (so dumb). . .I'll let you know. . .
__________________
AMD Ryzen 9 3900XT 12 Core+HT, 64GB DDR5, GeForce 1060, MSI Prestige x570 Creation Mobo, SIIG 4 port Serial PCIe Card, Win10, 1TB M.2 SSD OS HDD, 1 URay HDMI Network Encoder, 3 HD-PVR, 4 DirecTV STB serial tuned


Reply With Quote
  #8  
Old 02-06-2011, 04:19 PM
sdsean's Avatar
sdsean sdsean is offline
Sage Expert
 
Join Date: Jul 2008
Posts: 571
well figures, i had this exact same problem with the ati avivo transcoder. . . no freaking audio. its like it can't handle dts hd or something. . . in media espresso there the audio settings are a bit weird, i can only select dolby digital or LPCM .. . not sure which would apply since i usually use ac3. Also, it seems that it letterboxed the output eventhough the original was not. . . grr. . .
__________________
AMD Ryzen 9 3900XT 12 Core+HT, 64GB DDR5, GeForce 1060, MSI Prestige x570 Creation Mobo, SIIG 4 port Serial PCIe Card, Win10, 1TB M.2 SSD OS HDD, 1 URay HDMI Network Encoder, 3 HD-PVR, 4 DirecTV STB serial tuned


Reply With Quote
  #9  
Old 02-06-2011, 09:05 PM
Taddeusz Taddeusz is offline
SageTVaholic
 
Join Date: Nov 2004
Location: Yukon, OK
Posts: 3,919
If you run eac3to from the bdmv/playlist folder and use the mpls file for the main movie it will automatically stitch all the m2ts files together for you. I'm sure there is a more automated program but I haven't found a better conversion program than MeGUI as far as quality is concerned so I still use eac3to to demux the main movie for transcoding.
__________________
Server: i5 8400, ASUS Prime H370M-Plus/CSM, 16GB RAM, 15TB drive array + 500GB cache, 2 HDHR's, SageTV 9, unRAID 6.6.3
Client 1: HD300 (latest FW), HDMI to an Insignia 65" 1080p LCD and optical SPDIF to a Sony Receiver
Client 2: HD200 (latest FW), HDMI to an Insignia NS-LCD42HD-09 1080p LCD
Reply With Quote
  #10  
Old 02-06-2011, 10:29 PM
sdsean's Avatar
sdsean sdsean is offline
Sage Expert
 
Join Date: Jul 2008
Posts: 571
Oh sweet! I didn't know it would parse out the playlist auto-magically!! Nice! Now at least my steps are compressed a bit. Look up running time of movie, find correct playlist using BDInfo, use eactools to create h264/vc1 and dts files, then handbrake to transcode (which is still too slow but at least it works). Cool!! thanks for that.
__________________
AMD Ryzen 9 3900XT 12 Core+HT, 64GB DDR5, GeForce 1060, MSI Prestige x570 Creation Mobo, SIIG 4 port Serial PCIe Card, Win10, 1TB M.2 SSD OS HDD, 1 URay HDMI Network Encoder, 3 HD-PVR, 4 DirecTV STB serial tuned


Reply With Quote
  #11  
Old 02-07-2011, 08:06 AM
razrsharpe razrsharpe is offline
Sage Icon
 
Join Date: Sep 2008
Location: Boston, MA
Posts: 2,111
or use dvdfab, do a main movie copy, pick the right playlist, (usually (always) self evident by comparing the chapters, length, and main audio track... no need for bdinfo), check the convert hd audio box, let it go. Will end up with 1 m2ts file (even if original playlist was not) that you can feed into handbrake to do the conversion.

I'm also reasonably confident that tsmuxer will do the same thing because i used to use that with anydvd hd to remove the encryption

EDIT: it also looks like dvdfab makes a all in one program that will transcode the movie to other formats... and it uses cuda technology. I haven't used any of there transcoding tools so cant speak to their quality but it might be worth checking out too...
__________________
Server 2003 r2 32bit, SageTV9 (finally!)
2x Dual HDHR (OTA), 1x HD-PVR (Comcast), 1x HDHR-3CC via SageDCT (Comcast)
2x HD300, 1x SageClient (Win10 Test/Development)
Check out TVExplorer

Last edited by razrsharpe; 02-07-2011 at 08:28 AM.
Reply With Quote
  #12  
Old 02-09-2011, 10:54 PM
sdsean's Avatar
sdsean sdsean is offline
Sage Expert
 
Join Date: Jul 2008
Posts: 571
i guess i need to mess around more with tsmuxer. . i have only used to to re-mux stuff back together. . .

I've been just using BDInfo to figure out which playlist. . . perhaps I'm missing something but I don't see how tsmuxer can do this, and I don't see how its very "self-evident".

I say this b/c I'm not playing the movie 1st. . . I'm just looking at the playlists raw.
Before I used to go and actually read them myself. . .but with BD Info that's a lot easier
But even then. . .often times there are multiple versions of a "main movie" playlist with added crap like menus, previews and the like. . . so BDInfo with the running time info in hand seems like the best option too me. . .
__________________
AMD Ryzen 9 3900XT 12 Core+HT, 64GB DDR5, GeForce 1060, MSI Prestige x570 Creation Mobo, SIIG 4 port Serial PCIe Card, Win10, 1TB M.2 SSD OS HDD, 1 URay HDMI Network Encoder, 3 HD-PVR, 4 DirecTV STB serial tuned


Reply With Quote
  #13  
Old 02-09-2011, 10:56 PM
sdsean's Avatar
sdsean sdsean is offline
Sage Expert
 
Join Date: Jul 2008
Posts: 571
Still sux that I have to use Handbrake though. . .but it does seem to do the best job, just slowly. . .but hey its free so I guess i can't complain too much. . .

Cyberlink's crapware did the exact same thing ATI's AVIO transcoder did. . .no sound (doesn't seem to handle DTS-HD properly)

All the other ones use CUDA, which won't really help me since i'm using an ATI video card.
__________________
AMD Ryzen 9 3900XT 12 Core+HT, 64GB DDR5, GeForce 1060, MSI Prestige x570 Creation Mobo, SIIG 4 port Serial PCIe Card, Win10, 1TB M.2 SSD OS HDD, 1 URay HDMI Network Encoder, 3 HD-PVR, 4 DirecTV STB serial tuned


Reply With Quote
  #14  
Old 02-10-2011, 06:49 AM
stanger89's Avatar
stanger89 stanger89 is offline
SageTVaholic
 
Join Date: May 2003
Location: Marion, IA
Posts: 15,188
I think in TSmuxer you open the playlist, rather than the individual files, but it's been a while since I mucked with it directly.

Of course the easiest way to make it go faster is to not waste your time making the quality worse
Reply With Quote
  #15  
Old 02-10-2011, 12:12 PM
sdsean's Avatar
sdsean sdsean is offline
Sage Expert
 
Join Date: Jul 2008
Posts: 571
LOL i know, but i'm saving hdd space as well. . .i really could care less about true HD 1080p res. . .

interesting about tsmuxer, but again you still have to know what playlist to select, which bdinfo seems to be the only tool capable of helping with that other than just reading them raw myself.
__________________
AMD Ryzen 9 3900XT 12 Core+HT, 64GB DDR5, GeForce 1060, MSI Prestige x570 Creation Mobo, SIIG 4 port Serial PCIe Card, Win10, 1TB M.2 SSD OS HDD, 1 URay HDMI Network Encoder, 3 HD-PVR, 4 DirecTV STB serial tuned


Reply With Quote
  #16  
Old 02-10-2011, 03:33 PM
Fuzzy's Avatar
Fuzzy Fuzzy is offline
SageTVaholic
 
Join Date: Sep 2005
Location: Jurupa Valley, CA
Posts: 9,957
hard drives are so cheap, you can backup your blurays for $1.44 a piece (45GB on a $65 2TB drive), and that's keeping all menus/special features, etc. It's just not worth the time mucking with transcoding. The most I would do, is if the movie had no features i wanted, I'd rip down to the main movie and single audio track with MakeMKV, but I certainly don't see the need to transcode to anything else, unless I'm going to a mobile device.
__________________
Buy Fuzzy a beer! (Fuzzy likes beer)

unRAID Server: i7-6700, 32GB RAM, Dual 128GB SSD cache and 13TB pool, with SageTVv9, openDCT, Logitech Media Server and Plex Media Server each in Dockers.
Sources: HRHR Prime with Charter CableCard. HDHR-US for OTA.
Primary Client: HD-300 through XBoxOne in Living Room, Samsung HLT-6189S
Other Clients: Mi Box in Master Bedroom, HD-200 in kids room
Reply With Quote
  #17  
Old 02-11-2011, 04:59 PM
RocKKer RocKKer is offline
Sage Advanced User
 
Join Date: Dec 2005
Posts: 196
BD-Rebuilder makes it easy to pick a playlist, supports batch encoding, and converts to ac3 all in one step. I rip multiple movies and set em up to encode in batch mode and go to sleep. You can throw all 8 cores at them at night.

The encode can take as long as other encoding tools, it uses tsmuxer, H264, etc. with custom code wrapped around - it's a single process from the user perspective.

I have also experimented using the automatic encoding mode where it picks the encoding method and can use a single pass to encode, which is faster and gives me an "I can't the difference" result.

It also outputs to MKV, I encode to BRD so I haven't used this feature.
__________________
SageTV Server v9.2.2, Ubuntu Server 18.04.4 x64, Java 1.8.0_252, Xeon E5-2690, 32GB, 6X6TB WD Red - Software Raid 6, 2X HDHR3 (OTA), 3X HD-200
Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Video Transcoding goatboy22382 SageMC Custom Interface 6 11-17-2008 05:12 PM
Zune - transcoding video Wade SageTV Beta Test Software 10 03-05-2007 10:25 AM
Transcoding DVD's: Enlarged Video?? JUC SageTV Media Extender 18 07-12-2006 02:33 PM
Details on v5 FidgetyRat SageTV Software 1 04-28-2006 10:58 AM


All times are GMT -6. The time now is 06:58 AM.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2023, vBulletin Solutions Inc.
Copyright 2003-2005 SageTV, LLC. All rights reserved.