SageTV Community  

Go Back   SageTV Community > SageTV Development and Customizations > SageTV v7 Customizations > Batch Metadata Tools
Forum Rules FAQs Community Downloads Today's Posts Search

Notices

Batch Metadata Tools This forums is for discussing the user-created Batch Metadata Tools for SageTV.

Reply
 
Thread Tools Search this Thread Display Modes
  #1241  
Old 07-08-2009, 03:42 PM
ccourtney ccourtney is offline
Sage User
 
Join Date: Mar 2008
Posts: 27
Ok. I think I've isolated the problem. I got both of the movies I was having problems with to successfully process by renaming them so they get a proper hit from themoviedb.org. This meant renaming "National Lampoon's Vacation" to "Vacation" and "Star Wars I The Phantom Menace" to "Star Wars Episode I The Phantom Menace".

This indicates it may be a lack of suitable hits from themoviedb.org lookup that is causing the null pointer exception.

I also noticed that the DVDProfiler local index is not properly indexing the Original Title either.
__________________
Server - WHS, AMD X2 4850e, 3TB, 2 HD-PVRs w/ D11 DirecTV STBs
Client 1 - HD200
Client 2 - XP Home, AMD X2 5200+ w/ 8400GS
Client 3 - XP Pro, AMD X2 3800+ w/ 8400GS
Reply With Quote
  #1242  
Old 07-08-2009, 04:24 PM
rmac321 rmac321 is offline
Sage Advanced User
 
Join Date: Dec 2008
Posts: 194
Quote:
Originally Posted by stuckless View Post
I have had this happen to me... Normally I restart the SageTV server and all is well again. When it was happening to me, I noticed that my SageTV JVM memory size was set to 256mb, which is not enough if bmt is going to be running as well.
I'm having a variation on the problem you guys are describing. I haven't done enough testing to give complete info, but just in case any of this is helpful, here is what I've seen so far. To be sure, this is not a request for help, so please don't feel like you have to waste time helping me sort this out. I offer it as a data point in case it helps you figure out what's happening on your systems.

On mine, only the middle column (Metadata Tools) errors out. It happened with version 3 beta 3, so I updated to beta 4 before any more testing. After the update to beta 4, the status appeared normal. I then initiated a scan from SageMC. When the scan was done, I clicked on status so it would update and that is when my middle column errored out. I tried restarting the sage service (not the server) but that didn't help.

I decided to check out the backup/testing server which never had version 2 on it. The only BMT install on that server was 3 beta 3. After enabling the service, I was able to bring up the status page. I ran a scan via SageMC which took way too little time. After the scan I clicked status to update and lo and behold the center column errored out. I updated to beta 4 and the UI status page appeared normal. I started a scan which this time took much longer. After the scan was done I clicked on status and all 3 columns updated, but the Metadata Tools column still indicated that I had not done a scan since 1969. Now as I type this I just checked the status and it has now errored out the center column again. Restarting the Sage Service does not restore the center column.

edit:
Since disabling and re-enabling the Sage service one more time on the backup server, I can't seem to kill the UI now. I've initiated library scans from the UI, from the HD200 extender, from a client session on the server and from the MVP, and the UI always displays a good 3 column status screen now. I have no clue what has changed except for the disable and re-enable. I'll switch back to the main server later and see if I can repeat this. more to come...
(end update)

I haven't spent enough time looking at the logs to understand much of what the logs are telling me. If you guys want to point me to a specific type of entry in a log, I'll go take a peek. If you want to see my logs for yourselves, let me know which one(s).

Here's my info:
Code:
What bmt version? 3.0 beta 3 & 4
What SageTV version? 6.5.18.214
SageMC or default STV?  SageMC
SageMC version? 6.3.9a_46
Java version? 1.6_11
Phoenix version? 1.33
Java Heap Sizes   127MB/258MB/533MB

SageTV setup:
Is central FanArt folder enabled? yes
Is central FanArt folder local or a network share?  network share
Do you have SageTV set up to do automatic scans? yes
If yes, how often? 2 hours
Do the scans import new videos?  yes

BMT setup:
Command Line Tool:
Have you successfully used the command line tool?  No, I already use MediaScraper so I haven't tried it yet.

On-demand Tool:
Have you imported the on-demand plugin (stvi of xml)? yes, xml
Do you have the on-demand plug-in enabled? yes (also tried disabling)
Does the on-demand tool work properly?  Yes

Automatic Tool:
Do you have these 2 properties set in sage.properties?  yes
  mediafile_metadata_parser_plugins=org.jdna.sage.MetadataUpdaterPlugin
  custom_metadata_properties=UserRating;EpisodeNumber;EpisodeTitle;MediaTitle;MediaType;OriginalAirDate;SeasonNumber;MediaProviderDataID;DiscNumber
Does the automatic Tool work properly?  As near as I can tell it doesn't do anything.  No properties files are being created and no additional fanart is appearing anywhere.  I use MediaScraper to put everything in its proper place and properly name all my files.  I have MediaScraper setup to NOT create properties files.  This allows me to monitor BMT to see if it has created a properties file for any given media file.
__________________
SageTV v9.1.10.479 on Ubuntu
(testing v9.1.10.479 on Debian and Win10)

Last edited by rmac321; 07-08-2009 at 06:26 PM. Reason: added symptoms
Reply With Quote
  #1243  
Old 07-08-2009, 04:56 PM
rmac321 rmac321 is offline
Sage Advanced User
 
Join Date: Dec 2008
Posts: 194
I added more items in bold. You are of course welcome to add or delete as you see fit. Do I have the log info correct?

Code:
What bmt version 2.x (stable) or 3.x (beta)?
What SageTV version?
SageMC or default STV?
SageMC version?
Java version?
Phoenix version?
Java heap sizes?  (xxxMB/xxxMb/xxxMB)

SageTV setup:
Is central FanArt folder enabled?
Is central FanArt folder local or a network share?
Do you have SageTV set up to do automatic scans?
If yes, how often?
Do the scans import new videos?
Is SageTV debug logging enabled?

Command Line Tool:
Have you successfully used the command line tool?
Do you use the Command Line Tool from a batch file?
Do you Drag and Drop onto the .exe or a shortcut to the .exe?
Do you use all the defaults or have you made changes?
Describe your modifications:

On-demand Tool:
Have you imported the On-Demand plugin (stvi of xml)?
Do you have the On-Demand plug-in enabled?
Is On-Demand Tool working properly?
Do you use the default setup, or have you modified the settings?
Describe your modifications:  

Automatic tool:
Do you have these 2 properties set in sage.properties?
  mediafile_metadata_parser_plugins=org.jdna.sage.MetadataUpdaterPlugin
  custom_metadata_properties=UserRating;EpisodeNumber;EpisodeTitle;MediaTitle;MediaType;OriginalAirDate;SeasonNumber;MediaProviderDataID;DiscNumber
Is the Automatic Tool working properly?
Do you use the default settings or have you made modifications?
Describe your modifications:

I have attached my Sage log (sagetv_0.txt) enclosed in a code box.
I have attached my BMT log (mailcheck.log) enclosed in a code box.

Please give a description of the steps to reproduce your issue:
[/QUOTE]
__________________
SageTV v9.1.10.479 on Ubuntu
(testing v9.1.10.479 on Debian and Win10)
Reply With Quote
  #1244  
Old 07-08-2009, 06:34 PM
robogeek robogeek is offline
Sage Expert
 
Join Date: Apr 2003
Location: Appleton, WI USA
Posts: 568
Quote:
Originally Posted by rmac321 View Post
I'm having a variation on the problem you guys are describing. I haven't done enough testing to give complete info, but just in case any of this is helpful, here is what I've seen so far. To be sure, this is not a request for help, so please don't feel like you have to waste time helping me sort this out. I offer it as a data point in case it helps you figure out what's happening on your systems.

On mine, only the middle column (Metadata Tools) errors out. It happened with version 3 beta 3, so I updated to beta 4 before any more testing. After the update to beta 4, the status appeared normal. I then initiated a scan from SageMC. When the scan was done, I clicked on status so it would update and that is when my middle column errored out. I tried restarting the sage service (not the server) but that didn't help.

I decided to check out the backup/testing server which never had version 2 on it. The only BMT install on that server was 3 beta 3. After enabling the service, I was able to bring up the status page. I ran a scan via SageMC which took way too little time. After the scan I clicked status to update and lo and behold the center column errored out. I updated to beta 4 and the UI status page appeared normal. I started a scan which this time took much longer. After the scan was done I clicked on status and all 3 columns updated, but the Metadata Tools column still indicated that I had not done a scan since 1969. Now as I type this I just checked the status and it has now errored out the center column again. Restarting the Sage Service does not restore the center column.

I don't think this is a jetty issue or I suspect it would be all or nothing.

I haven't spent enough time looking at the logs to understand much of what the logs are telling me. If you guys want to point me to a specific type of entry in a log, I'll go take a peek. If you want to see my logs for yourselves, let me know which one(s).

Here's my info:
Code:
What bmt version? 3.0 beta 3 & 4
What SageTV version? 6.5.18.214
SageMC or default STV?  SageMC
SageMC version? 6.3.9a_46
Java version? 1.6_11
Phoenix version? 1.33
Java Heap Sizes   127MB/258MB/533MB

SageTV setup:
Is central FanArt folder enabled? yes
Is central FanArt folder local or a network share?  network share
Do you have SageTV set up to do automatic scans? yes
If yes, how often? 2 hours
Do the scans import new videos?  yes

BMT setup:
Command Line Tool:
Have you successfully used the command line tool?  No, I already use MediaScraper so I haven't tried it yet.

On-demand Tool:
Have you imported the on-demand plugin (stvi of xml)? yes, xml
Do you have the on-demand plug-in enabled? yes (also tried disabling)
Does the on-demand tool work properly?  Yes

Automatic Tool:
Do you have these 2 properties set in sage.properties?  yes
  mediafile_metadata_parser_plugins=org.jdna.sage.MetadataUpdaterPlugin
  custom_metadata_properties=UserRating;EpisodeNumber;EpisodeTitle;MediaTitle;MediaType;OriginalAirDate;SeasonNumber;MediaProviderDataID;DiscNumber
Does the automatic Tool work properly?  As near as I can tell it doesn't do anything.  No properties files are being created and no additional fanart is appearing anywhere.  I use MediaScraper to put everything in its proper place and properly name all my files.  I have MediaScraper setup to NOT create properties files.  This allows me to monitor BMT to see if it has created a properties file for any given media file.
I am also experiencing the "Failed to get status for: Metadata Tools" error now. I have a nearly identical setup to rmac321...main differences being that I'm running Java 6 update 13 and my max Java heap size is set to 768MB. The BMT automatic stuff was working great with BMT 3.0 beta 4 until I did a full library rescan...Detailed Setup->Advanced->Rescan Existing Library Files->Rescan Now. Now the middle column of the BMT jetty page errors out with the failed to get status message. It appears that the automatic stuff is now broken, but in the SageMC UI Video menu I can still use Edit Video Info to have BMT get Metadata/Fanart and then initiate a library rescan from the Video menu to get SageTV to import the metadata. A restart of the SageTV Service also did not clear up the error for me. Just prior to the full library rescan, I did update Nielm's IMDB .jar file and restarted SageTV...not sure if that did something or not.

The only thing I can add is the snippet from the SageTV debug log that shows the related jetty BMT error:

Code:
Wed 7/8 19:02:25.443 (org.mortbay.log) <DEBUG> REQUEST /bmt/bmtweb/status on org.mortbay.jetty.HttpConnection@102ab48
Wed 7/8 19:02:25.444 (org.mortbay.log) <DEBUG> sessionManager=org.mortbay.jetty.servlet.HashSessionManager@c93509
Wed 7/8 19:02:25.444 (org.mortbay.log) <DEBUG> session=null
Wed 7/8 19:02:25.444 (org.mortbay.log) <DEBUG> servlet=status
Wed 7/8 19:02:25.444 (org.mortbay.log) <DEBUG> chain=null
Wed 7/8 19:02:25.444 (org.mortbay.log) <DEBUG> servlet holder=status
Wed 7/8 19:02:25.445 (org.mortbay.log) <DEBUG> REQUEST /bmt/bmtweb/status on org.mortbay.jetty.HttpConnection@d5cfd6
Wed 7/8 19:02:25.446 (org.mortbay.log) <DEBUG> sessionManager=org.mortbay.jetty.servlet.HashSessionManager@c93509
Wed 7/8 19:02:25.446 (org.mortbay.log) <DEBUG> session=null
Wed 7/8 19:02:25.446 (org.mortbay.log) <DEBUG> servlet=status
Wed 7/8 19:02:25.446 (org.mortbay.log) <DEBUG> RESPONSE /bmt/bmtweb/status  200
Wed 7/8 19:02:25.446 (org.mortbay.log) <DEBUG> chain=null
Wed 7/8 19:02:25.446 (org.mortbay.log) <DEBUG> servlet holder=status
Wed 7/8 19:02:25.446 Status Failed!
Wed 7/8 19:02:25.448 (/bmt) <ERROR> Exception while dispatching incoming RPC call
Wed 7/8 19:02:25.448 com.google.gwt.user.server.rpc.UnexpectedException: Service method 'public abstract java.util.List org.jdna.bmt.web.client.ui.status.StatusServices.getStatusInfo(java.lang.String)' threw an unexpected exception: java.lang.NoClassDefFoundError: Could not initialize class com.google.gwt.user.client.Window
Wed 7/8 19:02:25.448 	at com.google.gwt.user.server.rpc.RPC.encodeResponseForFailure(RPC.java:360)
Wed 7/8 19:02:25.448 	at com.google.gwt.user.server.rpc.RPC.invokeAndEncodeResponse(RPC.java:546)
Wed 7/8 19:02:25.448 	at com.google.gwt.user.server.rpc.RemoteServiceServlet.processCall(RemoteServiceServlet.java:166)
Wed 7/8 19:02:25.448 	at com.google.gwt.user.server.rpc.RemoteServiceServlet.doPost(RemoteServiceServlet.java:86)
Wed 7/8 19:02:25.448 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
Wed 7/8 19:02:25.448 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
Wed 7/8 19:02:25.449 	at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:487)
Wed 7/8 19:02:25.449 	at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:362)
Wed 7/8 19:02:25.449 	at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
Wed 7/8 19:02:25.449 	at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:181)
Wed 7/8 19:02:25.449 	at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:729)
Wed 7/8 19:02:25.449 	at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:405)
Wed 7/8 19:02:25.449 	at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:206)
Wed 7/8 19:02:25.449 	at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
Wed 7/8 19:02:25.449 	at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
Wed 7/8 19:02:25.449 	at org.mortbay.jetty.Server.handle(Server.java:320)
Wed 7/8 19:02:25.450 	at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:505)
Wed 7/8 19:02:25.450 	at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:843)
Wed 7/8 19:02:25.450 	at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:647)
Wed 7/8 19:02:25.450 	at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:211)
Wed 7/8 19:02:25.450 	at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:380)
Wed 7/8 19:02:25.450 	at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:395)
Wed 7/8 19:02:25.450 	at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:488)
Wed 7/8 19:02:25.450 Caused by: java.lang.NoClassDefFoundError: Could not initialize class com.google.gwt.user.client.Window
Wed 7/8 19:02:25.450 	at org.jdna.bmt.web.client.util.Log.error(Log.java:15)
Wed 7/8 19:02:25.450 	at org.jdna.bmt.web.server.StatusServicesImpl.getStatusInfo(StatusServicesImpl.java:97)
Wed 7/8 19:02:25.451 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Wed 7/8 19:02:25.451 	at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
Wed 7/8 19:02:25.451 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
Wed 7/8 19:02:25.451 	at java.lang.reflect.Method.invoke(Unknown Source)
Wed 7/8 19:02:25.451 	at com.google.gwt.user.server.rpc.RPC.invokeAndEncodeResponse(RPC.java:527)
Wed 7/8 19:02:25.451 	... 21 more
Wed 7/8 19:02:25.451 (org.mortbay.log) <DEBUG> RESPONSE /bmt/bmtweb/status  500
Wed 7/8 19:02:25.456 (org.mortbay.log) <DEBUG> REQUEST /bmt/bmtweb/status on org.mortbay.jetty.HttpConnection@102ab48
Wed 7/8 19:02:25.456 (org.mortbay.log) <DEBUG> sessionManager=org.mortbay.jetty.servlet.HashSessionManager@c93509
Wed 7/8 19:02:25.456 (org.mortbay.log) <DEBUG> session=null
Wed 7/8 19:02:25.456 (org.mortbay.log) <DEBUG> servlet=status
Wed 7/8 19:02:25.456 (org.mortbay.log) <DEBUG> chain=null
Wed 7/8 19:02:25.456 (org.mortbay.log) <DEBUG> servlet holder=status
Wed 7/8 19:02:25.612 (org.mortbay.log) <DEBUG> RESPONSE /bmt/bmtweb/status  200
__________________
--Jason

Server Hardware: GIGABYTE GA-EP45-UD3R, Intel Q9550 CPU 2.83GHz, 11GB RAM, 1xHDHR, 1xHVR1600, 1xHVR2250
29TB Server Storage: 1TB SSD (OS), 1TB (data), 2x6TB+2x10TB (22TB FlexRaid storage pool), 2x2TB (recordings), 1x750GB (VMs).
Server Software: Win10 Pro x64 OS, SageTV 64bit v9.2.0.441, Java 1.8 u241, PlayOn, Comskip (Donator) v0.82.003, WampServer v2.5.
Clients: 3xHD300s, 2xHD100, 2xPlaceshifters
Reply With Quote
  #1245  
Old 07-08-2009, 07:09 PM
rmac321 rmac321 is offline
Sage Advanced User
 
Join Date: Dec 2008
Posts: 194
Quote:
Originally Posted by robogeek View Post
I am also experiencing the "Failed to get status for: Metadata Tools" error now. I have a nearly identical setup to rmac321...main differences being that I'm running Java 6 update 13 and my max Java heap size is set to 768MB. The BMT automatic stuff was working great with BMT 3.0 beta 4 until I did a full library rescan...Detailed Setup->Advanced->Rescan Existing Library Files->Rescan Now. Now the middle column of the BMT jetty page errors out with the failed to get status message. It appears that the automatic stuff is now broken, but in the SageMC UI Video menu I can still use Edit Video Info to have BMT get Metadata/Fanart and then initiate a library rescan from the Video menu to get SageTV to import the metadata. A restart of the SageTV Service also did not clear up the error for me. Just prior to the full library rescan, I did update Nielm's IMDB .jar file and restarted SageTV...not sure if that did something or not.
Just for kicks, try disabling and re-enabling the Sage Service to see if that makes a difference. I just edited my post and added that after disabling and re-enabling, I can't get it to error out now.
__________________
SageTV v9.1.10.479 on Ubuntu
(testing v9.1.10.479 on Debian and Win10)
Reply With Quote
  #1246  
Old 07-08-2009, 08:49 PM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
 
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
ccourtney, rmac321, robogeek, thanks for the great info.

robogeek, based the exception that you posted, I was able to track down an issue. I've uploaded a beta6 that captures the root issue and logs it. So while I can't actually fix the issue yet, the next time it happens, I should have a better idea as to why it is happening.
Reply With Quote
  #1247  
Old 07-08-2009, 09:09 PM
rmac321 rmac321 is offline
Sage Advanced User
 
Join Date: Dec 2008
Posts: 194
Ignore These Folders

Sean,

What's the expected format for the "Ignore These Folders" field? \\server\folder, //server/folder, "\\server\folder", \\\\server\\folder, or something else?

How should each entry be seperated? commas, semicolons, other?

I note a few errors in my logs from that field.

Thanks
__________________
SageTV v9.1.10.479 on Ubuntu
(testing v9.1.10.479 on Debian and Win10)
Reply With Quote
  #1248  
Old 07-08-2009, 09:45 PM
Ender Ender is offline
Sage Advanced User
 
Join Date: Sep 2007
Location: Upsate New York
Posts: 175
Quote:
Originally Posted by rsagetv99 View Post

Another symptom is that when I go to http://<servername>:<port>/bmt, the default page is not loaded. Instead, I am presented with links to the contents of the /bmt folder (instead of launching the default page), and I have to manually choose BMTWeb.html. Once I do, it goes to the page, but then gives me the status errors.
The following fixed it for me:
Originally Posted by stuckless View Post
I think that there is a bug in my jetty context file (jetty/contexts/bmt.xml). Edit the file and look for these lines and make sure both are set to true.

Code:

<Set name="extractWAR">true</Set>
<Set name="copyWebDir">true</Set>

Then in the jetty/webapps/ dir delete the bmt dir and restart sage server. That should extract the web application properly. Don't delete the bmt.war, just the bmt dir.
Reply With Quote
  #1249  
Old 07-08-2009, 09:57 PM
robogeek robogeek is offline
Sage Expert
 
Join Date: Apr 2003
Location: Appleton, WI USA
Posts: 568
Quote:
Originally Posted by stuckless View Post
ccourtney, rmac321, robogeek, thanks for the great info.

robogeek, based the exception that you posted, I was able to track down an issue. I've uploaded a beta6 that captures the root issue and logs it. So while I can't actually fix the issue yet, the next time it happens, I should have a better idea as to why it is happening.
Thanks Sean. I'll install it and give it a whirl tomorrow afternoon.
__________________
--Jason

Server Hardware: GIGABYTE GA-EP45-UD3R, Intel Q9550 CPU 2.83GHz, 11GB RAM, 1xHDHR, 1xHVR1600, 1xHVR2250
29TB Server Storage: 1TB SSD (OS), 1TB (data), 2x6TB+2x10TB (22TB FlexRaid storage pool), 2x2TB (recordings), 1x750GB (VMs).
Server Software: Win10 Pro x64 OS, SageTV 64bit v9.2.0.441, Java 1.8 u241, PlayOn, Comskip (Donator) v0.82.003, WampServer v2.5.
Clients: 3xHD300s, 2xHD100, 2xPlaceshifters
Reply With Quote
  #1250  
Old 07-09-2009, 07:53 AM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
 
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
Quote:
Originally Posted by rmac321 View Post
Sean,

What's the expected format for the "Ignore These Folders" field? \\server\folder, //server/folder, "\\server\folder", \\\\server\\folder, or something else?

How should each entry be seperated? commas, semicolons, other?

I note a few errors in my logs from that field.

Thanks
That field is a regular expression. So if you want to ignore a "Test" folder and a "Dummy" folder, you could enter just...
Code:
Test|Dummy
What the code does is look at the complete path and do a contains match (sort of). So, the above express would match on...
Code:
\\server\Test
\\server\somedir\Test
\\server\MyTestFolder
If you want to be more explicit in your matching, then you can enter the full path, but ALL bmt paths (with the exception of fanart folder) is URI based, so you can enter...
Code:
//server/Test|//server/Dummy
The pipe (|) is an "or"

EDIT: I'll have to verify that this is still used in 3.x... I may not be implemented yet. But it is implemented in the 2.x builds

Last edited by stuckless; 07-09-2009 at 07:56 AM.
Reply With Quote
  #1251  
Old 07-09-2009, 02:57 PM
rsagetv99's Avatar
rsagetv99 rsagetv99 is offline
Sage Fanatic
 
Join Date: Nov 2004
Posts: 766
Not sure about everyone else, but my problems were resolved with beta6.

Thanks Sean!!
Reply With Quote
  #1252  
Old 07-09-2009, 05:26 PM
bluenote bluenote is offline
Sage Aficionado
 
Join Date: Nov 2004
Location: Vancouver, canada
Posts: 336
I can't seem to figure out, between reading the documentation, and the install instructions, whether I do, indeed, need Jetty. The last time I installed this it was , I believe, just an import of the stvi (even though Im running sagemc?). But this was before it could handle metadata through the gui. (So I know there is some STV integration... which begs the question.. why would I need jetty)

Can someone clarify for me?

thanks

Cory
Reply With Quote
  #1253  
Old 07-09-2009, 06:00 PM
babgvant babgvant is offline
Sage Icon
 
Join Date: Jul 2008
Location: London
Posts: 1,834
Quote:
Originally Posted by cnovak View Post
I can't seem to figure out, between reading the documentation, and the install instructions, whether I do, indeed, need Jetty. The last time I installed this it was , I believe, just an import of the stvi (even though Im running sagemc?). But this was before it could handle metadata through the gui. (So I know there is some STV integration... which begs the question.. why would I need jetty)

Can someone clarify for me?

thanks

Cory
Jetty is not essential, but highly recommended. It surfaces the settings in a GUI and makes sure they get written to the correct place.
__________________
babgvant.com | @babgvant | Missing Remote
Reply With Quote
  #1254  
Old 07-09-2009, 10:41 PM
sflamm sflamm is offline
Sage Icon
 
Join Date: Mar 2009
Posts: 1,653
Sean,

There are several DVDProfiler fields being used by SageTV users that you should take into account:

1. DVD Title - this is the title displayed under the Videos Library. The name is also often the name of the folder the movie is stored under (but it doesnt have to be stored under this - see #2)

2. Original Title - this is not used for display. It can be used as the name of the folder storing the movie -- this allows the folder name to be different from the DVD Title (often used to make sure folder names do not have special characters in them, which the title can)

3. Discs - this is used to store box sets in directories. i.e. "Lord of the Rings Fellowship of the Ring - Disc 1"

in the collections.xml look for the xml format:

<DVD>
<Title>Lord of the Rings Fellowship of the Ring</Title>
<Discs>
<Disc>
<DescriptionSideA>Disc 1</DescriptionSideA>
<DescriptionSideB/>
...
</Disc>
<Disc>
<DescriptionSideA>Disc 2</DescriptionSideA>
<DescriptionSideB/>
...
</Disc>
</Discs>


This indicates that the movie is stored on 2 discs under a directory called "Lord of the Rings Fellowship of the Ring". The subdirectories are called "Lord of the Rings Fellowship of the Ring - Disc 1" and "Lord of the Rings Fellowship of the Ring - Disc 2" respectively.

You will need to know these titles to match box sets and to write the meta data so that SageTV will display the box sets correctly --> the meta data title needs to be "Lord of the Rings Fellowship of the Ring - Disc 1" and "Lord of the Rings Fellowship of the Ring - Disc 2" respectively. With the DVDPro2Sage plugin installed these show up correctly as box sets in SageTV.

Let me know if you have any questions -- I hope my explanation is somewhat clear)
Reply With Quote
  #1255  
Old 07-10-2009, 01:50 PM
rsagetv99's Avatar
rsagetv99 rsagetv99 is offline
Sage Fanatic
 
Join Date: Nov 2004
Posts: 766
Quote:
Originally Posted by stuckless View Post
The success rate will only be as good as the filenames. So, if the movies are "FindingNemo-SomeTorrent-SomeData.avi" then it probably won't work. But if the movie is, "Finding Nemo.avi", then it probably will work. If you can post some of your filenames, then I can see if then I can test the movie filename myself and see what i come up with.
I have a question. Is there a way to force the tool to use the Title of a movie in Sage, rather than the filename to search?

Maybe something like:
If ${filename} search returns null
search based on ${title}
Fancy coding right?

But you get the idea...

Maybe it does this already, but I am thinking it doesn't, since movies that I recorded in Sage are not matching anything, but when I use SageMC's IMDB lookup, they match 95% of the time.
Reply With Quote
  #1256  
Old 07-10-2009, 03:39 PM
robogeek robogeek is offline
Sage Expert
 
Join Date: Apr 2003
Location: Appleton, WI USA
Posts: 568
Quote:
Originally Posted by robogeek View Post
Thanks Sean. I'll install it and give it a whirl tomorrow afternoon.
I installed the latest beta yesterday. I tried and tried, but I can't get the jetty status page to fail out again like it did before. I'm still rearranging my DVDs, imported movies, and recordings and updating metadata and fanart. So if the jetty status page gives any failures, I'll report them here.
__________________
--Jason

Server Hardware: GIGABYTE GA-EP45-UD3R, Intel Q9550 CPU 2.83GHz, 11GB RAM, 1xHDHR, 1xHVR1600, 1xHVR2250
29TB Server Storage: 1TB SSD (OS), 1TB (data), 2x6TB+2x10TB (22TB FlexRaid storage pool), 2x2TB (recordings), 1x750GB (VMs).
Server Software: Win10 Pro x64 OS, SageTV 64bit v9.2.0.441, Java 1.8 u241, PlayOn, Comskip (Donator) v0.82.003, WampServer v2.5.
Clients: 3xHD300s, 2xHD100, 2xPlaceshifters
Reply With Quote
  #1257  
Old 07-10-2009, 05:27 PM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
 
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
@sflamm - Thanks for the DVDprofiler info. I am actually considering just using the DVDProf2Sage class, and skip the index/search model that bmt uses, since for BMT, it would appear that everying will be an exact match anyways. I just have to see if DVDProf2Sage supports accepting a File or Uri for the video file.

Quote:
Maybe it does this already, but I am thinking it doesn't, since movies that I recorded in Sage are not matching anything, but when I use SageMC's IMDB lookup, they match 95% of the time.
It actually uses the Title now. The problem is that bmt doesn't know that a recorded movie is a "movie" and it treats it as a recorded TV show. As a result when bmt does the lookup, only tvdb handles the query, since that is the only provider that can handle tv. BMT doesn't bother passing it to imdb or tvdb, since those providers don't handle tv.

I made a recent change in the phoenix api to set the media type of Movie for recorded movies. This was done so that fanart could be assigned correctly to recorded movies. I need to pull that logic into the core bmt search factory as well.

@robogeek - glad it's working
Reply With Quote
  #1258  
Old 07-10-2009, 07:48 PM
bluenote bluenote is offline
Sage Aficionado
 
Join Date: Nov 2004
Location: Vancouver, canada
Posts: 336
I've installed this following the instructions as closely as I could,
and, while I've used the command line tool for a long tiem successfully, I'm not getting anything out of trying to use it in 'automatic mode'. (I note that I'm not using Jetty).

I've imported and re-imported video library files, and no metadata shows up for them. I've tried through the UI, in sagemc, doing (from video info),
"Options" , "Metadata/Fanart", which brings up a "MetaData/Fan Art Search" dialog, but which only has the option of 'close'.

I assume this means something is not working, but Im not sure what its supposed to look like and/or how to manually test.

Can somebody point me in the right direction?

thanks

Cory
Reply With Quote
  #1259  
Old 07-10-2009, 09:25 PM
stuckless's Avatar
stuckless stuckless is offline
SageTVaholic
 
Join Date: Oct 2007
Location: London, Ontario, Canada
Posts: 9,713
Quote:
Originally Posted by cnovak View Post
I've installed this following the instructions as closely as I could,
and, while I've used the command line tool for a long tiem successfully, I'm not getting anything out of trying to use it in 'automatic mode'. (I note that I'm not using Jetty).

I've imported and re-imported video library files, and no metadata shows up for them. I've tried through the UI, in sagemc, doing (from video info),
"Options" , "Metadata/Fanart", which brings up a "MetaData/Fan Art Search" dialog, but which only has the option of 'close'.

I assume this means something is not working, but Im not sure what its supposed to look like and/or how to manually test.

Can somebody point me in the right direction?

thanks

Cory
What SageMC version are you running?
What BMT version are you running?
What SageTV version are you running?

When you installed it, did you install sagemc, and then install the bmt package?

Are you testing this from a client or placeshifter? if a client, do you have bmt installed and configured on the client?
Reply With Quote
  #1260  
Old 07-11-2009, 05:09 AM
plnewton plnewton is offline
Sage User
 
Join Date: Jun 2009
Posts: 38
Hi all,

Well I took your advice stuckless and started playing around with the command line options, getting much better results now, thanks for the tip.

I have set it to run on one drive which has about 330 DVD Rips in it.
It went through and completed about 250 of them and seems to have stopped and reports "processing failed" see log for details..

I have had a bit of hunt around but I have been unable to find the log files??

Any pointers on where to look?
Reply With Quote
Reply


Currently Active Users Viewing This Thread: 2 (0 members and 2 guests)
 

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
STV Import: Read & Write Metadata files for Default STV 5/6 (v2.2.9 18/Feb./2010) JREkiwi SageTV Customizations 251 10-09-2019 11:11 AM
Automated VideoRedo (DOS batch files) grauchy SageTV Customizations 3 09-08-2011 10:01 PM
Simple utility to control multiple USB or Serial HD DirecTV STBs jchiso Hardware Support 15 02-19-2009 06:27 PM
DVB-S setup with Digiguide EPG Grabber & XMLTV importer MCE-Refugee SageTV United Kingdom 27 09-08-2008 09:10 AM
Keeping custom metadata for imports via AddShow() Opus4 SageTV Studio 9 02-20-2008 06:35 PM


All times are GMT -6. The time now is 09:58 AM.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2023, vBulletin Solutions Inc.
Copyright 2003-2005 SageTV, LLC. All rights reserved.