<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";
color:black;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"Times New Roman","serif";
color:black;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Vorformatiert Zchn";
margin:0cm;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";
color:black;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Sprechblasentext Zchn";
margin:0cm;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";
color:black;}
span.HTMLVorformatiertZchn
{mso-style-name:"HTML Vorformatiert Zchn";
mso-style-priority:99;
mso-style-link:"HTML Vorformatiert";
font-family:Consolas;
color:black;}
span.SprechblasentextZchn
{mso-style-name:"Sprechblasentext Zchn";
mso-style-priority:99;
mso-style-link:Sprechblasentext;
font-family:"Tahoma","sans-serif";
color:black;}
span.E-MailFormatvorlage22
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 2.0cm 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body bgcolor=white lang=DE link=blue vlink=purple><div class=WordSection1><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Hi,<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>today I enabled the ORB logging at level 10.<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Here is a short snippet from the log:<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>2018-04-09 13:38:15.500@<local_host>@4904@LM_DEBUG@dance_locality_manager.exe|TAO (4904|1244) - Transport[1664]::drain_queue_helper, end of data<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>2018-04-09 13:38:15.500@<local_host>@4904@LM_DEBUG@dance_locality_manager.exe|TAO (4904|1244) - Transport[1664]::cleanup_queue, byte_count = 21100<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>2018-04-09 13:38:15.500@<local_host>@4904@LM_DEBUG@dance_locality_manager.exe|TAO (4904|1244) - Transport[1664]::cleanup_queue, after transfer, bc = 0, all_sent = 1, ml = 0<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>2018-04-09 13:38:15.500@<local_host>@4904@LM_DEBUG@dance_locality_manager.exe|TAO (4904|1244) - Transport[1664]::drain_queue_helper, byte_count = 21100, head_is_empty = 1<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>2018-04-09 13:38:15.500@<local_host>@4904@LM_DEBUG@dance_locality_manager.exe|TAO (4904|1244) - Transport[1664]::drain_queue_i, helper retval = 1<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>2018-04-09 13:38:15.500@<local_host>@4904@LM_DEBUG@dance_locality_manager.exe|TAO (4904|1244) - Connection_Handler[1664]::handle_input_internal, handle = 1664/1664, retval = 0<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>(9536|4496) [LM_DEBUG] - 13:38:15.796875 - NodeApplicationManager_impl::startLaunch - Activating NodeApplication servant<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>(8264|4444) [LM_TRACE] - 13:38:16.296875 - DA_NAM_ReplyHandlerImpl::startLaunch called.<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>(8264|4444) [LM_TRACE] - 13:38:16.296875 - DA_NAM_ReplyHandlerImpl::startLaunch - Plan ***SENSITIVE*** DomainApplication[03848570] node TestNode startLaunch succeeded, received 363 connections<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>(8264|4444) [LM_DEBUG] - 13:38:16.296875 - DA_NAM_ReplyHandlerImpl::Counter::on_all_completed - Plan ***SENSITIVE*** DomainApplication[03848570] successfully finished all nodes<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>(8264|4444) [LM_NOTICE] - 13:38:16.296875 - DomainApplicationManager_Impl::finish_startLaunch - DomainApplication[0] for plan ***SENSITIVE*** created 363 provided references.<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>(8264|4444) [LM_TRACE] - 13:38:16.296875 - DomainApplicationManager_Impl::finish_startLaunch - DomainApplication was successfully activated.<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>(7608|5104) [LM_DEBUG] - 13:38:16.859375 - Plan_Launcher_Base_Impl::start_launch - startLaunch completed...<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>(7608|5104) [LM_DEBUG] - 13:38:16.859375 - Plan_Launcher_Base_Impl::start_launch - DomainApplication was received from startLaunch<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>(7608|5104) [LM_DEBUG] - 13:38:16.859375 - Plan_Launcher_Base_Impl::launch_plan - before finishLaunch<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>(8264|4444) [LM_DEBUG] - 13:38:17.343750 - DomainApplication_impl::finishLaunch - Plan ***SENSITIVE*** DomainApplication[03848570] : 1 applications to finish launching<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>(8264|4444) [LM_TRACE] - 13:38:17.343750 - DomainApplication_Impl::finishLaunch - Plan ***SENSITIVE*** DomainApplication[03848570] node TestNode : calling finishLaunch on a node application<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>(8264|4444) [LM_TRACE] - 13:38:17.437500 - DomainApplication_Impl::finishLaunch - finishLaunch has been called on a node application<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>TAO (9536|4496) - ERROR: Could not create all profiles while extracting object [1, 4]<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>TAO (9536|4496) - ERROR: reference from the CDR stream.<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>(8264|4444) [LM_TRACE] - 13:38:17.687500 - DA_NA_ReplyHandlerImpl::finishLaunch_excep called<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>(8264|4444) [LM_ERROR] - 13:38:17.687500 - DA_NA_ReplyHandlerImpl::finishLaunch_excep - Plan ***SENSITIVE*** DomainApplication[03848570] node TestNode : Caught a CORBA exception: system exception, ID 'IDL:omg.org/CORBA/MARSHAL:1.0'<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>Unknown vendor minor code id (0), minor code = 0, completed = NO<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>(8264|4444) [LM_ERROR] - 13:38:17.687500 - DA_NA_ReplyHandlerImpl::Counter::on_all_completed_with_failure - Plan ***SENSITIVE*** DomainApplication[03848570] : 1 errors from node applications<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>(7608|5104) [LM_ERROR] - 13:38:17.687500 - Plan_Launcher_Base_Impl::finish_launch - Caught StartError exception while invoking finishLaunch: ***SENSITIVE***, 1 errors from node applications:<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'> TestNode - finishLaunch raised CORBA exception : system exception, ID 'IDL:omg.org/CORBA/MARSHAL:1.0'<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>Unknown vendor minor code id (0), minor code = 0, completed = NO<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>(7608|5104) [LM_ERROR] - 13:38:17.718750 - Plan_Launcher::launch_plan - Deployment failed, exception: Caught StartError exception while invoking finishLaunch: ***SENSITIVE***, 1 errors from node applications:<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'> TestNode - finishLaunch raised CORBA exception : system exception, ID 'IDL:omg.org/CORBA/MARSHAL:1.0'<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:8.0pt;font-family:"Courier New";color:#1F497D'>Unknown vendor minor code id (0), minor code = 0, completed = NO<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>From TAO there are two errors “Could not create all profiles while extracting object…” and “reference from the CDR stream”. Do you know what is causing these errors?<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>If necessary I can provide the full logfile also?<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Best regards<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Holger<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><div><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm'><p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext'>Von:</span></b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext'> Johnny Willemsen [mailto:jwillemsen@remedy.nl] <br><b>Gesendet:</b> Montag, 9. April 2018 10:30<br><b>An:</b> CIAO Users Mailing List; Haidinger, Holger<br><b>Betreff:</b> Re: [ciao-users] DAnCE: Plan Launcher throws CORBA MARSHAL exception<o:p></o:p></span></p></div></div><p class=MsoNormal><o:p> </o:p></p><p>Hi,<o:p></o:p></p><p>The log is not telling when exactly the marshal exception happens, probably you need to enable the ORB Logging at level 10 to get enough details to have any idea of what is happening<o:p></o:p></p><p class=MsoNormal>Regards,<br><br><o:p></o:p></p><pre>Johnny Willemsen<o:p></o:p></pre><pre>Remedy IT<o:p></o:p></pre><pre>Postbus 81 | 6930 AB Westervoort | The Netherlands<o:p></o:p></pre><pre><a href="http://www.remedy.nl">http://www.remedy.nl</a><o:p></o:p></pre><div><p class=MsoNormal>On 04/06/2018 05:40 PM, Haidinger, Holger wrote:<o:p></o:p></p></div><blockquote style='margin-top:5.0pt;margin-bottom:5.0pt'><pre>Hi Will,<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>we are using the ACE logging facility which is redirecting the log to a file.<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>I have attached a log file as a ZIP archive. Hopefully this will work on the mailing list.<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>The exception occurred at the end of the file. CIAO_LOG_LEVEL was not used.<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>Best regards<o:p></o:p></pre><pre>Holger<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>-----Ursprüngliche Nachricht-----<o:p></o:p></pre><pre>Von: ciao-users [<a href="mailto:ciao-users-bounces@list.isis.vanderbilt.edu">mailto:ciao-users-bounces@list.isis.vanderbilt.edu</a>] Im Auftrag von William R. Otte<o:p></o:p></pre><pre>Gesendet: Freitag, 23. März 2018 19:15<o:p></o:p></pre><pre>An: CIAO Users Mailing List<o:p></o:p></pre><pre>Betreff: Re: [ciao-users] DAnCE: Plan Launcher throws CORBA MARSHAL exception<o:p></o:p></pre><pre><o:p> </o:p></pre><pre><o:p> </o:p></pre><pre><o:p> </o:p></pre><pre>On 23 Mar 2018, at 12:02, Haidinger, Holger wrote:<o:p></o:p></pre><pre><o:p> </o:p></pre><blockquote style='margin-top:5.0pt;margin-bottom:5.0pt'><pre>Hi Will,<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>first of all, thank you very much for your quick response!<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>We turned up the logging by setting the following environment<o:p></o:p></pre><pre>variables:<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>set DANCE_LOG_LEVEL=10<o:p></o:p></pre><pre>set DANCE_TRACE_ENABLE=1<o:p></o:p></pre><pre><o:p> </o:p></pre></blockquote><pre><o:p> </o:p></pre><pre>Trace is a bit much, there’s a ton of overhead and you probably don’t need function call tracing at this point.<o:p></o:p></pre><pre><o:p> </o:p></pre><pre><o:p> </o:p></pre><blockquote style='margin-top:5.0pt;margin-bottom:5.0pt'><pre>With these settings the MARSHAL exception occurred always (on faster <o:p></o:p></pre><pre>machines).<o:p></o:p></pre><pre><o:p> </o:p></pre></blockquote><pre><o:p> </o:p></pre><pre>That’s a good indication that you’re seeing a race condition of some <o:p></o:p></pre><pre>kind, increasing the logging changes the timing of events.<o:p></o:p></pre><pre><o:p> </o:p></pre><pre><o:p> </o:p></pre><blockquote style='margin-top:5.0pt;margin-bottom:5.0pt'><pre>Did you mean these settings or did we miss something?<o:p></o:p></pre><pre><o:p> </o:p></pre></blockquote><pre><o:p> </o:p></pre><pre>Are you redirecting the log to a file? My recollection from when I <o:p></o:p></pre><pre>implemented that is that should be available as a feature. That should <o:p></o:p></pre><pre>have marginally less runtime impact over printing to stderr and then <o:p></o:p></pre><pre>possibly redirecting to a file, as that will incur fewer context <o:p></o:p></pre><pre>switches and will buffer less (if my recollection is correct about the <o:p></o:p></pre><pre>implementation of the logger).<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>Did you see any indication that the exception is coming from the node <o:p></o:p></pre><pre>infrastructure instead of the domain infrastructure?<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>If you’re seeing indication that it’s coming from the node level, <o:p></o:p></pre><pre>also consider setting CIAO_LOG_LEVEL.<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>Hth,<o:p></o:p></pre><pre>/-Will<o:p></o:p></pre><pre><o:p> </o:p></pre><pre><o:p> </o:p></pre><pre>_______________________________________________<o:p></o:p></pre><pre>ciao-users mailing list<o:p></o:p></pre><pre><a href="mailto:ciao-users@list.isis.vanderbilt.edu">ciao-users@list.isis.vanderbilt.edu</a><o:p></o:p></pre><pre><a href="http://list.isis.vanderbilt.edu/cgi-bin/mailman/listinfo/ciao-users">http://list.isis.vanderbilt.edu/cgi-bin/mailman/listinfo/ciao-users</a><o:p></o:p></pre><p class=MsoNormal><br><br><br><o:p></o:p></p><pre>_______________________________________________<o:p></o:p></pre><pre>ciao-users mailing list<o:p></o:p></pre><pre><a href="mailto:ciao-users@list.isis.vanderbilt.edu">ciao-users@list.isis.vanderbilt.edu</a><o:p></o:p></pre><pre><a href="http://list.isis.vanderbilt.edu/cgi-bin/mailman/listinfo/ciao-users">http://list.isis.vanderbilt.edu/cgi-bin/mailman/listinfo/ciao-users</a><o:p></o:p></pre></blockquote><p class=MsoNormal><o:p> </o:p></p></div></body></html>