Cannot contact Hypervisor

[David Fowler]

We are running Xendesktop and XenApp v7.6.0.5026.  and Vsphere 6.7.  I have run into an issue where the delivery controller can no longer talk to the Vcenter server.  Note, I we upgrade Vmware to 6.7 abut 2 months ago due to the inablilty to manage without flash.  I tell you this because it appears that 7.6 might not be compatable with vSphere 6.7.   But, it has worked fine for 2 months!

 

First I was getting the the error about the resources being unavailable.  I verified all permissions, certificates, and access.  I put the Connection/Resource in Maintenance mode, and now cannot get it back from maintance mode.  I continue to get .  

 

Here is the error.  I do not have support on this installation because it was supposed to be migrated by now, but as always, things take longer.  Can anyone assist with how to get it working again?

 

Error Id: XDDS:4DA81B28

Exception:
    Citrix.Console.Models.Exceptions.HypervisorNotContactableException The supplied address for the compute resource is invalid. In this case, the compute resource is what hosts your virtual desktops (such as your hypervisor, a server running SCCM, or a cloud-based controller).
       at Citrix.Console.PowerShellInteraction.CmdletExecutionMethods.CreateException[T](ICommonLog logger, ExecutionResults`1 results, ICmdletExecutionHost host)
       at Citrix.Console.PowerShellInteraction.CmdletExecutionMethods.Execute[T](ISdkCmdlet`1 sdkCmd, ICmdletExecutionHost host, Boolean allowFailover)
       at Citrix.Console.PowerShellSdk.HypervisorService.Scripts.SetMaintenanceModeScript.RunScript()
       at Citrix.Console.PowerShellInteraction.PowerShellScript`1.Run()
       at Citrix.Console.Hypervisors.UI.Mmc.Commands.HypervisorMaintenanceModeNodeCommand.<>c__DisplayClassa.<SetMaintenanceMode>b__9()
       at Citrix.Console.CommonControls.ProgressDisplay.ProgressWindowOperation.PerformOperation()
       at Citrix.Console.CommonControls.ProgressDisplay.ProgressWindowViewModel.PerformAction(Action operationComplete)
    
    DesktopStudio_ErrorId : HypervisorNotContactable
    Exception : Citrix.ManagedMachineAPI.HostingInfrastructureCommunicationsFailureException: Url invalid ---> System.Net.WebException: The underlying connection was closed: An unexpected error occurred on a send. ---> System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
       at System.Net.Security.SslState.StartReadFrame(Byte[] buffer, Int32 readBytes, AsyncProtocolRequest asyncRequest)
       at System.Net.Security.SslState.StartReceiveBlob(Byte[] buffer, AsyncProtocolRequest asyncRequest)
       at System.Net.Security.SslState.ForceAuthentication(Boolean receiveFirst, Byte[] buffer, AsyncProtocolRequest asyncRequest)
       at System.Net.Security.SslState.ProcessAuthentication(LazyAsyncResult lazyResult)
       at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
       at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
       at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state)
       at System.Net.TlsStream.ProcessAuthentication(LazyAsyncResult result)
       at System.Net.TlsStream.Write(Byte[] buffer, Int32 offset, Int32 size)
       at System.Net.ConnectStream.WriteHeaders(Boolean async)
       --- End of inner exception stack trace ---
       at System.Web.Services.Protocols.WebClientProtocol.GetWebResponse(WebRequest request)
       at System.Web.Services.Protocols.SoapHttpClientProtocol.Invoke(String methodName, Object[] parameters)
       at VimApi.VimService.RetrieveServiceContent(ManagedObjectReference _this)
       at Citrix.PoolManagement.VMManager.VmmImplementation.Vmware.VmwareVmConnection.SingleConnectionAttempt()
       --- End of inner exception stack trace ---
       at Citrix.PoolManagement.VMManager.VmmImplementation.Vmware.VmwareVmConnection.SingleConnectionAttempt()
       at HypervisorsCommon.BaseConnector`2.AttemptConnection(Boolean throwExceptions)
       at HypervisorsCommon.BaseConnector`2.Start()
       at Citrix.PoolManagement.VMManager.VmmImplementation.Vmware.VmwareVmManager.StartMachineManager()
       at Citrix.PoolManagement.VMManager.VmmImplementation.Vmware.VmwareFactory.CreateMachineManagerInternal(IList`1 servers, String userName, SecureString password, String options)
       at Citrix.PoolManagement.VMManager.VmmImplementation.Vmware.VMwareHypConnection..ctor(ConnectionDetails details)
       at Citrix.PoolManagement.VMManager.VmmImplementation.Vmware.VMwareHypConnection.GetOrCreateConnection(ConnectionDetails details)
       at Citrix.PoolManagement.VMManager.VmmImplementation.Vmware.VMwareHypervisor.IsDumSupported(ConnectionDetails connectionDetails)
       at Citrix.Host.Logic.ValidateConnectionDetails(HypervisorConnectionInternal connection, Boolean checkAllConnectionAddresses)
    Reason : HostingInfrastructureCommunicationsFailureException
    Message : Url invalid
    Sdk Error Message : The hypervisor was not contactable at the supplied address. (Reason = Url invalid)
    Sdk Error ID : Citrix.XDPowerShell.HostStatus.HypervisorNotContactable,Microsoft.PowerShell.Commands.SetItemCommand
    ErrorCategory : ResourceUnavailable
    DesktopStudio_PowerShellHistory : Turn Off Maintenance Mode on Connection 'Vsphere connection'
    7/12/2021 10:13:03 AM
    
    Get-LogSite  -AdminAddress "soha12citrixxd.ohaev.com:80"
    Start-LogHighLevelOperation  -AdminAddress "soha12citrixxd.ohaev.com:80" -Source "Studio" -StartTime "7/12/2021 3:13:03 PM" -Text "Turn Off Maintenance Mode on Connection `'Vsphere connection`'"
    Set-HypAdminConnection  -AdminAddress "soha12citrixxd.ohaev.com:80"
    Set-Item  -LiteralPath @("XDHyp:\Connections\Vsphere connection") -LoggingId "8d3ad1d0-98af-41f0-93e5-1843539471ba" -MaintenanceMode $False -Password ********
    Set-Item : The hypervisor was not contactable at the supplied address. (Reason = Url invalid)
        + CategoryInfo : InvalidOperation: (:) [Set-Item], InvalidOperationException
        + FullyQualifiedErrorId : Citrix.XDPowerShell.HostStatus.HypervisorNotContactable,Microsoft.PowerShell.Commands.SetItemCommand
    Set-Item : The hypervisor was not contactable at the supplied address. (Reason = Url invalid)
        + CategoryInfo : NotSpecified: (:) [Set-Item], InvalidOperationException
        + FullyQualifiedErrorId : System.InvalidOperationException,Microsoft.PowerShell.Commands.SetItemCommand
    Stop-LogHighLevelOperation  -AdminAddress "soha12citrixxd.ohaev.com:80" -EndTime "7/12/2021 3:13:03 PM" -HighLevelOperationId "8d3ad1d0-98af-41f0-93e5-1843539471ba" -IsSuccessful $False
    
    
Inner Exception:
    System.InvalidOperationException The hypervisor was not contactable at the supplied address. (Reason = Url invalid)
    
    
    
Thanks!error message-exit maintenance mode.txt