Jump to content
Welcome to our new Citrix community!
  • Configure NVIDIA License Server On-Prem and Integrate with MCS Provisioned Persistent Catalog


    cugcblogs

    Uddave Jajoo by Uddave Jajoo, CTA & Indianapolis CUGC Leader

    In 2021, I was asked to migrate the vGPU enabled VMs from one platform to another as our customer was migrating from VMWare Horizon to Citrix XenDesktops. I did not have enough knowledge about NVIDIA and how the GPU processing work in highly intensive graphics processing applications.

    I took help from community members and support teams (both Citrix and NVIDIA) and deployed the solution to provision NVIDIA vGPU-enabled Citrix VDIs on vSphere. This blog post was created 2 years ago but was not published that time. However, I am happy to publish it now to the community so that others could also benefit from it.

    (See also: Configuring NVIDIA vGPU VMs in Azure with Citrix DaaS.)

    Below are the overall configuration steps covering deployment of all the major infrastructure and other components.

    1. NVIDIA vGPU License Server Deployment
    2. Pre-Requisites Open JDK installation
    3. NVIDIA License Server Installation
    4. Access License Server management Interface
    5. Creating license server on NVIDIA portal
    6. Creating VDI Master Image (NVIDIA Driver Installation and vGPU profile)
    7. VDA installation and Machine Catalog creation
    8. Configuring Virtual Machine to enable vGPU profiles

    NVIDIA vGPU License Server Deployment: Open JDK JRE Prerequisite

    1. Install OpenJDK JRE on the server as prerequisite component before installing vGPU License server component
    2. Download java-1.8.0-openjdk-1.8.0.252-2.b09.ojdkbuild.windows.x86_64.msi
    image-8.png.f23ae5840b1d03be3b781361207163c4.png
    1. Run the MSI installer and proceed with the installation wizard
    2. Click Next
    3. Click Next and Install
    4. Monitor the installation and click Finish
    image-9.png.433e039381640411ff23a22bfdc98750.pngimage-10.png.b9479e2736578a0b95115c63bafcc943.pngimage-11.png.0c27ccdc3ed0c5483b39b87d41f92c4a.pngimage-12.png.66d9c728d9b83e1c4983e557896b9c42.png
    1. Configure system environment variable on the server pointing to jdk location.
      • Edit the System Environment Variables.
      • Add the location of the bin folder of the JDK installation to the PATH variable in System Variables.
      • The following is a typical value for the PATH variable: C:\WINDOWS\system32;C:\WINDOWS;"C:\Program Files\Java\jdk-11\bin"
    image-13.png.1948aee22ed72c79a6e1ea3bd14e1ddb.png
    1. Set JAVA_HOME: 
      • Under System Variables, click New. 
      • Enter the variable name as JAVA_HOME
      • Enter the variable value as the installation path of the JDK (without the bin sub-folder). 
      • Click OK. 
    image-14.png.ca4ca530e9cf48740b3b9ae9e14b17ab.png
    1. Configure the PATH environment to enable to run JAVA from a command prompt
      • Select the System variables “Path”
      • Click Edit
      • Click on New
      • Type “%JAVA_HOME%\bin” 
      • Click OK.
      • And OK again to apply changes.
    image-15.png.a79b1f78e1f89a7e402111f3cf321c5f.pngimage-16.png.fc7b0a0501278f722f347381c9b45bf8.png
    1. Verification:  
      • Change to the Java directory 
      • Type java.exe -version 
    Jajoo101123-02.png.d55f92ff6d03f2b15c514f01e47a9f0f.png

    NVIDIA Legacy License Server Installation

    Legacy License server is set to EOL by July 2023, hence NVIDIA offers two different methods for provisioning license server. (DLS) On Premise and Cloud(CLS). In this blog, I am going to cover how to setup a CLS based license server. Steps are very simple and described properly in the NVIDIA documentation as well.

     

    License System User Guide - NVIDIA Docs – Converting Legacy NVIDIA vGPU Software License Servers to NLS License Servers

    1. Right click the setup file and select run as administrator to proceed with configuration of license server
    image-18.png.a97d3edd5e98b0a6d5bdffaec908491a.png
    1. Open administrative command prompt and navigate to the setup folder and launch setup.exe
    2. When prompted select allow the file to launch, select Allow this file and click OK.
    3. Wait for the setup file to launch and navigate through the wizard.
    4. Click Next in the Introduction Tab
    5. Click Next for EULA
    6. Click Next for Accepting the Apache License
    image-19.png.4a8566934ccf243d0f7f3bc488b52123.pngimage-20.png.82dc41a445a84d98772036bd4a2de15a.pngimage-21.png.244f1c7c0cf9304178bd336e7321663d.png
    1. Select the location as default and proceed further with installation, click Next.
    2. In the Choose Firewall Options dialog box, select the ports to be opened in the firewall.
    3. To enable remote clients to access licenses from the server and prevent remote access to the management interface, use the default setting, which sets ports as follows:
      • ‣ Port 7070 is open to enable remote clients to access licenses from the server.
      • ‣ Port 8080 is closed to ensure that the management interface is available only through a web browser running locally on the license server host.
    4. Click Install and proceed further with the installation process.
    image-22.png.18df8d7cc957fa3ebfe95a7f2c00e300.pngimage-23.png.52cd6fc57eaf5ef4d72e758ba5a1f684.pngimage-24.png.1f45632ab354164d16212ffcfb70bb45.png
    1. Wait for the License Server installation script to execute
    2. Click Done once installation is complete.
    image-25.png.81332351a11f10f2fd57606f661fd55e.pngimage-26.png.34231368abb099ef57ff5d6914fd8c44.png

    Access License Server Management Interface

    1. In a web browser, visit the home page for license server management interface HTTP: http://localhost:8080/licserver
    2. If administrative security is enabled for the license server, log in to the license server.
      • In the license server management interface, select Login.
      • In the Login page that is displayed, enter your user name and password for logging in to the license server and click Authorize.
    image-27.png.4e440e1269f4534770c70ee99d706048.png

    The default credentials for the license server administrator account are as follows:

    ‣ admin

    Admin@123

    1. Record the license server’s MAC address, by launching the license server management console and navigating to configuration

      MAC Address – 00-XX-XX-XX-XX-XX-00 Note to change the MAC address binding on vecneter level

    2. Add Environment variable on the license server as below, this is needed to ensure the nvidialsadmin utility commands run perfectly fine.

      Variable Name:- FLEXNETLS_BASEURL

      Variable Value:- http://localhost:7070/api/1.0/instances/~

    3. Reboot the server
    4. Enable Administrative security for license server

      Perform this task in a command shell on the license server host.

      Set the property security.enabled to true.

      nvidialsadmin -config -set security.enabled=true Updated the property:security.enabled with value:true successfully

    image-28.png.33b377b483bcb5c7a6cdccf16decf1d0.pngimage-29.png.503efcb74741699288549aaeb21ae025.png
    1. Authenticating with license server

      To provide your password in the command, specify the credentials as follows:

       

      nvidialsadmin -authorize username password

       

      In any subsequent nvidialsadmin command, users must provide the required credentials for authenticating with the license server

    2. Run status check on the license server

      nvidialsadmin -authorize admin Admin@123 -status

    image-30.png.34cde16f3e27edaaa84b970782d49ccf.pngimage-31.png.372105e12ed98f71d0d5fd0df905d552.png

    Creating a License server on the NVIDIA Portal

    1. Login to NVIDIA Dashboard link to register the license server on portal

      https://nvid.nvidia.com/dashboard/#/dashboard

    2. Login with the Organization user credentials and create License Server
    image-32.png.badd4facdd5808b391cf7bf5bdbebe77.png
    1. On the NVIDIA Licensing Portal dashboard, click CREATE LICENSE SERVER.
    2. If you are adding a license server to an organization or virtual group for which a license server has already been created, click CREATE SERVER.
    3. Enter the details as below:

      ServerName: TestNVIDIA

      Description: License Server for NVIDIA vGPU

      MAC Address: 00-XX-XX-XX-XX-XX-00

      Select product – Virtual PC 2.0-10 Licenses

      Click Add Click create license server

    image-33.png.e689142954392ba3a26b4d3aed3507fc.png
    1. Verify the License server details along with the available license displayed in portal
    image-34.png.d256397b9b7b669f81c10167286159fa.png
    1. Download the License File
    image-35.png.25fdaabc837b94f661e7f3a17883097f.png
    1. Login to License server and upload the license file to the server.
    2. Navigate to Licensed Feature Usage

      Verify the details for the License added to the console.

    image-36.png.8c04beada2c1565a04b55cacc13be9d4.pngimage-37.png.cc4bc41a7559acb2e9577754ff130ed8.png

    Creating VDI Master Image (NVIDIA Driver Installation and vGPU profile)

    For vGPU card installation on vSphere or hypervisor please refer to the links: https://blogs.vmware.com/apps/2018/09/using-gpus-with-virtual-machines-on-vsphere-part-3-installing-the-nvidia-grid-technology.html

     

    https://virtualizationreview.com/articles/2015/05/29/how-to-install-an-nvidia-vgpu-in-esxi-hosts.aspx

    1. Create a new VM and install NVIDIA and VDA agent.
    2. In our case virtual machine was cloned from existing WIN10 Master image.
    3. Uninstall VDA from the image.
    4. Shutdown the machine
    5. Navigate to VMware vcenter, and locate the virtual machine.
    6. Click on Edit settings and add Shared PCI Device, Click Add and select the vGPU profile and click Reserve all Memory
    7. The New Shared PCI device with vGPU profile will show as configured
    8. Select Ok to complete the configuration
    image-38.png.06c08d842b83ff0cf1857978e35359f0.png
    1. Power on the virtual machine and monitor through remote console.
    2. Login as administrator
    3. Open Device Manager, it will show Microsoft Basic Display Adapter with exclamation mark, which is normal

       

      Caution:

      NVIDIA vGPU vSphere VIB version and NVIDIA driver for Windows version need to match

    4. Locate the media for NVIDIA driver and copy to local C Drive
    5. Right click on the NVIDIA driver setup file and run as administrator
    6. Select Yes to allow the UAC
    7. Leave the extraction path as default and click OK.
    image-39.png.be86ea252f4e3337296a715e5e8c7d9c.pngimage-40.png.fe05a0526aa99e77974ac56c06961eeb.pngimage-41.png.d7b686b56f12afef8b9d78b6e02eac74.png
    1. In the installation wizard, select Agree and Continue and proceed further
    2. Installation options select, Custom (advanced), it would let you select components to install as needed.
    3. Click Next, in the next window, it will display the list of components which will be install on the image.
    image-42.png.26336068449e9fd0075cd97a3af79689.pngimage-43.png.ab8a5099eb5bfce09febc50fd61f96e6.png
    1. Select the check box to Perform a Clean Installation and select Next.
    image-44.png.5ab75ad9f637a4ac150080cb9d38e22b.png
    1. Wait for the installation to complete and monitor the progress.
    image-45.png.853ad2e3078e733670e912f63ea56391.png
    1. Select restart now on successful installation of NVIDIA Driver.

       

      After restarting, the mouse cursor may not track properly using VNC or vSphere console. If so, use Remote Desktop.

    image-46.png.7bd81ced4abf1f688e526a9b7df7c7c1.png
    1. RDP to the virtual machine and verify the device manager configuration.
    2. Upon login to machine you may receive a prompt that NVIDIA license is not present. Ignore the alert for now.
    3. In order to validate the successful installation of the graphics drivers as well as the vGPU device, open Windows Device Manager and expand the Display Adapter section.
    4. It will show NVIDIA GRID M60-8Q adapter.’
    5. New Device NVDIA GRID V100D-8Q, it will show up as this in the display adapters
    image-47.png.e1477e53c9411b0ff46d8da672f720c7.pngimage-48.png.a34c52d5c8adc881bace73b8f50134d2.pngNew Device
    1. Shutdown the virtual machine and remove the Shared PCI device added on the master image.
    2. Right click machine, edit settings
    3. Click on the x mark against the Shared PCI device
    4. It will show as device will be removed, click OK.
    5. The recent Task Pane will display the status of completion once the device will be removed. A XenDesktop machine catalog can be safely configured now.
    image-49.png.67de6cb934512016235c3e274d14102b.pngimage-50.png.21ee2a456e35c99f65e6e667663e87aa.png

    VDA installation and Machine Catalog creation

    1. RDP to the virtual machine, copy the media to C:\Support
    2. Run the AutoSelect.exe file
    3. It will detect the VDA to be installed in Single Session OS by default.
    4. Select the option for VDA in single session OS and click Next.
    image-51.png.3dbdc9854c75eafa45a7c0d163037f8e.png
    1. In the next screen select Create a Master MCS image, click Next.
    2. VDA will be selected by default, click Next.
    image-52.png.eb0ab2204991670329a8922a9074f49e.pngimage-53.png.1638a5c2f0d496bd022335f76f22a93c.png
    1. In the component screen, select the option, Citrix Supportability Tools, Citrix User profile manager and Citrix User profile manager_WMI Plugin. Click Next.
    image-54.png.dfc72261327af29d1751da8651401b6b.png
    1. In the controller’s Tab, select configure later and click Next.
    2. In the Features Tab, select the options- Optimize Performance, use windows Remote Assistance, Enable Real Time Audio Transport for audio and MCS IO, click Next.
    image-55.png.5178b813c7d0e82d58477ae90ab9fab7.png
    1. In the Firewall Tab, leave the default and click Next.
    image-56.png.dc3f66cd3598a211718733516e97b9d4.png
    1. In the Summary Tab, review the selected configuration and proceed with Install. Click Install.
    image-57.png.a1c4ae5d4b5dc32dfed318642da1725c.png
    1. Uncheck the box and click Next.
    2. Click Finish and Restart the machine, it will reboot.
    3. Login to the machine again to resume the VDA installation process.
    image-58.png.e79d666043a12d5cc10c951273c9de0b.pngimage-59.png.26a173eb068d1fdf5e294f815149b757.png
    1. RDP to the machine and run Citrix Optimizer against the respective windows OS version template.
    2. Shut down the master image and take snapshot for the virtual machine.
    3. Login to Citrix studio and create machine catalog using the snapshot taken in above step.
    4. Navigate to the Machine Catalog Tab and select create Machine catalog, in the wizard select Next.
    5. In the next screen select Single Session OS and click Next.
    6. Select the options as highlighted and click Next.
    7. Check the option for Machines that are Power Managed

      Check Citrix MCS and select the resources corresponding to Cluster (ESXi Grid Server, where vGPU Cards and driver was configured) and click Next.

    image-60.png.aa9495581677352b5764e3dc1024e17f.pngimage-61.png.34e5aa9386af39c7c47e461bb1eb3053.png
    1. Select the options as highlighted and click Next.
    2. In the Master Image, select the Snapshot created for the master image.

      Ex – NVIDATESTVM_SNAP

    3. Select the minimum functional level for this catalog as 2206 or newer.
    4. In the Network cards tab, keep the VLAN selected and change if needed.
    image-62.png.f625205d77cc15ce9b6d402800ccfee6.png
    1. In the Virtual Machines page, select the number of virtual machine and allocate the memory:

      2 Machines with 32 GB RAM

    Jajoo101123-01.png.81849c0eef9fe4c0bade86c4454b503a.png
    1. Create the Active directory machine accounts for the Desktops
    2. Name the Machine Catalog with Description:

      TEST-MC-NVIDA-vGPU-Pool

    3. Monitor the Catalog creation process in studio and vcenter.

    Configuring Virtual Machine to enable vGPU profiles

    1. Assign vGPU profiles as per the requirement
    2. Assign B series profile to the provisioned desktops for allocating Virtual PC
    image-63.png.1bfff284a595ab30064469ddbb8a7c8d.pngimage-64.png.e021709b0cb1dadf885de9502e1e829b.png
    1. Assign a series profile to the provisioned desktops for allocating virtual Apps.

    Reference:

    License System User Guide - NVIDIA Docs – Converting Legacy NVIDIA vGPU Software License Servers to NLS License Servers

    https://blogs.vmware.com/apps/2018/09/using-gpus-with-virtual-machines-on-vsphere-part-3-installing-the-nvidia-grid-technology.html

     

    https://virtualizationreview.com/articles/2015/05/29/how-to-install-an-nvidia-vgpu-in-esxi-hosts.aspx

    License System User Guide - NVIDIA Docs

    Legacy License server is set to EOL by July 2023

     

    See More Recent Posts:

    image-17.png.55bdaf9b45340536725cae91eb471216.png

    image-65.png.7c8cf6b2fc28f91e86c3cb6ad1e1c6d7.png


    User Feedback

    Recommended Comments

    There are no comments to display.



    Create an account or sign in to comment

    You need to be a member in order to leave a comment

    Create an account

    Sign up for a new account in our community. It's easy!

    Register a new account

    Sign in

    Already have an account? Sign in here.

    Sign In Now

×
×
  • Create New...