Using MATLAB® as a Workspace
- Overview
- Prerequisites
- Environment Setup
- FAQ/Troubleshooting
Overview
Interactive MATLAB® sessions are supported in Domino by means of configuring a Compute Environment and Interactive Workspace. If your administrators have already configured such an environment, you may be able to use it by simply switching your project to that environment.
This page provides the steps necessary to create a suitable Compute Environment if it does not already exist. Some steps may require assistance from a Domino or MATLAB admin.
Prerequisites
Network Licensing structure for MATLAB
To get MATLAB working using this guide, you will need a network license. A network concurrent license is recommended, but a network named license may also work IF the usernames specified in the license match the usernames within Domino. If you don't currently have a network concurrent license, reach out to your MATLAB license administrator to determine if one is available or needs to be purchased. This information will be needed when configuring the Compute Environment (see below). You may have a single license server or a set of 3 license servers. We will show examples for two styles of providing the license server information:
-
The first method requires only the port and host for your license server(s), e.g. 27000@lic1.customer.com (and optionally 27000@lic2.customer.com, 27000@lic3.customer.com). This is recommended for most cases.
-
The second method applies if you have been given a network.lic file, e.g.
SERVER lic1.customer.com 000000000000 27000 SERVER lic2.customer.com 000000000010 27000 SERVER lic3.customer.com 000000000020 27000 USE_SERVER
This is recommended only if you have multiple sets of license servers (and thus multiple license files), i.e. in the case of separate license servers for MATLAB Parallel Server.
See Mathworks help for more details on the various options or talk to your MATLAB license administrator.
(Optional) Hardware Tiers with the correct GPU drivers
To make full use of GPU capabilities, the hardware tier you are using within Domino needs to have GPU drivers installed that can support the version of MATLAB you want to use. Compatibility is determined by this table describing the minimum CUDA Toolkit version requirement for each version of MATLAB, and by this table describing the minimum NVIDIA driver version requirement for each version of the CUDA Toolkit.
The MATLAB base images provided by Domino (see below) will already have a suitable version of the CUDA Toolkit installed. The NVIDIA drivers must be configured at the Hardware Tier level. If you already have a GPU-enabled hardware tier configured, it is likely that it already has suitable NVIDIA drivers. See the Troubleshooting section below for instructions on how to check the driver version during a MATLAB session to verify it is configured correctly.
If you do not have the correct NVIDIA drivers configured on your GPU Hardware Tier, talk to your Domino administrator and refer them to |release|<//environments/environment-caching-eks.html#install-gpu-drivers-gpu-amis-only">this sample documentation for configuring NVIDIA drivers in EKS.
Environment Setup
If a MATLAB-specific environment does not already exist in your Domino deployment, you will need to create one. Read about Compute Environment Management if you aren't already familiar.
Choose a base image
-
In Domino, click Environments in the top navigation bar.
-
Click Create Environment.
-
Give the environment an informative name, and then choose a base image that has MATLAB installed. The following are the most current options available from Domino.
quay.io/domino/matlab:R2019b-complete-20201014 quay.io/domino/matlab:R2020a-complete-20201014
More details about each image are documented in our github repo: https://github.com/dominodatalab/Domino_Base_Images/tree/master/MATLAB_Base_Images. This includes lists of Toolboxes, release notes and known issues, and information for all past images.
-
After selecting the appropriate base image, choosing a visibility setting, and optionally providing a description, click Create Environment to finalize.
-
The environment will be created and you will be automatically redirected to its Overview page. Scroll down to the Docker Settings and click Edit Dockerfile to continue setting up the environment.
Edit the Dockerfile
Add the following lines to your Dockerfile Instructions, editing the license server information to match your actual license servers. Also be sure to edit the MATLAB_VERSION variable to match the MATLAB version of the base image you chose in the previous step.
If you have port and host information for your license servers (recommended method):
# This MATLAB_VERSION variable is used later in persisting Add-ons and preferences ENV MATLAB_VERSION='R2019b' ENV MLM_LICENSE_FILE=27000@lic1.customer.com,27000@lic2.customer.com,27000@lic3.customer.com
Or, if you have a network.lic file (more useful if you have multiple license files) you can adapt this example:
ENV MATLAB_VERSION='R2019b' # Here we are simply pasting the information in the license file # If you have the license file hosted somewhere accessible to Domino, you could instead download it to the same location via wget or similar methods RUN mkdir -p /usr/local/MATLAB/$MATLAB_VERSION/licenses && \ printf "SERVER lic1.customer.com 000000000000 27000\nSERVER lic2.customer.com 000000000010 27000\nSERVER lic3.customer.com 000000000020 27000\nUSE_SERVER\n" > /usr/local/MATLAB/$MATLAB_VERSION/licenses/network.lic
Add Pluggable Workspace Tools definition
Add the appropriate "Pluggable Properties" to the Properties for Workspaces.
These are documented alongside the base image descriptions here: https://github.com/dominodatalab/Domino_Base_Images/tree/master/MATLAB_Base_Images.
Note that the MATLAB base images are built on top of the Domino standard environments, so you can add the workspace configs for e.g. Jupyter or RStudio for those standard environments also.
For example, if you are using the quay.io/domino/matlab:r2019b-20200521 base image, add the following lines for the MATLAB workspace:
matlab: title: "MATLAB" iconUrl: "https://raw.githubusercontent.com/dominodatalab/workspace-configs/develop/workspace-logos/matlab.png" start: [ "/var/opt/workspaces/matlab/start.sh" ] httpProxy: port: 8888 requireSubdomain: false
Because it is built on top of quay.io/domino/base:Ubuntu18_DAD_Py3.6_R3.6_20190916, you can optionally add any of the following sections for workspaces from that environment:
jupyter: title: "Jupyter (Python, R, Julia)" iconUrl: "/assets/images/workspace-logos/Jupyter.svg" start: [ "/var/opt/workspaces/jupyter/start" ] httpProxy: port: 8888 rewrite: false internalPath: "/{{ownerUsername}}/{{projectName}}/{{sessionPathComponent}}/{{runId}}/{{#if pathToOpen}}tree/{{pathToOpen}}{{/if}}" requireSubdomain: false supportedFileExtensions: [ ".ipynb" ] jupyterlab: title: "JupyterLab" iconUrl: "/assets/images/workspace-logos/jupyterlab.svg" start: [ "/var/opt/workspaces/Jupyterlab/start.sh" ] httpProxy: internalPath: "/{{ownerUsername}}/{{projectName}}/{{sessionPathComponent}}/{{runId}}/{{#if pathToOpen}}tree/{{pathToOpen}}{{/if}}" port: 8888 rewrite: false requireSubdomain: false vscode: title: "vscode" iconUrl: "/assets/images/workspace-logos/vscode.svg" start: [ "/var/opt/workspaces/vscode/start" ] httpProxy: port: 8888 requireSubdomain: false rstudio: title: "RStudio" iconUrl: "/assets/images/workspace-logos/Rstudio.svg" start: [ "/var/opt/workspaces/rstudio/start" ] httpProxy: port: 8888 requireSubdomain: false
(Optional) Persist MATLAB Preferences and Add-ons between sessions
In order to persist your MATLAB Preferences and Add-ons between Domino sessions, you can define a Post Run Script to automatically copy them to your Project Files when you Stop and Sync a session, and define a Pre Run Script to copy them from your Project Files into the locations MATLAB will recognize at the start of subsequent sessions.
Put the following lines into your Pre Run Script.
if [ -d /mnt/matlab-addons ]; then mkdir -p /home/ubuntu/Documents/MATLAB/SupportPackages/$MATLAB_VERSION/ rsync -r /mnt/matlab-addons/ /home/ubuntu/Documents/MATLAB/SupportPackages/$MATLAB_VERSION fi if [ -d /mnt/matlab-preferences/$DOMINO_STARTING_USERNAME ]; then mkdir -p /home/ubuntu/.matlab/$MATLAB_VERSION/ rsync -r /mnt/matlab-preferences/$DOMINO_STARTING_USERNAME/ /home/ubuntu/.matlab/$MATLAB_VERSION fi
Put the following lines into your Post Run Script.
if [ -d /home/ubuntu/Documents/MATLAB/SupportPackages/$MATLAB_VERSION]; then mkdir -p /mnt/matlab-addons rsync -r /home/ubuntu/Documents/MATLAB/SupportPackages/$MATLAB_VERSION/ /mnt/matlab-addons fi if [ -d /home/ubuntu/.matlab/$MATLAB_VERSION]; then mkdir -p /mnt/matlab-preferences/$DOMINO_STARTING_USERNAME rsync -r /home/ubuntu/.matlab/$MATLAB_VERSION/ /mnt/matlab-preferences/$DOMINO_STARTING_USERNAME fi
Note that these scripts will save add-ons per project, so that any collaborators launching a workspace in the same project will have the same add-ons. For preferences, however, they will be saved per user in the project so that each user can have a different set of preferences.
(Optional) Generate a startup script for proxy settings
If your company uses a proxy to connect to external networks, you may already have lines like the following in many of your Compute Environment Dockerfiles:
ENV http_proxy='http://someusername:password123@proxy.company.com:80' ENV https_proxy='http://someusername:password123@proxy.company.com:80' ENV HTTP_PROXY='http://someusername:password123@proxy.company.com:80' ENV HTTPS_PROXY='http://someusername:password123@proxy.company.com:80'
Without setting the proxy information in MATLAB as well, you may not be able to connect to external networks from MATLAB (e.g. for downloading community Add-ons). Proxy information can be set manually in MATLAB under Preferences -> Web, and these will be persisted across sessions if the Pre and Post Run Scripts from the previous section are included in your environment.
Alternately, you can define a startup.m file in your project to ensure the proxy settings are correct at every launch of MATLAB. The file would look something like the following.
% This startup file was created from the environment pre-run script, to set proxy settings for MATLAB disp('Setting proxy configuration via startup.m file') com.mathworks.mlwidgets.html.HTMLPrefs.setUseProxy(true) com.mathworks.mlwidgets.html.HTMLPrefs.setProxyHost('proxy.company.com') com.mathworks.mlwidgets.html.HTMLPrefs.setProxyPort('80') com.mathworks.mlwidgets.html.HTMLPrefs.setUseProxyAuthentication(true) com.mathworks.mlwidgets.html.HTMLPrefs.setProxyUsername('someusername') com.mathworks.mlwidgets.html.HTMLPrefs.setProxyPassword('password123')
Put the following lines into your Pre Run Script to automatically generate such a file in any project where it does not exist, whenever this Compute Environment is used to launch a session. (Omit the Authentication, Username, and Password lines if your proxy does not use them.)
if [ ! -f /mnt/startup.m ]; then echo "% This startup file was created from the environment pre-run script, to set proxy settings for MATLAB" > /mnt/startup.m echo "disp('Setting proxy configuration via startup.m file')" >> /mnt/startup.m echo "com.mathworks.mlwidgets.html.HTMLPrefs.setUseProxy(true)" >> /mnt/startup.m echo "com.mathworks.mlwidgets.html.HTMLPrefs.setProxyHost('proxy.company.com')" >> /mnt/startup.m echo "com.mathworks.mlwidgets.html.HTMLPrefs.setProxyPort('80')" >> /mnt/startup.m echo "com.mathworks.mlwidgets.html.HTMLPrefs.setUseProxyAuthentication(true)" >> /mnt/startup.m echo "com.mathworks.mlwidgets.html.HTMLPrefs.setProxyUsername('someusername')" >> /mnt/startup.m echo "com.mathworks.mlwidgets.html.HTMLPrefs.setProxyPassword('password123')" >> /mnt/startup.m fi
Build and Test the Environment
Click Build when you have finished editing the above sections. You will be redirected to the Revisions page for the environment.
If the new revision builds successfully, you are ready to test! Go to the Project Settings for a project where you wish to use MATLAB and change the Compute Environment to use this new environment; once you do, you should see a MATLAB icon appear as an option for Workspaces in that project.
See the Troubleshooting section below for information on known issues and frequently encountered problems if anything does not work as expected.
FAQ/Troubleshooting
GPU functionality does not work as expected
The most common problem with GPU functionality is not having the correct NVIDIA driver version for your environment configured in your Hardware Tier. The following shell command should print some information about the GPU driver versions so you can verify it with the compatibility tables linked in the Prerequisites section.
>> !nvidia-smi Wed May 13 00:00:16 2020 +-----------------------------------------------------------------------------+ | NVIDIA-SMI 440.64.00 Driver Version: 440.64.00 CUDA Version: 10.2 | |-------------------------------+----------------------+----------------------+ | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | |===============================+======================+======================| | 0 Tesla V100-SXM2... Off | 00000000:00:1B.0 Off | 0 | | N/A 39C P0 50W / 300W | 0MiB / 16160MiB | 0% Default | +-------------------------------+----------------------+----------------------+ | 1 Tesla V100-SXM2... Off | 00000000:00:1C.0 Off | 0 | | N/A 41C P0 50W / 300W | 0MiB / 16160MiB | 0% Default | +-------------------------------+----------------------+----------------------+ | 2 Tesla V100-SXM2... Off | 00000000:00:1D.0 Off | 0 | | N/A 40C P0 52W / 300W | 0MiB / 16160MiB | 0% Default | +-------------------------------+----------------------+----------------------+ | 3 Tesla V100-SXM2... Off | 00000000:00:1E.0 Off | 0 | | N/A 40C P0 54W / 300W | 0MiB / 16160MiB | 4% Default | +-------------------------------+----------------------+----------------------+ +-----------------------------------------------------------------------------+ | Processes: GPU Memory | | GPU PID Type Process name Usage | |=============================================================================| | No running processes found | +-----------------------------------------------------------------------------+
MATLAB workspace fails to launch
License configuration problems
License issues are the most common cause of problems launching a MATLAB workspace. To debug, start a Jupyter or RStudio workspace (still using the MATLAB environment) and open a Terminal. Check if your license server information has been correctly entered into the network.lic file, in the correct part of the MATLAB directory structure (i.e. matching your MATLAB version):
$ which matlab /usr/local/MATLAB/R2019b/bin/matlab $ cat /usr/local/MATLAB/R2019b/licenses/network.lic
If that contains the license server information you expect, but there are still problems, you can use the lmutil utility to check that the license server is reachable and contains the correct information.
$ lmutil lmstat -a -c 27000@lic1.customer.com
It should output information on the licenses being managed by that license server, including the MATLAB licenses.
Advanced troubleshooting
The workspace launch process for MATLAB respects several environment variables related to logging, which may help you debug more obscure or advanced problems. You can set these as project-level environment variables, similar to how you would set environment variables for secure credential storage, to enable toggling them on or off without having to edit the Compute Environment.
- WS_LOGGING=[MATLAB]|ALL|DEBUG. By default, only the MATLAB logs are shown.
- ALL shows logs for the underlying screen management xterm and xpra.
- DEBUG shows everything from ALL, and activates a flag to show all commands.
- TTY_MODE=[disabled]|PRE|POST. Runs ttyd before or after the workspace. It's a terminal that runs in a browser so you can easily inspect things.
- PRE will run ttyd before the workspace launch.
- POST will run ttyd after the workspace launch fails (if it fails).
- START_LOGGING=[false]|true. Increases logging verbosity in certain stages.
MATLAB workspace is laggy
In poor network conditions you may notice some lag in typing and general interactions with the MATLAB UI. This is to be expected in certain circumstances. Other common Domino workspaces like Jupyter or RStudio use browser-based IDEs, while this MATLAB environment is running a (Linux) desktop version of MATLAB in a remote desktop style interface. This results in more sensitivity to slow network conditions than a browser-based IDE.
For these situations, if you encounter them frequently, you may find it useful to install the Domino CLI on your local machine to facilitate editing files locally, then syncing them to Domino.
Keyboard shortcuts for copy/paste do not work
MATLAB in Domino runs the Linux version of MATLAB, which uses the "Emacs" set of keyboard shortcuts by default. To enable keyboard shortcuts Ctrl+C and Ctrl+V for copy and paste, go to Preferences -> Keyboard -> Shortcuts and change this from "Emacs" to "Windows". See the MATLAB help for more details.
Connection error when downloading Add-ons or using urlread
If you get network errors when downloading Add-ons or using urlread to download files, it may be due to proxy settings. See the Proxy`</ section above for options for setting your proxy in MATLAB either within the current session or more globally.
Toolbox is not available
A selection of Toolboxes is pre-installed in each MATLAB base image, but this may not include every Toolbox you have on your local installation. You can see the list of Toolboxes by running the ver command within MATLAB, and the list is also documented for each base image. We may release more base images in the future, with different selections, and you can contact your Domino account team with any specific requests for Toolboxes to include.
In addition to having the Toolbox installed in the base image, you must have an available license for using it on your license serve.
Known Issues and Release Notes
If your problem is not listed in this FAQ, it may be worth checking the release notes for the base image you are using. Especially if your environment is built on an older image tag, checking the release notes of newer images may give you a quick answer about whether rebuilding on the most current image will help.
MATLAB and Simulink are registered trademarks of The MathWorks, Inc. See http://mathworks.com/trademarks for a list of additional trademarks.
Comments
0 comments
Please sign in to leave a comment.