Quick start for Linux
OpenCue is an open source render management system. You can use OpenCue in visual effects and animation production to break down complex jobs into individual tasks. You can submit jobs to a queue that allocates rendering resources. You can also monitor rendering jobs from your workstation.
The sandbox environment provides a way to quickly start a test OpenCue deployment. You can use the test deployment to run small tests or for development work. The sandbox environment runs OpenCue components in separate Docker containers on your local machine.
This quick start takes approximately 20 minutes to complete.
Before you begin
You must have the following software installed on your machine:
- Python version 2.7 or greater
- The Python
- The Python virtualenv tool
- Docker Compose
If you don’t already have a recent local copy of the OpenCue source code, you must do one of the following:
Download and unzip the OpenCue source code ZIP file.
If you have the
gitcommand installed on your machine, you can clone the repository:
git clone https://github.com/AcademySoftwareFoundation/OpenCue.git
Deploying the OpenCue sandbox environment
You deploy the sandbox environment using Docker Compose, which downloads and runs the images of the following containers from Docker Hub:
- a PostgresSQL database
- a Cuebot server
- an RQD rendering server
NoteIn a production OpenCue deployment, you might run many hundreds of RQD rendering servers.
Docker Compose downloads images of Cuebot and RQD corresponding to the latest release of OpenCue.
The Docker Compose deployment process also configures the database and applies
any database migrations. The deployment process creates a
sandbox directory. The
db-data directory is mounted as a volume in
the PostgresSQL database container and stores the contents of the database. If
you stop your database container, all data is preserved as long as you don’t
remove this directory. If you need to start from scratch with a fresh
database, remove the contents of this directory and restart the containers
To deploy the OpenCue sandbox environment:
Open a Terminal window.
If you haven’t already, add your user account to the
sudo gpasswd -a $USER docker
Docker Compose mounts volumes for the RQD rendering server on the host operating system under
/tmp/rqd/shots. RQD saves logs to the
logsdirectory. You specify the
shotsdirectory to save RQD output when creating OpenCue jobs.
To create the mount points with the required permissions, run the following command:
NoteIf you skip this step, the root account of the host operating system might incorrectly own the mount point directories.
mkdir -p /tmp/rqd/logs /tmp/rqd/shots
Change to the root of the OpenCue source code directory:
To deploy the OpenCue sandbox environment, export the
NoteYou must export all environment variables each time you start the sandbox.
To specify a password for the database, export the
Build the RQD container from source:
NoteThis is a temporary workaround due to a bug related to RQD in version 0.3.6 of OpenCue.
docker build -t opencue/rqd -f rqd/Dockerfile .
To deploy the sandbox environment, run the
docker-compose --project-directory . -f sandbox/docker-compose.yml up
The command produces a lot of output. When the setup process completes, you see output similar to the following example:
rqd_1 | 2019-09-03 16:56:09,906 WARNING rqd3-__main__ RQD Starting Up rqd_1 | 2019-09-03 16:56:10,395 WARNING rqd3-rqcore RQD Started cuebot_1 | 2019-09-03 16:56:10,405 WARN pool-1-thread-1 com.imageworks.spcue.dispatcher.HostReportHandler - Unable to find host 172.18.0.5,org.springframework.dao.EmptyResultDataAccessException: Failed to find host 172.18.0.5 , c reating host.
Leave this shell running in the background.
Installing the OpenCue client packages
OpenCue includes the following client packages to help you submit, monitor, and manage rendering jobs:
- PyCue is the OpenCue Python API. OpenCue client-side Python tools, such as
cueadmin, all use PyCue for communicating with your OpenCue deployment.
- PyOutline is a Python library that provides a Python interface to the job specification XML. You can use PyOutline to construct complex jobs with Python code instead of working directly with XML.
- CueSubmit is a graphical user interface for configuring and launching rendering jobs to an OpenCue deployment.
- CueGUI is a graphical user interface you run to monitor and manage jobs, layers, and frames.
cueadminis the OpenCue command-line client for administering an OpenCue deployment.
pycuerunis a command-line client for submitting jobs to OpenCue.
To install the OpenCue client packages:
Open a second Terminal window.
Change to the root of the OpenCue source code directory:
Create a virtual environment for the Python packages:
To install the lastest versions of the OpenCue client packages, you must configure the installation script with the version number. You can look up the version numbers for OpenCue releases on GitHub.
Install the Python dependencies and client packages in the
NoteAlternatively, you can install the client packages from your local clone of the source code. However, the latest version of the OpenCue source code might include changes that are incompatible with the prebuilt OpenCue images of Cuebot and RQD on Docker Hub used in the sandbox environment. To install from source, run
Testing the sandbox environment
To connect to the sandbox environment, you must first configure your local client packages to:
- Locate the
outline.cfgPyOutline configuration file included in the OpenCue Git repository.
- Locate the Cuebot server running in a Docker container on your machine.
To test the sandbox environment, run the following commands from the second Terminal window:
Set the location of the PyOutline configuration file:
NoteYou must export all environment variables each time you start the client packages.
The Cuebot docker container is forwarding the gRPC ports to your localhost, so you can connect to it as
To verify the successful installation of the sandbox environment, as well as the connection between the client packages and sandbox, you can run the
cueadmincommand-line tool. To list the hosts in the sandbox environment, run the following
The command produces output similar to the following:
Host Load NIMBY freeMem freeSwap freeMcp Cores Mem Idle Os Uptime State Locked Alloc Thread 172.18.0.5 52 False 24.2G 0K 183.1G 2.0 25.5G [ 2.00 / 25.5G ] Linux 00:04 UP OPEN local.general AUTO
Launch the CueSubmit app for submitting jobs:
The following screenshot illustrates the layout of CueSubmit as a standalone app:
By default, the OpenCue sandbox environment doesn’t include any rendering software. To experiment with the user interface, you can execute simple command-line shell scripts.
To execute a command-line shell script:
- For Job Name, type
- For User Name, type
- For Shot, type
- For Layer Name, type
- For Command To Run, type the following command:
echo "Output from frame: #IFRAME#; layer: #LAYER#; job: #JOB#"
- For Frame Spec, type
This job consists of 10 frames, which each run a simple
echocommand. For each frame, the
echocommand prints the frame number, layer name, and job name using replacement tokens such as
- For Job Name, type
To submit the job to OpenCue, click Submit.
Launch the CueGUI Cuetopia app for monitoring jobs:
The following screenshot illustrates the layout of CueGUI Cuetopia monitoring app:
CueGUI displays the job name
testing-test-shot-test-user_helloworldin the list of jobs.
Double-click the job name.
CueGUI displays the list of frames in the job.
After OpenCue marks the status of a frame as
SUCCEEDED, click the corresponding row in the list of frames.
In the LogView view, review the log output for the job to verify the frame produced output similar to the following:
Output from frame: 9; layer: test_layer; job: testing-test-shot-test-user_helloworld
Stopping and deleting the sandbox environment
To delete the resources you created in this guide, run the following commands from the second shell:
To stop the sandbox environment, run the following command:
docker-compose --project-directory . -f sandbox/docker-compose.yml stop
To free up storage space, delete the containers:
docker-compose --project-directory . -f sandbox/docker-compose.yml rm
To delete the virtual environment for the Python client packages:
rm -rf venv
- To test submitting a Blender rendering job, see Customizing RQD rendering hosts.
- Learn more about OpenCue concepts and terminology.
- Install the full OpenCue infrastructure.
Was this page helpful?
Glad to hear it! Please tell us how we can improve.
Sorry to hear that. Please tell us how we can improve.