We provide prebuilt
conda environments containing GPU-supported builds of
tensorflow (both with
horovod support for multi-node
jax, and many other commonly-used Python modules.
Users can activate this environment by first loading the
conda module, and
then activating the base environment.
Explicitly (either from an interactive job, or inside a job script):
This will load and activate the base environment.
Virtual environments via
To install additional packages that are missing from the
we can build a
venv on top of it.
base environment +
If you need a package that is not already
installed in the
this is generally the recommended approach.
We can create a
venv on top of the base
Anaconda environment (with
--system-site-packaes to inherit
You can always retroactively change the
state for this virtual environment by editing
changing the value of the line
To install a different version of a package that is already installed in the base environment, you can use:
The shared base environment is not writable, so it is impossible to remove or
uninstall packages from it. The packages installed with the above
should shadow those installed in the base environment.
Cloning the base Anaconda environment
This approach is generally not recommended as it can be quite slow and can use significant storage space.
If you need more flexibility, you can clone the conda environment into a custom
path, which would then allow for root-like installations via
conda install<module> or
pip install <module>.
venv approach, using a cloned Anaconda environment requires you to
copy the entirety of the base environment, which can use significant storage
To clone the
path/to/envs/base-clone should be replaced by a suitably chosen
Note: The cloning process can be quite slow.
pip install --user (not recommended)
This is typically not recommended.
With the conda environment setup, one can install common Python modules using
python3 pip install --users '<module-name>' which will install
$PYTHONUSERBASE environment variable is automatically set when you
load the base conda module, and is equal to
Note, Python modules installed this way that contain command line binaries will
not have those binaries automatically added to the shell's
manually add the path:
Be sure to remove this location from
$PATH if you deactivate the base
Anaconda environment or unload the module.
Cloning the Anaconda environment, or using
venv are both more flexible and
transparent when compared to