Differences

This shows you the differences between two versions of the page.

--- pub:hpc:mill [2024/05/07 22:39] – [VS Code] tvmwd6
+++ pub:hpc:mill [2024/05/15 14:28] (current) – jonesjosh
@@ Line 22: / Line 22: @@
 | Model | CPU Cores | System Memory | Node Count |
 | Dell R6525 | 128 | 512 GB | 25 |
-| Dell C6525 | 64 | 256 GB | 124 |
+| Dell C6525 | 64 | 256 GB | 128 |
-| Dell C6420 | 40 | 192 GB | 1 |
+| Dell C6420 | 40 | 192 GB | 4 |
@@ Line 34: / Line 34: @@
 | Dell XE9680 | 112 | 1 TB | H100 SXM5 | 80 GB | 8 | 1 |
 | Dell C4140 | 40 | 192 GB | V100 SXM2 | 32 GB | 4 | 4 |
-| Dell R740xd | 40 | 394 GB | V100 PCIe | 32 GB | 2 | 1 |
+| Dell R740xd | 40 | 384 GB | V100 PCIe | 32 GB | 2 | 1 |
 A specially formatted sinfo command can be ran on the Mill to report live information about the nodes and the hardware/features they have.
@@ Line 356: / Line 356: @@
 <code> sbatch array_test.sub </code>
+=====Priority Access=====
+Information coming on priority access leases.
 ===== Applications =====
@@ Line 425: / Line 427: @@
 ====Anaconda====
-If you would like to install python modules via conda, you may load the anaconda module to get access to conda for this purpose. After loading the module you will need to initialize conda to work with your shell.
+If you would like to install packages via conda, you may load the module for the version you prefer (anaconda, miniconda, mamba) to get access to conda commands. After loading the module you will need to initialize conda to work with your shell.
 <code>
-module load anaconda    # miniconda and mamba are also available
+# miniconda and mamba are also available
+module load anaconda
 conda init
 </code>
 This will ask you what shell you are using, and after it is done it will ask you to log out and back in again to load the conda environment. After you log back in your command prompt will look different than it did before. It should now have (base) on the far left of your prompt. This is the virtual environment you are currently in. Since you do not have permissions to modify base, you will need to create and activate your own virtual environment to build your software inside of.
 <code>
-conda create --name myenv
+# to create in default location (~/.conda/envs)
-conda activate myenv
+conda create -n ENVNAME
+conda activate ENVNAME
+# to create in custom location (only do this if you have a reason to)
+conda create -n ENVNAME -p /path/to/location
+conda activate /path/to/location
 </code>
-Now instead of (base) it should say (myenv) or whatever you have named your environment in the create step. These environments are stored in your home directory so they are unique to you. If you are working together with a group, everyone in your group will either need a copy of the environment you've built in $HOME/.conda/envs/
+Now instead of (base) it should say (ENVNAME). These environments are stored in your home directory so they are unique to you. If you are working together with a group, see the sections below about rebuilding or moving an environment, or if you have shared storage read the section about creating single environments in a different folder and moving the default conda install directory and choose the solution that is best for your team.
 \\
 Once you are inside your virtual environment you can run whatever conda installs you would like and it will install them and dependencies inside this environment. If you would like to execute code that depends on the modules you install you will need to be sure that you are inside your virtual environment. (myenv) should be shown on your command prompt, if it is not, activate it with `conda activate`.
+=== - Rebuilding or Moving Conda Environments ===
+The recommended method for moving an environment to a new location is to save its configuration and rebuild it in the new location, so the instructions for both processes are the same.
+In order to create a configuration file for a Conda environment, run the following commands:
+<code>
+# Activate the env you wish to export
+conda activate ENVNAME
+# Export the configuration
+conda env export > ENVNAME.yml
+</code>
+If you are simply moving to a new system,copy the file and rebuild the env.
+<code>
+conda env create -f ENVNAME.yml
+</code>
+If you need to specify a location for just this one env, you can specify a prefix.
+<code>
+conda env create -f ENVNAME.yml -p /path/to/install/location/
+</code>
+=== - Moving Env's by Moving the Default Conda Install Directory ===
+If you want to permanently change the conda install directory, you need to generate a .condarc file and tell conda where it needs to install your environments from now on. The paths you specify should point to folders.
+**If you are intending for all lab members to install env's in shared storage, each member will need to generate the .condarc file and set the paths for their own Conda configuration**
+<code>
+# Generate .condarc
+conda config
+# Add new package install directory
+conda config --add pkgs_dirs /full/path/to/pkgs/
+# Add new env install directory
+conda config --add envs_dirs /full/path/to/envs/
+</code>
+You can check your configuration by making sure these new paths are listed first in their respective fields when you run:
+<code>
+conda info
+</code>
+You may also need to temporarily rename your original conda folder so that your new environments can have the same name as the old ones.
+<code>
+## Remember to delete conda-old once you have verified
+## that the new env's work properly, otherwise you are
+## not saving space!
+mv ~/.conda ~/conda-old
+</code>
+Now you can reinstall the environments as usual, but they will be stored in the new location.
+<code>
+conda env create -f ENVNAME.yml
+</code>
+Because we updated the paths earlier you can still activate your environments like normal even though the location has changed.
 === - Using Conda Envs With Jupyter in OpenOnDemand ===

User Tools

Differences

Page Tools

IT Research Support Solutions Wiki

Site Tools