Managing software on ARC - Revision history

Dmitri: /* Getting software centrally installed */

2023-12-11T17:09:52Z

Getting software centrally installed

← Older revision		Revision as of 17:09, 11 December 2023
Line 31:		Line 31:

	It is possible to ask ARC analysts to install a specific software package on ARC centrally, so it will be available for every user.		It is possible to ask ARC analysts to install a specific software package on ARC centrally, so it will be available for every user.
	However, the software has to meet some condition to qualify for central installation:		However, the software has to meet '''some condition''' to qualify for central installation:

	* It has to be of some general interest. If you are the only person who is ever going to use it, it is better to have it installed for yourself only.		* It has to be of '''some general interest'''. If you are the only person who is ever going to use it, it is better to have it installed for yourself only.

	* The software has to be somewhat stable, not under active development. The reason is simple. Once a version of the software is installed it cannot be removed, as it can be used by somebody. Thus, any update, upgrade or new version will have to be installed '''in parallel''' with any existing installation. If you expect to need the software updated in less than a year, it is better not to have it centrally installed. If you install it in your home directory, you will be the owner of the installation and will be able to update it at any time at your convenience.		* The software has to be '''somewhat stable''', not under active development. The reason is simple. Once a version of the software is installed it cannot be removed, as it can be used by somebody. Thus, any update, upgrade or new version will have to be installed '''in parallel''' with any existing installation. If you expect to need the software updated in '''less than a year''', it is better not to have it centrally installed. If you install it in your home directory, you will be the owner of the installation and will be able to update it at any time at your convenience.

	= Installing Software in User's Home Directory =		= Installing Software in User's Home Directory =

Dmitri: /* Environment modules */

2023-12-11T17:09:11Z

Environment modules

← Older revision		Revision as of 17:09, 11 December 2023
Line 27:		Line 27:
	Unlike some clusters, there are no modules loaded by default.		Unlike some clusters, there are no modules loaded by default.
	So, for example, to use '''Intel compilers''', or to use '''Open MPI''' parallel programming, you must load an appropriate module.		So, for example, to use '''Intel compilers''', or to use '''Open MPI''' parallel programming, you must load an appropriate module.

			== Getting software centrally installed ==

			It is possible to ask ARC analysts to install a specific software package on ARC centrally, so it will be available for every user.
			However, the software has to meet some condition to qualify for central installation:

			* It has to be of some general interest. If you are the only person who is ever going to use it, it is better to have it installed for yourself only.

			* The software has to be somewhat stable, not under active development. The reason is simple. Once a version of the software is installed it cannot be removed, as it can be used by somebody. Thus, any update, upgrade or new version will have to be installed '''in parallel''' with any existing installation. If you expect to need the software updated in less than a year, it is better not to have it centrally installed. If you install it in your home directory, you will be the owner of the installation and will be able to update it at any time at your convenience.

	= Installing Software in User's Home Directory =		= Installing Software in User's Home Directory =

Dmitri: /* Activating the software */

2023-11-06T19:52:06Z

Activating the software

← Older revision		Revision as of 19:52, 6 November 2023
Line 156:		Line 156:
	so you can run them all with one command.		so you can run them all with one command.
	For example, if you put all the init work into <code>$HOME/software/init-my-code.sh</code> script, then you can activate your software with		For example, if you put all the init work into <code>$HOME/software/init-my-code.sh</code> script, then you can activate your software with
	$ source $HOME/init-my-code.sh		$ source $HOME/software/init-my-code.sh

	command.		command.

Dmitri: /* Installing Software in User's Home Directory */

2023-11-06T19:48:59Z

Installing Software in User's Home Directory

← Older revision		Revision as of 19:48, 6 November 2023
Line 52:		Line 52:
	If we (analysts) install software centrally, we install it into <code>/global/software</code> shared directory,		If we (analysts) install software centrally, we install it into <code>/global/software</code> shared directory,
	if a user wants to install a software package and manage it on his/her own,		if a user wants to install a software package and manage it on his/her own,
	than it has to be installed into the user's home directory, that is <code>/home/$HOME</code>.		than it has to be installed into the user's home directory, that is <code>/home/$USER</code>, or just <code>$HOME</code>.
	In such cases package managers cannot be used and the software often '''has to be compiled''' on '''ARC''' and		In such cases package managers cannot be used and the software often '''has to be compiled''' on '''ARC''' and
	the '''desired installation location''' has to be specified during the compilation process.		the '''desired installation location''' has to be specified during the compilation process.

Lleung: Removed software category

2023-09-21T17:08:15Z

Removed software category

← Older revision		Revision as of 17:08, 21 September 2023
Line 65:		Line 65:

	* You '''software will be stored''' in the '''software''' subdirectory in your home, you can refer to it as <code>$HOME/software</code> path on the command line.		* You '''software will be stored''' in the '''software''' subdirectory in your home, you can refer to it as <code>$HOME/software</code> path on the command line.


	* The directories for a '''software package of some specific version''' can be installed in a sub-directory named <code>name-version</code>.		* The directories for a '''software package of some specific version''' can be installed in a sub-directory named <code>name-version</code>.
	: For example, if you want to install the version 3.6.2 of GNU R, it can go into the <code>$HOME/software/r-3.6.2</code> sub-directory.		: For example, if you want to install the version 3.6.2 of GNU R, it can go into the <code>$HOME/software/r-3.6.2</code> sub-directory.


	* The '''distribution files and archives''' can be downloaded to the <code>$HOME/software/src/software_name</code> sub-directory.		* The '''distribution files and archives''' can be downloaded to the <code>$HOME/software/src/software_name</code> sub-directory.
Line 197:		Line 195:

	== Apptainer / Singularity ==		== Apptainer / Singularity ==

	* On-line Tutorial: https://singularity-tutorial.github.io/		* On-line Tutorial: https://singularity-tutorial.github.io/


	* [[How to convert a Docker container to an Apptainer container]].		* [[How to convert a Docker container to an Apptainer container]].

	~~= Links =~~
	~~[[RCS Home Page \| Main page]]~~

	[[Category:ARC]]		[[Category:ARC]]
	~~[[Category:Software]]~~
	[[Category:Guides]]		[[Category:Guides]]

	{{Navbox ARC}}		{{Navbox ARC}}
	~~{{Navbox Software}}~~

Lleung: Added guides category

2023-09-21T16:19:33Z

Added guides category

← Older revision		Revision as of 16:19, 21 September 2023
Line 208:		Line 208:
	[[Category:ARC]]		[[Category:ARC]]
	[[Category:Software]]		[[Category:Software]]
			[[Category:Guides]]

	{{Navbox ARC}}		{{Navbox ARC}}
	{{Navbox Software}}		{{Navbox Software}}

Lleung: Added navbox

2023-09-20T22:27:29Z

Added navbox

← Older revision		Revision as of 22:27, 20 September 2023
Line 208:		Line 208:
	[[Category:ARC]]		[[Category:ARC]]
	[[Category:Software]]		[[Category:Software]]

			{{Navbox ARC}}
			{{Navbox Software}}

Dmitri: /* Using Conda */

2023-09-12T20:14:56Z

Using Conda

← Older revision		Revision as of 20:14, 12 September 2023
Line 162:		Line 162:
	command.		command.

	= ~~Using~~ Conda =		= Installing software via Conda =

	Many software packages today are available via '''Conda''' repositories.		Many software packages today are available via '''Conda''' repositories.
Line 170:		Line 170:

	* Then, can follow the software installation manual on how to install it using the '''Conda''' option.		* Then, can follow the software installation manual on how to install it using the '''Conda''' option.


	= Containers =		= Containers =

Dmitri: /* Containers */

2023-09-12T20:14:21Z

Containers

← Older revision		Revision as of 20:14, 12 September 2023
Line 161:		Line 161:

	command.		command.

			= Using Conda =

			Many software packages today are available via '''Conda''' repositories.
			'''Conda''' is a general purpose software package manager and can be used to conveniently install software that offer this option.

			* First, you have to install your own '''Conda''' following this article, [[Conda on ARC]].

			* Then, can follow the software installation manual on how to install it using the '''Conda''' option.


	= Containers =		= Containers =

Dmitri: /* Apptainer / Singularity */

2023-09-12T20:10:04Z

Apptainer / Singularity

← Older revision		Revision as of 20:10, 12 September 2023
Line 190:		Line 190:

	* On-line Tutorial: https://singularity-tutorial.github.io/		* On-line Tutorial: https://singularity-tutorial.github.io/


			* [[How to convert a Docker container to an Apptainer container]].

	= Links =		= Links =