RCS Summer School 2024: Difference between revisions
No edit summary |
|||
Line 80: | Line 80: | ||
|- | |- | ||
!1:30 PM | !1:30 PM | ||
|'''[[RCS Summer School 2024#AWS|AWS: Inspiring the art of the possible]]'''<br>ICT 102, 1:30 PM - | |'''[[RCS Summer School 2024#AWS|AWS: Inspiring the art of the possible]]'''<br>ICT 102, 1:30 PM - 2:00 PM<br>Patrick Colucci | ||
| | | | ||
| | | | ||
|- | |- | ||
!2:00 PM | !2:00 PM | ||
|[[RCS Summer School 2024#AWS|'''AWS: How AWS works with Researchers''']]<br>ICT 102, 2:00 PM - 2: | |[[RCS Summer School 2024#AWS|'''AWS: How AWS works with Researchers''']]<br>ICT 102, 2:00 PM - 2:30 PM<br>Jessica Steed & Hatem Siyala | ||
| | | | ||
| rowspan="3" |'''[[RCS Summer School 2024#Reproducible Data Management with Datalad|Reproducible Data Management with Datalad: Part II]]<br>'''ICT 102, 2:30 PM - 3:20 PM<br>David Deepwell | | rowspan="3" |'''[[RCS Summer School 2024#Reproducible Data Management with Datalad|Reproducible Data Management with Datalad: Part II]]<br>'''ICT 102, 2:30 PM - 3:20 PM<br>David Deepwell | ||
Line 91: | Line 91: | ||
|- | |- | ||
!2:30 PM | !2:30 PM | ||
| rowspan="5" |'''[[RCS Summer School 2024#AWS|AWS: Machine Learning with low-code workshop]]'''<br>ICT 102, 2:30 PM - | | rowspan="5" |'''[[RCS Summer School 2024#AWS|AWS: Machine Learning with low-code workshop]]'''<br>ICT 102, 2:30 PM - 5:00 PM<br>Abhi Sodhani | ||
| rowspan="4" |'''[[RCS Summer School 2024#Data in Motion: Navigating Storage Solutions for Active Research Data|Data in Motion: Navigating Storage Solutions for Active Research Data]]<br>'''ICT 102, 2:30 AM - 4:20 AM<br>Ian Percel, Jennifer Abel, Alex Thistlewood | | rowspan="4" |'''[[RCS Summer School 2024#Data in Motion: Navigating Storage Solutions for Active Research Data|Data in Motion: Navigating Storage Solutions for Active Research Data]]<br>'''ICT 102, 2:30 AM - 4:20 AM<br>Ian Percel, Jennifer Abel, Alex Thistlewood | ||
| | | | ||
Line 305: | Line 305: | ||
====AWS: Inspiring the art of the possible==== | ====AWS: Inspiring the art of the possible==== | ||
<span id="AWS"></span> | <span id="AWS"></span> | ||
|June 11, 1: | |June 11, 1:30 PM - 2:00 PM | ||
ICT 102 | ICT 102 | ||
|Learn what is possible on AWS Cloud for research. | |Learn what is possible on AWS Cloud for research. | ||
Line 316: | Line 316: | ||
! | ! | ||
====AWS: How AWS works with Researchers==== | ====AWS: How AWS works with Researchers==== | ||
|June 11, 2: | |June 11, 2:00 PM - 2:30 PM | ||
ICT 102 | ICT 102 | ||
| AWS has many programs to support researchers such as credits, letter of supports, immersion days, working on proof of concepts. In this session, we will cover how we engage with researchers and what programs are out there to help accelerate your research with the AWS Cloud. | | AWS has many programs to support researchers such as credits, letter of supports, immersion days, working on proof of concepts. In this session, we will cover how we engage with researchers and what programs are out there to help accelerate your research with the AWS Cloud. | ||
Line 327: | Line 327: | ||
! | ! | ||
====AWS: Machine learning with low-code workshop==== | ====AWS: Machine learning with low-code workshop==== | ||
|June 11, 2:30 PM - 5: | |June 11, 2:30 PM - 5:00 PM | ||
ICT 102 | ICT 102 | ||
| The Machine Learning (ML) journey requires continuous experimentation and rapid prototyping to be successful. In order to create highly accurate and performant models, data scientists have to first experiment with feature engineering, model selection and optimization techniques. These processes are traditionally time consuming and expensive. | | The Machine Learning (ML) journey requires continuous experimentation and rapid prototyping to be successful. In order to create highly accurate and performant models, data scientists have to first experiment with feature engineering, model selection and optimization techniques. These processes are traditionally time consuming and expensive. |
Revision as of 19:21, 24 May 2024
Research Computing Services' 3rd annual summer school offers a handful of courses with a wide range of topics to help empower your research. We will cover topics including Linux/Slurm, ARC/HPC, Research Data Management (RDM) and Data Management Plan (DMP), working with research software and workflows, plus much more. The sessions and workshops is available from introductory to intermediate levels and is suitable for everyone interested in research in HPC.
The summer school will run from Monday, June 10 through to Wednesday, June 12, 2024 from 9AM to 5PM. This 3 day event is completely free to all University of Calgary members.
Registration
Registration is required to attend the RCS Summer School sessions. Registration is free to all members of the University of Calgary only.
There will be a limit of approximately 100 seats. If you are unable to attend after registering, please cancel/modify your registration or notify us via email.
Schedule
The summer school sessions will be held in ICT 102 and ICT 114. Refreshments will be available in ICT 114 on all 3 days.
Time | June 10 | June 11 | June 12 | |||
---|---|---|---|---|---|---|
Track 1 | Track 2 | Track 1 | Track 2 | Track 1 | Track 2 | |
8:30 AM | Registration & check-in ICT 102 |
Registration & check-in ICT 102 |
Registration & check-in ICT 102 | |||
9:00 AM | Introduction to the Summer School & RCS ICT 102, 9:00 AM - 9:20 AM Jill Kowalchuk |
Refreshments ICT 114 |
The Alliance: An Introduction ICT 102, 9:00 AM - 9:20 AM Brock Kahanyshyn |
Refreshments ICT 114 |
Introduction to containers with Apptainer ICT 102, 9:00 AM - 9:50 AM Tannistha Nandi |
Fast Dataframes with Polars on Python ICT 114, 9:00 AM - 9:50 AM Dave Schulz |
9:30 AM | Introduction to Linux, Bash, and the command line ICT 102, 9:30 AM - 10:30 AM Robert Fridman |
Accelerate data science workflows with NVIDIA RAPIDS ICT 114, 9:30 AM - 11:50 AM Tarini Bhatnagar |
Introduction to HPC resources ICT 102, 9:30 AM - 10:20 AM Robert Fridman, Dave Schulz |
Prefect for Research Workflow Development ICT 114, 9:30 AM - 11:00 AM Pedro Martinez | ||
10:00 AM | Managing scientific software with Conda ICT 102, 10:00 AM - 10:50 AM Dmitri Rozmanov |
Refreshments ICT 114 | ||||
10:30 AM | Hands on with Linux & Slurm ICT 102, 10:30 AM - 11:50 AM Robert Fridman |
Linux tools & utilities for working with large data sets ICT 102, 10:30 AM - 11:20 AM Leo Leung, Dave Schulz |
||||
11:00 AM | Refreshments ICT 114 |
Reproducible Data Management with Datalad: Part I ICT 114, 11:00 AM - 11:50 AM David Deepwell |
||||
11:30 AM | RCS Q&A period: Ask RCS anything ICT 102, 11:30 AM - 12:00 PM RCS Team |
|||||
12:00 PM | Lunch break 12:00 PM - 1:00 PM |
Lunch break 12:00 PM - 1:00 PM |
Lunch break 12:00 PM - 1:00 PM | |||
12:30 PM | ||||||
1:00 PM | Open OnDemand on ARC ICT 102, 1:00 PM - 1:20 PM Leo Leung |
Refreshments ICT 114 |
Research Data Management and Data File Management ICT 102, 1:00 PM - 2:20 PM Ingrid Reiche, Jennifer Abel, Alex Thistlewood |
Refreshments ICT 114 |
Dell & AMD: Machine learning with Dell & AMD ICT 102, 1:00 PM - 1:50 PM Rob Lucas |
Refreshments ICT 114 |
1:30 PM | AWS: Inspiring the art of the possible ICT 102, 1:30 PM - 2:00 PM Patrick Colucci |
|||||
2:00 PM | AWS: How AWS works with Researchers ICT 102, 2:00 PM - 2:30 PM Jessica Steed & Hatem Siyala |
Reproducible Data Management with Datalad: Part II ICT 102, 2:30 PM - 3:20 PM David Deepwell |
||||
2:30 PM | AWS: Machine Learning with low-code workshop ICT 102, 2:30 PM - 5:00 PM Abhi Sodhani |
Data in Motion: Navigating Storage Solutions for Active Research Data ICT 102, 2:30 AM - 4:20 AM Ian Percel, Jennifer Abel, Alex Thistlewood |
||||
3:00 PM | ||||||
3:30 PM | End of day: 3:30 PM | |||||
4:00 PM | ||||||
4:30 PM | End of day: 4:30 PM | |||||
5:00 PM | End of day: 5:00 PM |
Sessions
Session | Time and Location | Synopsis |
---|---|---|
Introduction to the Summer School & RCS |
June 10, 9:00AM - 9:20AM
ICT 102 |
We will begin the RCS summer school with a quick introduction by Jill Kowalchuk, the Interim director of Research Computing Services. We will introduce the RCS team, provide a high level overview of our services, and how to get help and support from our analysts.
|
Introduction to Linux, Bash, and the command line |
June 10, 9:30AM - 10:30AM
ICT 102 |
This course provides you with essential skills to effectively use the Linux command line. We will go over from ground up how to log-in and interact with our HPC cluster, traverse the filesystem, execute programs, and manage files.
This beginner friendly session requires no prior experience to Linux. We recommend bringing your own device to follow along. By the end of the course, you should be familiar with what is possible with the Linux command line.
|
Workshop: Hands on with Linux & Slurm |
June 10, 10:30AM - 11:50 AM
ICT 102 |
This follow-up workshop comes immediately after the Introduction to Linux session. We will build on what we learned in the previous session and go into details on how to use the HPC cluster using the Slurm scheduler.
This workshop will provide you with the skills necessary to write a simple Slurm batch script, submit jobs to Slurm, view and manage your jobs. By the end of the course, you will be familiar with what Slurm is, how it fits in in a HPC environment, and how to start using Slurm on our HPC clusters for your research. This is a beginner friendly workshop. You should be familiar with the Linux command line. We recommend bringing your own device to follow along.
|
Open OnDemand on ARC |
June 10, 1:00 PM - 1:20 PM
ICT 102 |
Did you know you can run a Linux desktop and graphical tools on ARC? This session will cover what ARC Open OnDemand is and how it may help with your research. We will show you how to:
By the end of this session, you will be familiar with the options available on Open OnDemand and be able to start graphical sessions through this service. This is a beginner friendly workshop and no prior experience is necessary. We recommend bringing your own device to follow along.
|
|
June 12, 2:30 AM - 4:20 AM
ICT 102 |
Planning for and requesting specialized storage for large research projects can be a daunting proposition. The variety of storage options and the expected justifications for allocations locally to UCalgary, at national supercomputing sites, and in the public cloud can quickly become overwhelming. This talk aims to provide an introduction to the cost/benefit tradeoff in using different storage systems, when to reach out to different support services around the university for help in making critical decisions, and basic techniques for providing a quantitative justification for a storage request.
By the end of the session, you will be familiar with the types of storage related questions that should be answered when tackling large research projects and the different types of solutions that the University offers our researchers.
|
Reproducible Data Management with Datalad |
Part I: June 12, 11:00 AM - 11:50 AM
Part II: June 12, 2:30 PM - 3:20 PM ICT 102 |
Data management and research data is critical to research. This is a two part workshop that introduces you to DataLad, a digital data management system based on the Git version control system.
Content to be covered in the two-part session includes:
Background content will be covered before conducting the primary hands-on training where attendees will create a small demonstrative research project containing data provenance. Although no git knowledge is required, familiarity with git is strongly advised. Command line experience is required.
|
Introduction to HPC resources |
June 11, 9:30AM - 10:20AM
ICT 102 |
This session is a primer for those new to high performance computing (HPC) or computing on remote resources. We will build on the foundations built from our previous Linux and Slurm introductory sessions and expand on the larger picture, including:
|
Linux tools & utilities for working with large data sets |
June 11, 10:30AM - 11:20AM
ICT 102 |
This session introduces more intermediate to advanced uses of the Linux environment for handling large data sets. The course will demonstrate the power of shell pipes and how you can work with large datasets with just standard Linux tools and utilities that is built-in to the system.
We will cover some common use cases including:
This is an intermediate course. You should be familiar with the Linux command line and some common Linux utilities prior to the course. Some understanding of regular expressions may be useful.
|
RCS Q&A period: Ask RCS anything |
June 11, 11:30AM - 12:00PM
ICT 102 |
This is a general question and answers period where you may ask the Research Computing Services team questions related to RCS and HPC. You may ask both technical and non-technical questions.
|
Research Data Management and Data File Management |
June 11, 1:00PM - 2:20PM
ICT 102 |
Managing your digital files and research materials is critical for keeping yourself organized, collaborating, and communicating with colleagues. In this session, we will cover Research Data Management (RDM) and Data Management Plan (DMP). We will also go over best practices in digital file management depending on your individual and organizational needs.
This presentation will also discuss best practices, versioning, and how to document and share your file and folder convention using a README file. By the end of this session, you should be familiar with RDM and DMP concepts to help keep your research materials organized.
|
Introduction to containers with Apptainer |
June 12, 9:00AM - 9:50PM
ICT 102 |
Reproducible research workflows is essential for repeatability. This session will cover the basics of using containers with Apptainer, a secure container technology designed to be used on for high performance compute clusters. We will cover:
The instructor for this session will be remote and will be streamed in ICT 102. We will provide a zoom link for those who wishes to attend virtually.
|
Managing scientific software with Conda |
June 12, 10:00 AM - 10:50 AM
ICT 102 |
Running customized scientific software on a shared HPC environment may be challenging. This session, we will go over how to set up customized software environments using Conda.
|
Prefect for Research Workflow Development |
June 11, 9:30 AM - 11:00 AM
ICT 114 |
Modernize your research workflows using Prefect, an open source workflow orchestration tool. In this session we will cover some of the fundamentals of building workflows with Prefect, with examples on how to deploy Prefect on local and distributed computing infrastructure.
|
AWS: Inspiring the art of the possible |
June 11, 1:30 PM - 2:00 PM
ICT 102 |
Learn what is possible on AWS Cloud for research.
|
AWS: How AWS works with Researchers |
June 11, 2:00 PM - 2:30 PM
ICT 102 |
AWS has many programs to support researchers such as credits, letter of supports, immersion days, working on proof of concepts. In this session, we will cover how we engage with researchers and what programs are out there to help accelerate your research with the AWS Cloud.
|
AWS: Machine learning with low-code workshop |
June 11, 2:30 PM - 5:00 PM
ICT 102 |
The Machine Learning (ML) journey requires continuous experimentation and rapid prototyping to be successful. In order to create highly accurate and performant models, data scientists have to first experiment with feature engineering, model selection and optimization techniques. These processes are traditionally time consuming and expensive.
In this workshop attendees will learn the following:
|
Accelerate data science workflows with NVIDIA RAPIDS |
June 10, 9:30 AM - 11:50 AM
ICT 114 |
Unlock the power of GPU acceleration for your data science projects in our hands-on workshop. This session is designed to introduce participants to NVIDIA RAPIDS, a suite of open-source software libraries and APIs built on CUDA. RAPIDS enables data scientists and analysts to execute end-to-end data science and analytics pipelines entirely on GPUs, significantly speeding up workflows.
In this interactive session, we will:
By the end of this session, you will have the basic practical skills necessary to start using RAPIDS for GPU-accelerated research work on our HPC infrastructure.
|
Dell Presentation: TBD |
June 12, 1:00 PM - 1:50 PM
ICT 102 |
TBD
|
Fast Dataframes with Polars on Python | June 12, 9:00 AM - 9:50 AM
ICT 114 |
Have you used Pandas Dataframes with Python and are unhappy with the performance? Can't seem to figure out Pandas' indexing? In this session, we will go over using fast dataframes with Polars.
Polars dataframe features:
By the end of this session, you'll have the basic skills to leverage Polars in your Python workflows.
|
Frequently Asked Questions
- Can I attend this event remotely?
- We are only offering these sessions in-person on the specified dates in ICT 102 and ICT 114.
- Will there be recordings made available afterwards?
- The sessions will not be recorded.
- Can I forward this invitation to others?
- You are welcome to forward this invite to any faculty, staff, and students at the University of Calgary.
- I am only interested in one of the sessions in the morning/afternoon period. Can I drop in at anytime to these sessions?
- You may show up to only the session that interests you, but we ask that you register for the entire morning/afternoon session that covers the session you are interested in.
- Will there be any free food?
- We will be providing snacks and refreshments during this event. There will be gluten-free and vegetarian options.
- What happens if there is no more seats available?
- We will be offering up to 100 seats for this session. We may be able to raise this depending on the interest in the sessions. If you are interested in joining a session that has filled, please join the waiting list when ordering the ticket and reach out to us for options.
- I have more questions. Who do I contact?
- Please reach out to the Research Computing Services team at support [at] hpc.ucalgary.ca.