Online workflow code-along: Intro to Snakemake

New Zealand eScience Infrastructure(NeSI) designs, builds, and operates a shared national platform of advanced computing resources and data services. All researchers in Aotearoa New Zealand have access to NeSI’s platforms. Through NeSI, researchers can access high-capacity CPUs, GPUs and high memory nodes; tailored software environments; expertise in research software and data science engineering; and skills training in computational  tools and approaches. NeSI enables researchers to investigate large, unique, or complex projects more easily, quickly, and accurately.  To learn more, get in touch: info@nesi.org.nz.

New Zealand eScience Infrastructure (NeSI)

In this hands-on, online workshop you will explore what it takes to automate your workflow with Snakemake

Ticket sales have ended for this workshop. Please email training@nesi.org.nz for any further assistance.

Automate Your Workflow With SnakemakeAre you working with big data? Do you need to pass your data through various software? Oh wait! Have I updated this output file?If you’ve ever been in this situation, you would know that it can become quite difficult to maintain consistency and accuracy. The more manual steps we execute, the more human errors that are inevitably introduced into our analysis - hampering accuracy and reproducibility.Sit back and let the machines do their magic.Workflow languages automate your data analysis workflow. They also ensure that all your analysis logs are captured in an organized fashion, explicitly outline the software used, capture the input and output files at each step and even allow you to restart the pipeline from where it errored out. The process ensures higher productivity and decreases loss of resources re-running your workflow from the start. Additionally, when your data inevitably becomes big data, workflow languages allow you to easily scale up - meaning, you can move your analysis to a high performance cluster (HPC) without stress!In this hands-on workshop, ESR’s Leah Kemp and the NeSI team will guide you through an introduction to Snakemake, a workflow language with its basis in the popular programming language, Python. Attendees can expect to learn:<ul><li>The benefits of using Snakemake or other workflow languages,</li><li>How to create a workflow to organize your computations, and</li><li>How an HPC scheduler (such as Slurm) fits into your workflow </li></ul>Who Should AttendThis Workshop is intended for anyone who has several steps in their data analysis workflow. It is a hands-on workshop, meaning you will be coding along with Leah and the NeSI team.Here&#x27;s a sneak-peak of what to expect from this workshop (content is subject to revisions):<a href="https://tinyurl.com/snakemakeworkshop" target="_blank" data-msys-clicktrack="0" rel="nofollow noopener noreferrer"> https://tinyurl.com/snakemakeworkshop</a>SetupThis is an online workshop that will use <a href="https://jupyter.nesi.org.nz" target="_blank" data-msys-clicktrack="0" rel="nofollow noopener noreferrer">Jupyter on NeSI</a>. Attendees will be required to set up an account on NeSI in order to participate. Full instructions will be sent to registrants closer to the time of the workshop. If you have any questions or would like more information about this session, please email training@nesi.org.nz<a href="https://nesi.github.io/snakemake_workshop/workshop_material/01_introduction.html" target="_blank" data-msys-clicktrack="0" rel="nofollow noopener noreferrer"></a><ul><h2></h2></ul>

Our {communityGuidelinesLink} describe the sort of content we prohibit on Eventbrite. If you suspect an event may be in violation, you can report it to us so we can investigate.

To report other categories of prohibited or illegal content, submit {link}

Ticket sales have ended

Online workflow code-along: Intro to Snakemake

More events from New Zealand eScience Infrastructure (NeSI)

Discover more events from New Zealand eScience Infrastructure (NeSI), from Science & Tech to other experiences you might love.

Ticket sales have ended

Online workflow code-along: Intro to Snakemake

More events from New Zealand eScience Infrastructure (NeSI)

Discover more events from New Zealand eScience Infrastructure (NeSI), from Science & Tech to other experiences you might love.

You might also like...

Browse more events with different dates, prices, and formats to find your next great experience.