EcoCommons’ use of data and the Nextflow computational pipeline for running reproducible workflows on the cloud

Mr Arve Solland1

1Griffith University, Nathan, Australia

The EcoCommons platform aims to significantly reduce the time and wrangling needed to get from data to high-impact results that inform decisions that are good for the environment. The EcoCommons Program is building a platform that provides an open, extendable and reusable eResearch Services infrastructure for use by researchers and policy decision-makers.

Right at the heart of EcoCommons are data – and the tools that have been developed to interact with these data.

At EcoCommons, we use the Nextflow computational pipeline ( http://nextflow.io/ ) in order to offer users the ability to design and run scalable and reproducible workflows in a secure cloud environment.

Nextflow provides an abstraction layer between the pipeline logic and the execution layer, so that it can be executed repeatedly on multiple platforms and without the need to make any changes. It supports Docker and Singularity container technology to provide pre-defined environments for your functions. You can choose to write self-contained pipelines and manage versions in order to rapidly reproduce any configuration within the environment that you are working in.

In this talk we will explore how EcoCommons is using data to provide access to intricate analytics, and how Nextflow is used to run species distribution models and other complex workflows on EcoCommons. We will summarise the benefits of running the workflows on our platform.


Biography:

Arve joined EcoCommons in May 2020 as the Technical Lead and Solutions Architect after spending more than a decade working across a range of national, and international research projects within the eResearch sector as a senior software engineer and analyst.

Date

Oct 13 2021
Expired!

Time

12:40 pm - 1:00 pm

Local Time

  • Timezone: America/New_York
  • Date: Oct 12 2021
  • Time: 9:40 pm - 10:00 pm