A DSL for data-driven computational pipelines

a pytorch lib with state-of-the-art architectures, pretrained models and real-time updated results

Tools for computation on batch systems

R package to send function calls as jobs on LSF, SGE, Slurm, PBS/Torque, or each via SSH

🚀 R package future.batchtools: A Future API for Parallel and Distributed Processing using batchtools

EnsEMBL Hive - a system for creating and running pipelines on a distributed compute resource

qtop (pronounced queue-top) is a tool written in order to monitor the state of Queueing Systems, along with related information relevant on HPC & grid clusters. At present it supports **PBS, SGE & OAR** families. There is a historic reference for the prior shell version of the tool, at former CERN source:

An easy to use and comprehensive python package which aids in the analysis and visualization of orthologous genes. 🐵

An information-theoretic pipeline for methylation analysis of WGBS data

IBM LSF manual translation and practical experience

Module to create DAG Task and Manage Task on SGE

Simple HPC queuing system adapter for Python on based jinja templates to automate the submission script creation.

Intro how to install and use SGE(Sun Grid Engine) on ConteOS 7

Longbow is a tool for automating simulations on a remote HPC machine. Longbow is designed to mimic the normal way an application is run locally but allows simulations to be sent to powerful machines.

parse Grid Engine qstat job info list into a list of python dicts

Utilities to support interacting with multiple HPC clusters

xGAP is an efficient, modular, extensible and fault-tolerant pipeline for massively parallelized genomic analysis/variant discovery from next-generation DNA sequencing data.

🚀 R package future.clustermq: A Future API for Parallel Processing using 'clustermq'

runjob is a program for managing a group of related jobs running on a compute cluster

🚀 R package: future.BatchJobs: A Future API for Parallel and Distributed Processing using BatchJobs [Intentionally archived on CRAN on 2021-01-08]