Articles producció científica> Enginyeria Informàtica i Matemàtiques

Triggerflow: Trigger-based orchestration of serverless workflows

  • Identification data

    Identifier: imarina:9218782
    Authors:
    Arjona ALópez PGSampé JSlominski AVillard L
    Abstract:
    As more applications are being moved to the Cloud thanks to serverless computing, it is increasingly necessary to support the native life cycle execution of those applications in the data center. But existing cloud orchestration systems either focus on short-running workflows (like IBM Composer or Amazon Step Functions Express Workflows) or impose considerable overheads for synchronizing massively parallel jobs (Azure Durable Functions, Amazon Step Functions). None of them are open systems enabling extensible interception and optimization of custom workflows. We present Triggerflow: an extensible Trigger-based Orchestration architecture for serverless workflows. We demonstrate that Triggerflow is a novel serverless building block capable of constructing different reactive orchestrators (State Machines, Directed Acyclic Graphs, Workflow as code, Federated Learning orchestrator). We also validate that it can support high-volume event processing workloads, auto-scale on demand with scale down to zero when not used, and transparently guarantee fault tolerance and efficient resource usage when orchestrating long running scientific workflows.
  • Others:

    Author, as appears in the article.: Arjona A; López PG; Sampé J; Slominski A; Villard L
    Department: Enginyeria Informàtica i Matemàtiques
    URV's Author/s: Arjona Perez, Aitor
    Keywords: Serverless Orchestration Event-based Engine serverless orchestration
    Abstract: As more applications are being moved to the Cloud thanks to serverless computing, it is increasingly necessary to support the native life cycle execution of those applications in the data center. But existing cloud orchestration systems either focus on short-running workflows (like IBM Composer or Amazon Step Functions Express Workflows) or impose considerable overheads for synchronizing massively parallel jobs (Azure Durable Functions, Amazon Step Functions). None of them are open systems enabling extensible interception and optimization of custom workflows. We present Triggerflow: an extensible Trigger-based Orchestration architecture for serverless workflows. We demonstrate that Triggerflow is a novel serverless building block capable of constructing different reactive orchestrators (State Machines, Directed Acyclic Graphs, Workflow as code, Federated Learning orchestrator). We also validate that it can support high-volume event processing workloads, auto-scale on demand with scale down to zero when not used, and transparently guarantee fault tolerance and efficient resource usage when orchestrating long running scientific workflows.
    Thematic Areas: Software Saúde coletiva Medicina ii Medicina i Matemática / probabilidade e estatística Interdisciplinar Hardware and architecture Engenharias iv Engenharias iii Engenharias i Comunicação e informação Computer science, theory & methods Computer networks and communications Ciências sociais aplicadas i Ciências biológicas ii Ciências biológicas i Ciência da computação
    licence for use: https://creativecommons.org/licenses/by/3.0/es/
    Author's mail: aitor.arjona@urv.cat aitor.arjona@urv.cat
    Author identifier: 0000-0001-5451-4865 0000-0001-5451-4865
    Record's date: 2024-07-27
    Papper version: info:eu-repo/semantics/publishedVersion
    Link to the original source: https://www.sciencedirect.com/science/article/pii/S0167739X21001989?via%3Dihub
    Licence document URL: https://repositori.urv.cat/ca/proteccio-de-dades/
    Papper original source: Future Generation Computer Systems-The International Journal Of Escience. 124 215-229
    APA: Arjona A; López PG; Sampé J; Slominski A; Villard L (2021). Triggerflow: Trigger-based orchestration of serverless workflows. Future Generation Computer Systems-The International Journal Of Escience, 124(), 215-229. DOI: 10.1016/j.future.2021.06.004
    Article's DOI: 10.1016/j.future.2021.06.004
    Entity: Universitat Rovira i Virgili
    Journal publication year: 2021
    Publication Type: Journal Publications
  • Keywords:

    Computer Networks and Communications,Computer Science, Theory & Methods,Hardware and Architecture,Software
    Serverless
    Orchestration
    Event-based
    Engine
    serverless
    orchestration
    Software
    Saúde coletiva
    Medicina ii
    Medicina i
    Matemática / probabilidade e estatística
    Interdisciplinar
    Hardware and architecture
    Engenharias iv
    Engenharias iii
    Engenharias i
    Comunicação e informação
    Computer science, theory & methods
    Computer networks and communications
    Ciências sociais aplicadas i
    Ciências biológicas ii
    Ciências biológicas i
    Ciência da computação
  • Documents:

  • Cerca a google

    Search to google scholar