Project Vision

Collecting and analysing large amounts of data in the Cloud-to-Edge computing continuum raises novel challenges. Processing all this data centrally in cloud data centres is not feasible anymore as transferring large amounts of data to the cloud is time-consuming, expensive, degrade performance and may raise security concerns. Therefore, novel distributed computing paradigms, such as edge and fog computing emerged to support processing data closer to its origin. However, such hyper-distributed systems require fundamentally new methods.

To overcome the limitation of current centralised application management approaches, Swarmchestrate will develop a completely novel decentralised application-level orchestrator, based on the notion of self-organised interdependent Swarms. Application microservices are managed in a dynamic Orchestration Space by decentralised Orchestration Agents, governed by distributed intelligence that provides matchmaking between application requirements and resources, and supports the dynamic self-organisation of Swarms. Knowledge and trust, essential for the operation of the Orchestration Space, will be managed through blockchain-based trusted solutions using methods of Self-Sovereign Identities (SSI) and Distributed Identifiers (DID). End-to-end security of the overall system will be assured by utilising state-of-the-art cryptographic algorithms and privacy preserving data analytics.

Due to the imminent complexity of the decentralised system, novel simulation approaches will be developed to test and optimise system behaviour (e.g., energy efficiency) in the early stages of development. Additionally, the simulator will be further extended into a digital twin running in parallel to the physical system and improving its behaviour with predictive feedback. The Swarmchestrate concept will be prototyped on four real life demonstrators from the areas of flood prevention, parking space management, urban noise classification and a digital twin of natural habitat.

Objectives

Develop an application-level decentralised orchestration framework (incorporating compute, data and code), utilising Swarm-based distributed intelligence for highly dynamic and distributed Cloud-to-Edge computing infrastructures.

Dynamically create and manage a set of interconnected Swarms by matching application requirements with resources across the distributed Cloud-to-Edge infrastructure.

Develop matchmaking algorithms using decentralised AI methods that will dynamically pair application requirements with resource characteristics, in order to optimise energy efficiency, resilience and effectiveness of the system.

Develop a trusted, reliable, secure and transparent knowledge management infrastructure.

Develop a simulation environment based on the novel decentralised orchestration concept of the project that will be utilised to measure and finetune the effectiveness of the implemented solutions and algorithms. Additionally, further extend this simulator to be used to create a digital twin of the orchestration solution, supporting the live system by recommending predictive modifications of the system setup and its parameters.

Implement four real-life application demonstrators utilising Swarmchestrate services in realistic scenarios where large amounts of data, collected at the network edges, need to be efficiently processed.