Engineering Swarm Intelligence for the self-organized scheduler in ACES EMDCs

What is a swarm? A swarm is a group that solves a common problem by emergent behavior. In doing so, swarm participants work together without a central commander, following only their own simple rules. With this behavior, they show advantages in robustness, scalability and adaptability.

Together they are stronger. An individual ant would hardly stand a chance of surviving alone. However, they come together to form ant colonies consisting of thousands or even millions of ants. Each ant in the colony knows exactly what to do, whether it is collecting food, building nests, defending the colony against enemies, or caring for the queens and their offspring. Ants do not need leaders; they follow their own rules. For example, if an ant discovers food, it quickly returns to the nest and brings reinforcements. It leaves a scent trail for others to follow, leading them directly to the source of food.In the world of fish, the swarm is also a successful model: about a quarter of all fish species spend their entire lives in a school. In a school, individual fish are much better protected against predators. When fish move in a school, they follow simple rules: follow the fish next to you, stay close, but not too close.

Use swarms for optimizing technical systems. The concept of swarm intelligence is likely to be adapted in technical systems of various kinds. The increased complexity in our systems asks for a self-organized way to handle individual, interacting components. When selecting a swarm member, the members should be understandable/plausible to enable trust in the proposed solution.

Criteria for swarm members:

  • Should be “many”, similar entities
  • Have to be able to take decisions
  • Must be able to detect (dynamic) data from the (local) environment
  • React to information from local neighborhoods

When individuals interact with one another and/or their environment following defined rules, they can display collective behavior that effectively solves complex tasks. Systems engineered with the principles of swarm intelligence typically showcase distinct characteristics, including parallel and distributed processing and control, scalable performance, adaptability to dynamic variations, and resilience to losses and individual component failures.

The self-organized scheduler for the EMDCs in ACES.

In the ACES project, we have exactly the situation that we prefer for engineering a self-organized system: complexity. The foundation of our engineering concept lies in employing swarm agents to represent demand and supply entities. Each incoming microservice/pod shows a demand interest for the resources provided by the EMDC. Thus, they represent the demand swarm agent. Conversely, supply swarm agents are the resources, available from a pool of resources (e.g., CPU cores, GPU cores, RAM and NVM). These agents collaborate within an EMDC environment, orchestrating processes of workload placement.

Decisions are made on two levels: by pods (intra-cluster) and by cluster heads (inter-cluster):

  • INTER CLUSTER LEVEL: Pods request/release resources and balance supply/demand by communication with other pods.
  • INTRA CLUSTER LEVEL: Cluster heads divert a complete pod to another cluster head.

0 Comments

Submit a Comment

Your email address will not be published. Required fields are marked *

Related content

Final Call to Action: Help Us Build Europe’s Autopoietic Edge

Over the past three years, ACES-Autopoietic Cognitive Edge-cloud Services-set out to rethink how Europe processes data where it matters most: at the edge. We’ve...

Dell Technologies: strengthening the Edge Ecosystem through Collaboration and Shared Innovation

As a global provider of digital infrastructure and technology solutions, Dell Technologies actively supports research and innovation ecosystems that advance Europe’s...

The Road to Market: turning ACES Innovation into Real-World Impact

With the ACES project (Autopoietic Cognitive Edge-cloud Services), European research in edge computing has reached a pivotal moment. After years of experimentation and...

Tackling Edge Computing with intelligence and autopoiesis: Challenges and Opportunities for ACES

The computing landscape continues its significant transformation, with Edge Computing solidifying its role as a vital bridge between centralised Cloud platforms and...

The Rise of the Autopoietic Edge: How a Mesh of Micro-Datacenters Is Re-shaping Europe’s Digital Resilience

Looking back Once celebrated for limitless scalability, the promise of the cloud has quietly revealed its fragility. The world’s digital backbone is centralised,...

ACES Stages of Exploitation

The Foundations Exploitation within ACES has been conceived as a progressive path from knowledge creation to market positioning. It aims to transform technical outcomes...