ACES, Edge-native Cloud Infrastructure for Data-Dense Environments and Applications

The continuous increase of data density in organisational, service, and industrial processes in our living and working environments, may draw important and wide-ranging benefits from a powerful edge computing infrastructure that is designed to locally process Big Data and AI. This distributed infrastructure supports the interoperability of applications and platforms that increasingly incorporate autonomous intelligent behaviours and functions. Consequently, the cloud-to-edge (North-South) infrastructure orientation that charted the path into the 4th Industrial revolution is now transforming into an edge-to-edge-to cloud (East-West) infrastructure orientation with an ‘edge-first’ emphasis. 

The management of such an infrastructure follows the same trajectory of development as the applications and platforms it is going to support, e.g. autonomous, ‘edge first’ east-west interoperability and distributed intelligent, and at times emergent, behaviour. 

ACES is building the first generation of an infrastructure management platform for powerful edge as a service (PEaaS). ACES is a performant, low latency and high availability platform leveraging cognitive technology to flexibly orchestrate and arrange clusters of hyperconverged servers in a mesh of compact EdgeMicroDataCenters (EMDC). ACES exhibits a self-orchestrating, self-configuring, self-repairing and self-adjusting intelligence which takes full advantage of the capabilities of Artificial Intelligence, Machine Learning and Swarm Intelligence to run a self-sustaining edge infrastructure. The future-proof design of the intelligence can orchestrate a fully composable data centre, that is a data centre equipped with bleeding-edge hardware, currently being introduced in the market, that relies on PCIe-CXL technology.

ACES autopoiesis framework is a future-proof approach, and already the 1st generation of its platform enables reliable and self-adaptive execution of processing, storage, and networking services at the edge, guaranteeing continuous self-optimizing performance, little to no overprovisioning and underutilization of infrastructure, and reduced data transfer needs. ACES is an important element is the realisation of cost-efficient high-performing edge infrastructures. 

ACES integrates the latest containerisation tool (Kubernetes) complemented with a mix of beyond state-of-the-art swarm technology (emergent intelligence) AI/ML. The swarm is not a typical homogeneous one (large number of elements of the same ‘species’), nor is it relying on the behaviour of one species (birds, ants, etc.). ACES has built a heterogenous custom swarm by combining large numbers of entities from different custom-built species, for each custom-built species the initial implementation cloned and combined the characteristics from multiple well known swarm species. The additional AI/ML is intended to feed the swarm with triggers, tweak the swarm agents, and embed levels of explainability within the swarm behaviour. 

The rationale behind this design is twofold: to overcome the limited responsiveness and flexibility of current orchestration mechanisms, the future of data centres is in composable hardware.

Furthermore, to improve the efficiency of the standard Kubernetes orchestrator under highly dynamically changing workloads, various AI/ML and specific swarm technologies have been deployed. Compared to the standard Kubernetes orchestrator the efficiency improved yet at the same time the studies draw two main conclusions: AI/ML is too slow in grasping the fast-changing dynamics of the workloads, and, although swarm technologies are faster, as yet they do not provide enough flexibility in adaptivity nor was such adaptivity explainable so far. Swarm technologies require a large number of entities in order to work efficiently. The current state of the art for an edge node is a hyperconverged server (CPU, memory) with PCIe attached storage and accelerators. By implementing a dual high-speed fabric (Ethernet and PCIe), the EMDC can dynamically offer any mix of CPU cores (including memory), accelerator and storage to the orchestrator. This capability is unprecedented: with the arrival of PCIe-CXL the individual components in the datacentre become fully disaggregated, creating pools of CPU cores, accelerator cores, RAM, and storage. The ACES orchestrator is now capable of dynamically creating the right hardware configurations for the incoming workloads, and after execution of the workloads it can return individual components to their pools of resources. While not all hardware components are currently CXL capable, the ACES project is already developing the orchestrator for the fully composable datacentre. Especially at the edge, where each EMDC has, despite its high density, limited resources, the composability will allow very high utilization levels and energy efficiency, ultimately leading to cost optimisation of edge infrastructure.

0 Comments

Submit a Comment

Your email address will not be published. Required fields are marked *

Related content

Final Call to Action: Help Us Build Europe’s Autopoietic Edge

Over the past three years, ACES-Autopoietic Cognitive Edge-cloud Services-set out to rethink how Europe processes data where it matters most: at the edge. We’ve...

Dell Technologies: strengthening the Edge Ecosystem through Collaboration and Shared Innovation

As a global provider of digital infrastructure and technology solutions, Dell Technologies actively supports research and innovation ecosystems that advance Europe’s...

The Road to Market: turning ACES Innovation into Real-World Impact

With the ACES project (Autopoietic Cognitive Edge-cloud Services), European research in edge computing has reached a pivotal moment. After years of experimentation and...

Tackling Edge Computing with intelligence and autopoiesis: Challenges and Opportunities for ACES

The computing landscape continues its significant transformation, with Edge Computing solidifying its role as a vital bridge between centralised Cloud platforms and...

The Rise of the Autopoietic Edge: How a Mesh of Micro-Datacenters Is Re-shaping Europe’s Digital Resilience

Looking back Once celebrated for limitless scalability, the promise of the cloud has quietly revealed its fragility. The world’s digital backbone is centralised,...

ACES Stages of Exploitation

The Foundations Exploitation within ACES has been conceived as a progressive path from knowledge creation to market positioning. It aims to transform technical outcomes...