{"id":2947,"date":"2025-10-29T13:19:42","date_gmt":"2025-10-29T13:19:42","guid":{"rendered":"https:\/\/spice-platform.eu\/?page_id=2947"},"modified":"2025-10-29T15:39:31","modified_gmt":"2025-10-29T15:39:31","slug":"wp5","status":"publish","type":"page","link":"https:\/\/spice-platform.eu\/sk\/work-packages\/wp5\/","title":{"rendered":"Work package 5"},"content":{"rendered":"<div data-elementor-type=\"wp-post\" data-elementor-id=\"2947\" class=\"elementor elementor-2947\">\n\t\t\t\t<div class=\"elementor-element elementor-element-15a79d6 e-con-full e-flex e-con e-parent\" data-id=\"15a79d6\" data-element_type=\"container\" data-e-type=\"container\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t<div class=\"elementor-element elementor-element-ed237d3 e-flex e-con-boxed e-con e-child\" data-id=\"ed237d3\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-39da4b9 elementor-widget elementor-widget-heading\" data-id=\"39da4b9\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h1 class=\"elementor-heading-title elementor-size-default\">Work package 5<\/h1>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-dfb8441 e-flex e-con-boxed e-con e-parent\" data-id=\"dfb8441\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-9d187da elementor-widget elementor-widget-heading\" data-id=\"9d187da\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\"><span style=\"font-weight: normal\">Objectives: A<span style=\"font-style: inherit\">daptive decentralized data pipelines development<\/span><\/span><\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-be49231 e-flex e-con-boxed e-con e-parent\" data-id=\"be49231\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-f086daa elementor-widget elementor-widget-image\" data-id=\"f086daa\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<img fetchpriority=\"high\" decoding=\"async\" width=\"870\" height=\"376\" src=\"https:\/\/spice-platform.eu\/wp-content\/uploads\/2025\/10\/blockchain-powered-document-sharing-img-3.jpg\" class=\"attachment-large size-large wp-image-3004\" alt=\"\" srcset=\"https:\/\/spice-platform.eu\/wp-content\/uploads\/2025\/10\/blockchain-powered-document-sharing-img-3.jpg 870w, https:\/\/spice-platform.eu\/wp-content\/uploads\/2025\/10\/blockchain-powered-document-sharing-img-3-300x130.jpg 300w, https:\/\/spice-platform.eu\/wp-content\/uploads\/2025\/10\/blockchain-powered-document-sharing-img-3-768x332.jpg 768w, https:\/\/spice-platform.eu\/wp-content\/uploads\/2025\/10\/blockchain-powered-document-sharing-img-3-18x8.jpg 18w\" sizes=\"(max-width: 870px) 100vw, 870px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-8567571 e-flex e-con-boxed e-con e-parent\" data-id=\"8567571\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-60f3bf3 elementor-widget elementor-widget-text-editor\" data-id=\"60f3bf3\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<h3><strong>Task 5.1 \u2013 High-throughput Enactment Engine<\/strong><\/h3>\n<p>Develop a portable, resilient <strong>Enactment Engine<\/strong> to execute complex data pipelines across the edge\u2013cloud continuum as scheduled by the Mapper (T5.3). Focus on transparent handling of data parallelism and control-flow for portable pipeline execution.<br>The EE will <strong>monitor<\/strong> execution metrics (e.g., via Prometheus) such as task runtimes, data transfer, and deployment\/invocation times, forwarding them to the Unified Knowledge Layer (WP3). On predicted or actual SLO violations, the EE will notify the Mapper (input to T5.3).<\/p>\n<hr>\n<h3><strong>Task 5.2 \u2013 Pipeline Predictor<\/strong><\/h3>\n<p>Develop <strong>ML-based predictors<\/strong> for dynamic pipeline ensembles and uncertainties in workloads and compute resources. Inputs include monitoring data (T5.1), performance experiments, and feedback from T5.3.<br>The Predictor will (a) forecast near-future workloads and (b) predict resource availability and utilization using <strong>RNNs, LSTMs, TCNs<\/strong>, and other time-series models. It supports <strong>runtime updates<\/strong> and provides localized\/specialized AI components for WP5.<\/p>\n<hr>\n<h3><strong>Task 5.3 \u2013 Cognitive Mapper<\/strong><\/h3>\n<p>Develop the <strong>Mapper<\/strong>, a hybrid scheduler that maps pipeline ensembles to edge\u2013cloud resources. Pipelines will first be transformed for seamless integration with <strong>Smart Data Management (T6.1)<\/strong>.<br>The Mapper combines <strong>global optimization<\/strong> with <strong>runtime heuristics<\/strong> based on T5.2 predictions to:<\/p><p><span style=\"font-style: inherit; font-weight: inherit;\">Maximize throughput and minimize costs.<\/span><\/p><p><span style=\"font-style: inherit; font-weight: inherit;\">Adapt rapidly to runtime changes, prediction errors, and load fluctuations (e.g., using Shortest Transmission Time First or Shortest Queue Length First).<\/span><\/p><p><span style=\"font-style: inherit; font-weight: inherit;\">After optimization, it negotiates resource SLOs with the <\/span><strong style=\"font-style: inherit;\">Resource Ensemble Manager (WP7)<\/strong><span style=\"font-style: inherit; font-weight: inherit;\">. The hybrid scheduler and recommender service balance near-optimal scheduling with adaptive performance.<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>","protected":false},"excerpt":{"rendered":"<p>Work package 5 Objectives: Adaptive decentralized data pipelines development Task 5.1 \u2013 High-throughput Enactment Engine Develop a portable, resilient Enactment [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"parent":541,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"site-sidebar-layout":"no-sidebar","site-content-layout":"page-builder","ast-site-content-layout":"full-width-container","site-content-style":"unboxed","site-sidebar-style":"unboxed","ast-global-header-display":"","ast-banner-title-visibility":"disabled","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"disabled","ast-breadcrumbs-content":"","ast-featured-img":"disabled","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"enabled","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"set","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"class_list":["post-2947","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/spice-platform.eu\/sk\/wp-json\/wp\/v2\/pages\/2947","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/spice-platform.eu\/sk\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/spice-platform.eu\/sk\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/spice-platform.eu\/sk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/spice-platform.eu\/sk\/wp-json\/wp\/v2\/comments?post=2947"}],"version-history":[{"count":7,"href":"https:\/\/spice-platform.eu\/sk\/wp-json\/wp\/v2\/pages\/2947\/revisions"}],"predecessor-version":[{"id":3010,"href":"https:\/\/spice-platform.eu\/sk\/wp-json\/wp\/v2\/pages\/2947\/revisions\/3010"}],"up":[{"embeddable":true,"href":"https:\/\/spice-platform.eu\/sk\/wp-json\/wp\/v2\/pages\/541"}],"wp:attachment":[{"href":"https:\/\/spice-platform.eu\/sk\/wp-json\/wp\/v2\/media?parent=2947"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}