Trustworthy Execution in Untrustworthy Autonomous Systems

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216224%3A14330%2F23%3A00135188" target="_blank" >RIV/00216224:14330/23:00135188 - isvavai.cz</a>

Výsledek na webu

<a href="http://dx.doi.org/10.1109/TrustCom60117.2023.00240" target="_blank" >http://dx.doi.org/10.1109/TrustCom60117.2023.00240</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1109/TrustCom60117.2023.00240" target="_blank" >10.1109/TrustCom60117.2023.00240</a>

Jazyk výsledku

angličtina

Název v původním jazyce

Trustworthy Execution in Untrustworthy Autonomous Systems

Popis výsledku v původním jazyce

With the increasing pervasiveness of software solutions, which are joining cyber-physical spaces and forming partnerships with humans, the importance of the trustworthiness of these systems is growing. At the same time, however, trustworthiness assurance is becoming extremely difficult in these complex ecosystems due to the high autonomy, unpredictability and limited controllability of their individual players. To mitigate safety risks for humans, these Dynamic Autonomous Ecosystems (e.g., Smart Cities) might require their member systems (e.g., Autonomous Vehicles) to execute software modules called Smart Agents to ensure safe coordination among themselves. Unfortunately, this technology is currently in its very early development with many challenges ahead. Namely, there is no guaranteed way of ensuring that these agents run on the right piece of hardware, with the right privileges required to fulfill their roles, and without the execution environment tampering with their instructions. This way, the host system (e.g., the Autonomous Vehicle we need to control for the sake of the safety of other ecosystem members) can escape the actual safety measures to be enforced. In this paper, we are proposing a novel software architecture that focuses on the detection of instruction tampering and privileged access in Smart Agents, and this way support the vision of trustworthy and safe evolution of Dynamic Autonomous Ecosystems.

Název v anglickém jazyce

Trustworthy Execution in Untrustworthy Autonomous Systems

Popis výsledku anglicky

With the increasing pervasiveness of software solutions, which are joining cyber-physical spaces and forming partnerships with humans, the importance of the trustworthiness of these systems is growing. At the same time, however, trustworthiness assurance is becoming extremely difficult in these complex ecosystems due to the high autonomy, unpredictability and limited controllability of their individual players. To mitigate safety risks for humans, these Dynamic Autonomous Ecosystems (e.g., Smart Cities) might require their member systems (e.g., Autonomous Vehicles) to execute software modules called Smart Agents to ensure safe coordination among themselves. Unfortunately, this technology is currently in its very early development with many challenges ahead. Namely, there is no guaranteed way of ensuring that these agents run on the right piece of hardware, with the right privileges required to fulfill their roles, and without the execution environment tampering with their instructions. This way, the host system (e.g., the Autonomous Vehicle we need to control for the sake of the safety of other ecosystem members) can escape the actual safety measures to be enforced. In this paper, we are proposing a novel software architecture that focuses on the detection of instruction tampering and privileged access in Smart Agents, and this way support the vision of trustworthy and safe evolution of Dynamic Autonomous Ecosystems.

Druh

D - Stať ve sborníku

CEP obor

—

OECD FORD obor

10200 - Computer and information sciences

Projekt

—

Návaznosti

S - Specificky vyzkum na vysokych skolach

Rok uplatnění

2023

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Název statě ve sborníku

2023 IEEE 22nd International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom)

ISBN

9798350381993

ISSN

2324-898X

e-ISSN

—

Počet stran výsledku

8

Strana od-do

1766-1773

Název nakladatele

IEEE

Místo vydání

Neuveden

Místo konání akce

Exeter, UK

Datum konání akce

1. 1. 2023

Typ akce podle státní příslušnosti

WRD - Celosvětová akce

Kód UT WoS článku

001239879400216