Location
Hilton Hawaiian Village, Honolulu, Hawaii
Event Website
https://hicss.hawaii.edu/
Start Date
3-1-2024 12:00 AM
End Date
6-1-2024 12:00 AM
Description
The dependability of autonomous agents, such as self-driving cars, in complex and unpredictable real-world environments is a critical challenge. To address this, scenario-based testing attempts to assess agents across a range of diverse scenarios. However, the manual definition of these test scenarios is often labor-intensive and requires considerable domain expertise, while existing methods to extract scenarios from sensor data also depend on intricate assumptions about the data. To overcome these limitations, we introduce an unsupervised approach that uses trace graphs to determine meaningful scenario boundaries in time-series sensor data, without the need for additional domain knowledge or manual input. Our experimental results demonstrate that our method can extract a small but comprehensive set of test scenarios that captures the full spectrum of the agent's experiences as observed in the sensor data.
Recommended Citation
Brinkmann, Jannik; Metzger, Noah; and Bartelt, Christian, "Unsupervised Extraction of Test Scenarios from Time-Series Sensor Data using Trace Graphs" (2024). Hawaii International Conference on System Sciences 2024 (HICSS-57). 5.
https://aisel.aisnet.org/hicss-57/st/software_engineering/5
Unsupervised Extraction of Test Scenarios from Time-Series Sensor Data using Trace Graphs
Hilton Hawaiian Village, Honolulu, Hawaii
The dependability of autonomous agents, such as self-driving cars, in complex and unpredictable real-world environments is a critical challenge. To address this, scenario-based testing attempts to assess agents across a range of diverse scenarios. However, the manual definition of these test scenarios is often labor-intensive and requires considerable domain expertise, while existing methods to extract scenarios from sensor data also depend on intricate assumptions about the data. To overcome these limitations, we introduce an unsupervised approach that uses trace graphs to determine meaningful scenario boundaries in time-series sensor data, without the need for additional domain knowledge or manual input. Our experimental results demonstrate that our method can extract a small but comprehensive set of test scenarios that captures the full spectrum of the agent's experiences as observed in the sensor data.
https://aisel.aisnet.org/hicss-57/st/software_engineering/5