Assessing the Effects of Sensory Modality Conditions on Object Retention across Virtual Reality and Projected Surface Display Environments
This repository contains experimental data for the ISS '24 full paper "Assessing the Effects of Sensory Modality Conditions on Object Retention across Virtual Reality and Projected Surface Display Environments"
Haptic feedback reportedly enhances human interaction with 3D data, particularly improving the retention of mental representations of digital objects in immersive settings. However, the effectiveness of visuohaptic integration in promoting object retention across different display environments remains underexplored. Our study extends previous virtual reality research on visuohaptic integration to a projected surface display to assess whether earlier findings generalize to 2D environments. Participants performed a delayed match-to-sample task incorporating visual, haptic, and visuohaptic sensory feedback within a projected surface display environment. We compared error rates and response times across these sensory modalities and display environments. Our results reveal that visuohaptic integration significantly enhances object retention on projected surfaces, benefiting task performance across display environments. Our findings suggest that haptics can improve object retention without requiring fully immersive setups, offering insights for designing interactive systems that assist professionals who rely on precise object retention.
The paper is available in the ACM Digital Library.
- results.csv, available in Creative Commons Public Domain Dedication (CC-0), represented the experimental results from consented anonymous participants and was collected by Lucas Siqueira Rodrigues.
- The data.csv itself, available in Creative Commons Public Domain Dedication (CC-0), combines the experimental results from consented anonymous participants and was collected by Lucas Siqueira Rodrigues in the current projected surface experiment and the previous VR study.
- logistic_regression_error_rates.py Performs logistic regression on error rates on data.csv.
- mannwhitneyu_response_time.py performs Mann-Whitney U tests for response times on data.csv.
- data_analysis_interaction.py examines interactions between the display environments and sensory modality conditions.
Copyright © 2024. Cluster of Excellence Matters of Activity. All rights reserved.
Below are the BibTex entries to cite the paper and data set.
@article{10.1145/3698137,
author = {Siqueira Rodrigues, Lucas and Schmidt, Timo Torsten and Nyakatura, John and Zachow, Stefan and Israel, Johann Habakuk and Kosch, Thomas},
title = {Assessing the Effects of Sensory Modality Conditions on Object Retention across Virtual Reality and Projected Surface Display Environments},
year = {2024},
issue_date = {December 2024},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
volume = {8},
number = {ISS},
url = {https://doi.org/10.1145/3698137},
doi = {10.1145/3698137},
journal = {Proc. ACM Hum.-Comput. Interact.},
month = oct,
articleno = {537},
numpages = {28},
keywords = {Data Analysis, Data Exploration, Feedback, Haptics, Human-Computer Interaction, Memory Retention, Visuohaptic Integration}
}
@misc{siqueira_rodrigues_data_2d_2023,
title = {Data from "Assessing the Effects of Sensory Modality Conditions on Object Retention across Virtual Reality and Projected Surface Display Environments"},
url = {https://github.com/lsrodri/VHMatch2D},
publisher = {https://github.com/lsrodri/VHMatch2D},
author = {Siqueira Rodrigues, Lucas and Schmidt, Timo T. and Nyakatura, John and Zachow, Stefan and Israel, Johann Habakuk and Kosch, Thomas},
year = {2023},
}
The author acknowledges the support of the Cluster of Excellence »Matters of Activity. Image Space Material« funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) under Germany's Excellence Strategy – EXC 2025 – 390648296.
Copyright © 2024. Cluster of Excellence Matters of Activity. All rights reserved.