Luca Resti (PhD Researcher)

Researcher in Acoustic Signal Processing

MAV-C: A Framework for the Joint Objective Estimation of Audio-Visual Complexity in Immersive Virtual Environments


Journal article


Luca Resti, A. Gully, Michael McLoughlin, Gavin Kearney, Alena Denisova
AVARIG 2026: Audio for Virtual and Augmented Reality and Immersive Games · Paper 494, 2026

AES E-Library Semantic Scholar ArXiv
Cite

Cite

APA   Click to copy
Resti, L., Gully, A., McLoughlin, M., Kearney, G., & Denisova, A. (2026). MAV-C: A Framework for the Joint Objective Estimation of Audio-Visual Complexity in Immersive Virtual Environments. AVARIG 2026: Audio for Virtual and Augmented Reality and Immersive Games · Paper 494.


Chicago/Turabian   Click to copy
Resti, Luca, A. Gully, Michael McLoughlin, Gavin Kearney, and Alena Denisova. “MAV-C: A Framework for the Joint Objective Estimation of Audio-Visual Complexity in Immersive Virtual Environments.” AVARIG 2026: Audio for Virtual and Augmented Reality and Immersive Games · Paper 494 (2026).


MLA   Click to copy
Resti, Luca, et al. “MAV-C: A Framework for the Joint Objective Estimation of Audio-Visual Complexity in Immersive Virtual Environments.” AVARIG 2026: Audio for Virtual and Augmented Reality and Immersive Games · Paper 494, 2026.


BibTeX   Click to copy

@article{luca2026a,
  title = {MAV-C: A Framework for the Joint Objective Estimation of Audio-Visual Complexity in Immersive Virtual Environments},
  year = {2026},
  journal = {AVARIG 2026: Audio for Virtual and Augmented Reality and Immersive Games · Paper 494},
  author = {Resti, Luca and Gully, A. and McLoughlin, Michael and Kearney, Gavin and Denisova, Alena}
}

Abstract

We present the Motion-Aware Audio-Visual Complexity Metric (MAV-C), a reference-free framework for the joint objective estimation of audio-visual complexity. The metric combines entropy-based audio features (temporal, spectral, and spatial) with visual features (Sobel gradient magnitude, chromatic uniqueness, and optical flow) via a parametric fusion stage, producing a continuous joint complexity score CAV (t) [0,1]. We validate MAV-C on two datasets: a controlled synthetic corpus (SYN) of stimuli with known signal characteristics and a naturalistic gameplay corpus (GAM) of 60 clips drawn from the SAFEPLAY-X dataset. On SYN, the metric exhibits strong validity: the audio score CA and visual score CV are each insensitive to changes in the opposite modality (CoV<0.003), the joint score CAV spans [0.00,0.90] across all parameter combinations, and single-axis feature sweeps produce monotone trajectories (Spearman up to 0.995). On GAM, CV differs significantly across content categories (Kruskal-Wallis p = 0.021) while CA does not, and the two sub-scores are uncorrelated (r = 0.03), confirming they operate on independent signal dimensions. OFAT sensitivity analysis identifies a two-tier parameter hierarchy, with modality balance (wa) and visual regularization (v) as most significant tunable parameters. Full subjective calibration is planned as future work.