Deep Neural Room Acoustics Primitive
Yuhang He, Anoop Cherian, Gordon Wichern, Andrew Markham.
The 41st International Conference on Machine Learning (ICML), 2024.
We introduce a novel framework to learn a continuous neural room acoustics field that implicitly encodes all essential sound propagation primitives for each enclosed 3D space.
SoundCount: Sound Counting from Raw Audio with Dyadic Decomposition Neural Network
Yuhang He, Zhuangzhuang Dai, Long Chen, Niki Trigoni, Andrew Markham.
The 38th Annual AAAI Conference on Artificial Intelligence (AAAI), 2024.
We introduce a learnable dyadic decomposition framework that learns more representative time-frequency representation from highly polyphonic and loudness varying sound waveform. It dyadically decomposes the waveform in multi-stage hierarchical manner.
Sound3DVDet: 3D Sound Source Detection Using Multiview Microphone Array and RGB Images
Yuhang He, Sangyun Shin, Anoop Cherian, Niki Trigoni, Andrew Markham.
IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2024.
We introduce a novel 3D sound source localization and classification from multiview acoustic-camera recordings task. The sound source lies on object's physical surface but visually non-observable, which reflects some application cases like gas leaking.
Metric-Free Exploration for Topological Mapping by Task and Motion Imitation in Feature Space
Yuhang He, Irving Fang, Yiming Li, Rushi Bhavesh Shah, Chen Feng.
Robotics: Science and Systems (RSS), 2023.
We propose metric-free DeepExplorer to efficiently construct topological map to represent an environment. DeepExplorers exhibits strong sim2sim and sim2real generalization capability.
SoundSynp: Sound Source Detection from Raw Waveforms with Multi-Scale Synperiodic Filterbanks
Yuhang He, Andrew Markham
International Conference on Artificial Intelligence and Statistics (AISTATS), 2023.
We propose a novel framework to construct learnable sound signal processing filter banks that achieve multi-scale processing in both time and frequency domain.
SoundDoA: Learn Sound Source Direction of Arrival and Semantics from Sound Raw Waveforms
Yuhang He, Andrew Markham
Interspeech, 2022.
We propose a novel sound event direction of arrival (DoA) estimation framework with a novel filter bank to jointly learn sound event semantics and spatial location relevant representations.
SoundDet: Polyphonic Moving Sound Event Detection and Localization from Raw Waveform
Yuhang He, Niki Trigoni, Andrew Markham
International Conference on Machine Learning (ICML), 2021.
We propose a novel sound event detection framework for polyphonic and moving sound event detection. We also propose novel object-based evaluation metrics to evaluate performance more objectively.
Real-Time Vehicle Detection from Short-range Aerial Image with Compressed MobileNet
Yuhang He, Ziyu Pan, Lingxi Li, Yunxiao Shan, Dongpu Cao and Long Chen
International Conference on Robotics and Automation (ICRA), 2019.
We propose a compressed MobileNet framework for real-time vehicle detection in short-range aerial image.
Multi-task Relative Attributes Prediction by Incorporating Local Context and Global Style Information Features
Yuhang He, Long Chen, Jianda Chen
British Machine Vision Conference (BMVC), 2016.
We fuse features arising from both local context and global style to boost relative attributes prediction task.
Using Edit Distance and Junction Feature to Detect and Recognize Arrow Road Marking
Yuhang He, Shi Chen, Yifeng Pan, Kai Ni
International IEEE Conference on Intelligent Transportation Systems (ITSC), 2014.
We incorporate classic line detector and edit distance metrics to detect various arrow road markings on autonomous driving road.