- Azimuth
- 30°
- Elevation
- 32°
- Distance
- 3.2 m
Human hearing.
For robots.
HRTF-based biomimetic two-channel sensors and BiSELD.
Jointly estimating sound types and 3D locations for multiple sources.
- Azimuth
- -74°
- Elevation
- 48°
- Distance
- 5.8 m
- Azimuth
- 137°
- Elevation
- 24°
- Distance
- 7.4 m
Sound type.Event timing.Spatial coordinates.
From two-channel input to scene information.
One sound,
two different signals.
Small differences between the two channels carry spatial information.
We analyze timing, sound level, and frequency together to interpret the direction of sound.
Arrival-Time Differences
The same sound reaches the two channels at different times. We analyze the time difference between corresponding signals as a cue to estimate direction.
Level Differences
Sound levels at the two channels vary with the direction of arrival. We use the relative level difference between channels as a spatial cue.
Spectral Differences
The head and outer ears shape sound transmission across frequencies. We interpret these direction-dependent patterns as HRTF-based spatial cues.
A synthetic visualization illustrating differences between binaural signals. Not actual measurements or inference results.
Two-channel differences,
inputs to spatial estimation.
We compare the binaural signals received by Left and Right. Timing, level, and spectral differences provide spatial cues for BiSELD to jointly estimate the types and 3D locations of multiple events.
Event classification
Spatial localization
Event type
Multiple sound event classification
3D location
Azimuth · Elevation · Distance
Conceptual illustration of binaural signal differences. Waveforms and processing flows are illustrative, not measured data or inference results.
When does it start,
and when does it end?
Sound event detection (SED) estimates event types and their onset and offset times. Marking event intervals on a timeline reveals durations and overlaps between multiple events.
Event classificationFootsteps · Conversation · Ringing
Time boundariesOnset time · Offset time
Overlapping intervalsSimultaneous sound events
A synthetic sequence illustrating onset and offset detection in SED. Not an actual recording or inference result.
Foundations of spatial hearing,
HRTF research infrastructure.
BUJEON measures direction-dependent head-related transfer functions (HRTFs) using a KEMAR dummy head in an anechoic chamber. We record changes in the signals reaching both ears to provide foundational data for spatial hearing research.
BUJEON anechoic chamber · KEMAR-based HRTF measurement setup
Binaural Transfer Characteristics
We measure changes in timing, sound level, and spectrum caused by the head and outer ears, recording signal transfer characteristics at both ears for each direction.
Directional HRTF Measurement
We build a far-field HRTF database through measurements at 5° intervals over 360° of azimuth and elevations from −80° to +90°.
Measurement vs. Simulation
We study direction-dependent acoustic transfer characteristics by comparing measured HRTFs with numerical results from the boundary element method (BEM).
HRTFs describe direction-dependent sound transmission shaped by the head and ears. AI-Ear uses HRTF-based biomimetic two-channel sensors and BiSELD to jointly estimate the types and 3D locations of multiple sound sources.
HRTF → 2 CHANNELS → BiSELDSpatial hearing.
Explore its applications.
Discuss applications for HRTF-based sensing and BiSELD,
system requirements, and research collaboration.
