Hearing aid application
Hearing aid application is software which, when installed on a mobile computational platform, helps with hearing. Mobile devices may include smartphones, tablets or smart watch.
Adjustment
As operational characteristics are adjusted directly through the graphic interface of the application, this feature allows classifying the hardware-software complex as a programmable hearing aid.HAA, as a rule, adjusts the level of the surrounding acoustic environment to the user's hearing characteristics, thereby allowing him to hear better. Most of HAA works both with wired and bluetooth headsets/headphones.
Unlike traditional hearing aid, which is a part of system consisting of a hearing aid, wired or wireless interworking interface, computer device and installed software for changes, adjustment of HAA is a procedure within the united hardware-software complex.
Hearing aid applications | Traditional Hearing aids | |
Channels | Up to 256 | 15-111 |
Sample rate | Maximum 44 kHz | Maximum 14 kHz |
Programmable hearing aid | Yes | Yes |
In-built hearing test | Yes | Yes |
Hearing test time | A few minutes | 30 minutes - 60 minutes |
Effects of anti stigmatization | Yes | No, except for intra channels |
Audio recorder + Speech recognition in text | Yes | No |
Remote microphone option without additional devices | Yes | No |
Binaural correction of both ears | Yes | No |
Gain formula, that takes into account the upper threshold of perception | Yes | No |
Adjustable noise supppression | Yes | Yes |
Ecosystem of assistive applications | Yes | No |
Built into app course of adaptation to hearing aid | Yes | No |
Online gain formula change | Yes | No |
Amplification of quiet sounds | Yes | No |
Batteries | Built-in, rechargeable | Rechargeable and replaceable |
Thus, HAA is not inferior, and even surpasses traditional hearing aids in some characteristics.
The basic hearing aid setting is amplification adjustment in accordance with the user's audiogram.
The process of selection of traditional hearing aid starts with audiometry, which is also the first characteristic of sound perception disorder considered during the adjustment of HAA. If the user has already had a special audiologic checkup, this type of adjustment can be done remotely by a specialist, and the results of this checkup can be entered by the user with the help of the application's graphic interface. A lot of HAA have a built-in procedure of in situ-audiometry which automates the whole process so that the user can take this type of examination on their own. Software-based generators of tone signals and interface elements for reaction to exceeding the hearing perception threshold are used for that.
Quick change of settings, such as recruitment compensation, noise suppression, amplification regulation allows HAA users to choose the settings which are more suitable to understanding the speech in silence or with a background noise.
An additional feature of HAA is ability to choose and apply the sets of parameters most suitable for the current acoustic situation, for example, for silence, for talking in a noisy environment, etc.
Some HAA provide for using different computing formulas for calculation of target amplification on the basis of audiometry data. These formulas are intended to amplify the speech up to the maximum comfortable level of perception by the user.
In particular, Pertalex HAA offers its users 3 well-known formulas:
- NAL-R;
- Berger;
- Pogo.
Acoustic feedback is the most widespread option of feedback appearing at the return leakage of sound from the speaker to the microphone. This can be caused by small distance between the microphone and the speaker, loose fit of an earpiece to the surface of acoustic meatus and so on.
The processing under frequency-dependent amplification of input signal for compensation of hearing impairment includes assistive functions, such as acoustic feedback suppression.
In a number of HAA a scheme with subband signal decomposition is used for acoustic feedback suppression.
Advantages and disadvantages
Compared to traditional hearing aids, HAA has the following disadvantages:- more noticeable and not so comfortable to wear;
- due to the fact that the microphone is not located in the ear, it does not use the functional advantages of the auricle and the natural acoustics of the outer ear.
- the large distance between the microphone and the speaker prevents the occurrence of acoustic feedback, which allows the use of large acoustic amplification and a simpler audio signal processing algorithm;
- due to the rather large size of the device, it is possible to implement more convenient application control functions for people with poor motor skills;
- using of various types of headphones is possible;
- it is possible to achieve the highest sound pressure level and get high sound quality due to large speakers and a long battery life;
- resistant to ingress of earwax and moisture;
- thanks to the capacious battery, it is possible to use more complex audio signal processing algorithms and a higher sampling rate;
- software flexibility;
- developed software distribution system through appropriate services; the possibility of applying hearing correction algorithms to audio and video recordings, telephone calls, etc., and not only to acoustic signals;
- the set up HAA in simple cases does not require special equipment and qualifications, the user can perform it independently;
- HAA does not cause any psychological inconvenience, since the smartphone/tablet is not associated with the auditory pathologies in other people;
- the user does not need to purchase and carry a separate device.
Comparative characteristics
Distribution of HAA is limited by the infrastructure of specialized application stores, such as App Store, Google Play, etc. There is a fairly large number of applications that implements a hearing aid based on a smartphone/tablet. However, despite the general idea - hearing aid, they all differ in a number of criteria.
For benchmarking, the following applications were selected from the top 10 Google Play store applications and the App Store, selected on the "Hearing aid" request, and meet the following criteria:
- the release date of the latest version - no later than June 2012;
- the correspondence of the main functional declared by the developers in the descriptions solved by the application to the task - compensation of hearing impairments.
Petralex | uSound | Hearing Aid Sound Amplifier | Fennex | Ear Spy | Jacoti ListenApp | BoiAid | AmplyPhone | Dectone | Listening device - Hearing aid | Google Sound Amplifier | |
Latest release | , | , | , | | |||||||
Audio latency | 20 ms***, 65 ms*** | 30 ms*** , 30 ms*** | 30 ms*** | 45 ms*** | 35 ms***, 360 ms*** | 20 ms*** | 30 ms*** | 35 ms*** | 65 ms*** | 30 ms*** | |
Programmable hearing aid | Yes | Yes | Yes | Yes | No | Yes | No | No | Yes | Yes | No |
In-built hearing test | Yes | Yes | No | Yes | No | Yes***** | No | No | Yes | Yes | No |
Automatic/manual audiometry | Automatic and manual | Automatic and manual | Manual | Automatic and manual | No | Automatic and manual | No | No | Automatic and manual | Automatic and manual | No |
Nonlinear hearing aid | Yes | No | No | No | No | No | No | No | Yes | Yes | No |
Amplification of quiet sounds | Yes | No | No | Yes | No | No | No | No | Yes | Yes | Yes |
Adjustment of WDRC | Yes | No | No | Yes | No | No | No | No | Yes | Yes | Yes |
Online gain formula change | Yes | No | No | No | No | No | No | No | Yes | Yes | No |
Ability to adapt to the environment | Yes | Yes | Yes | Yes | No | Yes | Yes | No | Yes | Yes | No |
Adjustable noise suppression | Yes | No | Yes | Yes | No | No | Yes | No | Yes | Yes | Yes |
Suppression of acoustic feedback | Yes | No | No | No | No | No | No | No | Yes | Yes | No |
Bluetooth headset support | Yes, on iOS and Android | Yes, on iOS and Android | Yes, only on iOS | Yes, only on iOS | Yes, on iOS and Android**** | No | Yes, only on iOS | No | Yes | Yes | No |
Audio recorder | Yes | No | No | No | Yes**** | No | No | Yes | Yes | Yes | No |
Speech recognition in text | Yes, only on iOS | No | No | No | No | No | No | No | No | Yes | No |
Volume balance reconstruction of the left/right ear | No | No | Yes | Yes | No | No | No | No | Yes | Yes | Yes |
Gain formula, that takes into account the upper thresholds of perception | Yes | No | No | No | No | No | No | No | Yes | Yes | No |
Ecosystem of assistive applications | Yes | No | No | No | No | No | No | No | Yes | Yes | No |
Built into course of adaptation to hearing aid application | Yes | No | No | No | No | No | No | No | Yes | No | No |
Special gain formula for tinnitus | Yes | No | No | No | No | No | No | No | Yes | Yes | No |
Ratings | 4.7 on AppStore, 4.0 on Google Play | 3.7 on Google Play | 4.4 on AppStore | No | 3.1 on AppStore, 3.7 on Google Play | No | No | No | 3.7 on Google Play | 4.6 on AppStore | 3.7 on Google Play |
Notes: *tested on iPhone 6+, ** tested on Samsung Galaxy A3, *** on the date of testing, **** in the paid version, ***** - with the help of an additional application.
HAA basic principles of work
The principles of working HAA are similar to those of traditional hearing aids.Most HAA provides two modes: settings mode and the hearing correction mode.
Setup mode is an in situ-audiometry procedure that allows the user to independently measure hearing thresholds using tone audio signals that are generated with a gradually increasing amplitude over a period of some seconds. Audio signals are generated according to the following sequence of frequencies: 125, 250, 500, 1000, 2000, 4000, 6000 and 8000 Hz.
Some HAA do not have an integrated audiometry system. In this case, the adjustment of the sound amplification level is made by the user based on their own subjective feelings.
Hearing correction mode represents an audio signal processing system. The audio signal processing system implements a broadband method for changing the correction of the spectral envelope of a signal using a filter with a finite impulse response whose frequency response is generated based on user-defined hearing thresholds during the in situ-audiometry procedure.
Figure 2 shows a general signal processing scheme in a hearing aid application.
Audio input signal, acoustic feedback and background noise are captured by the microphone, summed and then divided into sub-band components with a lower sampling rate using an analysis filter bank.
Estimation of noise is based on the minima controlled recursive averaging of past values of noise.
Cleared of noise subband signal is cleared of acoustic echo by adaptive filtering.
The subband audio components that are cleared of echo and noise are amplified by multiplying by the corresponding coefficients, which are calculated based on the level of input and output audio signals, ambient noise energy, as well as hearing thresholds of the user.
The gain unit also performs the function of dynamic range compression, thereby compensating for the function of non-linear amplification of the human cochlea.
The processed broadband signal is synthesized using a synthesis filter bank.
AFB and SFB are can be realised as DFT-modulated filter banks, which is one of the most popular filter bank type used in modern hearing aids.
The output signal can be multiplied by the total gain, which provides a comfortable sound level. This coefficient is adjusted by the user using an external controller directly in HAA interface.
HAA, as a rule, provides high speed and high sound quality due to a simple signal processing algorithm as well as due to the effective implementation of application functional blocks.
Some HAA may not have an acoustic cancellation block.
Estimate of hearing aid efficiency
Based on the results of studies conducted on the effectiveness of using the different hearing aid applications, it can be concluded that for those respondents who have never used hearing aids before, there is a tendency of a positive effect on speech intelligibility. The positive impact on speech intelligibility when talking in a noisy environment was noted by those respondents who used hearing aids.HAA also can be useful not only as a hearing aid. For example, it can be useful in the process of studying, as students can place their smartphone/tablet closer to the teacher and hears him better.