Vocal Detection Using Convolution Neural Networks with Visualization Tools

Shingchern D. You; Hsu Chia Cho; Chien Hung Liu

doi:10.1109/ICCE-Asia57006.2022.9954848

Vocal Detection Using Convolution Neural Networks with Visualization Tools

Shingchern D. You
, Hsu Chia Cho
, Chien Hung Liu

Department of Computer Science and Information Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

1 Scopus citations

Abstract

In this paper, we report the use of convolutional neural networks (CNN) with the aid of visualization tools, such as Grad-CAM and Score-CAM, to detect vocal signals in audio clips. CNN model typically requires relatively long audio segments for prediction. To improve the detection accuracy with short nonvocal gaps, we include information obtained from the Grad-CAM and Score-CAM, along with the original predicted results, to form the input to a post classifier. The experimental results show that the detection accuracy is improved, especially when short nonvocal gaps are present.

Original language	English
Title of host publication	2022 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2022
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781665464345
DOIs	https://doi.org/10.1109/ICCE-Asia57006.2022.9954848
State	Published - 2022
Event	2022 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2022 - Yeosu, Korea, Republic of Duration: 26 Oct 2022 → 28 Oct 2022

Publication series

Name	2022 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2022

Conference

Conference	2022 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2022
Country/Territory	Korea, Republic of
City	Yeosu
Period	26/10/22 → 28/10/22

Bibliographical note

Publisher Copyright:
© 2022 IEEE.

Keywords

CNN
Grad-CAM
Score-CAM
Vocal detection

Access to Document

10.1109/ICCE-Asia57006.2022.9954848

Cite this

You, S. D., Cho, H. C., & Liu, C. H. (2022). Vocal Detection Using Convolution Neural Networks with Visualization Tools. In 2022 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2022 (2022 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2022). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICCE-Asia57006.2022.9954848

@inproceedings{7d7880d1573f447a83f9e633375139a5,

title = "Vocal Detection Using Convolution Neural Networks with Visualization Tools",

abstract = "In this paper, we report the use of convolutional neural networks (CNN) with the aid of visualization tools, such as Grad-CAM and Score-CAM, to detect vocal signals in audio clips. CNN model typically requires relatively long audio segments for prediction. To improve the detection accuracy with short nonvocal gaps, we include information obtained from the Grad-CAM and Score-CAM, along with the original predicted results, to form the input to a post classifier. The experimental results show that the detection accuracy is improved, especially when short nonvocal gaps are present.",

keywords = "CNN, Grad-CAM, Score-CAM, Vocal detection",

author = "You, \{Shingchern D.\} and Cho, \{Hsu Chia\} and Liu, \{Chien Hung\}",

note = "Publisher Copyright: {\textcopyright} 2022 IEEE.; 2022 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2022 ; Conference date: 26-10-2022 Through 28-10-2022",

year = "2022",

doi = "10.1109/ICCE-Asia57006.2022.9954848",

language = "???core.languages.en\_GB???",

series = "2022 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2022",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "2022 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2022",

}

You, SD, Cho, HC & Liu, CH 2022, Vocal Detection Using Convolution Neural Networks with Visualization Tools. in 2022 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2022. 2022 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2022, Institute of Electrical and Electronics Engineers Inc., 2022 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2022, Yeosu, Korea, Republic of, 26/10/22. https://doi.org/10.1109/ICCE-Asia57006.2022.9954848

Vocal Detection Using Convolution Neural Networks with Visualization Tools. / You, Shingchern D.; Cho, Hsu Chia; Liu, Chien Hung.
2022 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2022. Institute of Electrical and Electronics Engineers Inc., 2022. (2022 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2022).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Vocal Detection Using Convolution Neural Networks with Visualization Tools

AU - You, Shingchern D.

AU - Cho, Hsu Chia

AU - Liu, Chien Hung

PY - 2022

Y1 - 2022

N2 - In this paper, we report the use of convolutional neural networks (CNN) with the aid of visualization tools, such as Grad-CAM and Score-CAM, to detect vocal signals in audio clips. CNN model typically requires relatively long audio segments for prediction. To improve the detection accuracy with short nonvocal gaps, we include information obtained from the Grad-CAM and Score-CAM, along with the original predicted results, to form the input to a post classifier. The experimental results show that the detection accuracy is improved, especially when short nonvocal gaps are present.

AB - In this paper, we report the use of convolutional neural networks (CNN) with the aid of visualization tools, such as Grad-CAM and Score-CAM, to detect vocal signals in audio clips. CNN model typically requires relatively long audio segments for prediction. To improve the detection accuracy with short nonvocal gaps, we include information obtained from the Grad-CAM and Score-CAM, along with the original predicted results, to form the input to a post classifier. The experimental results show that the detection accuracy is improved, especially when short nonvocal gaps are present.

KW - CNN

KW - Grad-CAM

KW - Score-CAM

KW - Vocal detection

UR - https://www.scopus.com/pages/publications/85143804196

U2 - 10.1109/ICCE-Asia57006.2022.9954848

DO - 10.1109/ICCE-Asia57006.2022.9954848

M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???

AN - SCOPUS:85143804196

T3 - 2022 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2022

BT - 2022 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2022

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2022 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2022

Y2 - 26 October 2022 through 28 October 2022

ER -

Vocal Detection Using Convolution Neural Networks with Visualization Tools

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this