Interactive audio-visual performance system controlled by smartphone based on arm movements

Chien Wen Cheng

doi:10.1109/ICAMSE.2016.7840186

Interactive audio-visual performance system controlled by smartphone based on arm movements

Chien Wen Cheng

Department of Interaction Design

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

1 Scopus citations

Abstract

This research proposes an interactive audio-visual system for the new trend in performing arts that incorporates interactive technology into traditional performance. In order to break the limit of movement space and to simplify the hardware and software configuration, smartphones are used to replace regular wireless sensors and to track the arm movements of the performer. The detected sensor data are sent to the interactive systems on computers through WIFI for further analysis and interpretation of which the result will be used to control the real-time audio and video processing.

Original language	English
Title of host publication	Proceedings of the IEEE International Conference on Advanced Materials for Science and Engineering
Subtitle of host publication	Innovation, Science and Engineering, IEEE-ICAMSE 2016
Editors	Teen-Hang Meen, Stephen D. Prior, Artde Donald Kin-Tak Lam
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	516-519
Number of pages	4
ISBN (Electronic)	9781509038695
DOIs	https://doi.org/10.1109/ICAMSE.2016.7840186
State	Published - 2 Feb 2017
Event	2016 IEEE International Conference on Advanced Materials for Science and Engineering, IEEE-ICAMSE 2016 - Tainan, Taiwan Duration: 12 Nov 2016 → 13 Nov 2016

Publication series

Name	Proceedings of the IEEE International Conference on Advanced Materials for Science and Engineering: Innovation, Science and Engineering, IEEE-ICAMSE 2016

Conference

Conference	2016 IEEE International Conference on Advanced Materials for Science and Engineering, IEEE-ICAMSE 2016
Country/Territory	Taiwan
City	Tainan
Period	12/11/16 → 13/11/16

Bibliographical note

Publisher Copyright:
© 2016 IEEE.

Keywords

Interactive Music
Interactive Video
Live Electronics
Open Sound Control

Access to Document

10.1109/ICAMSE.2016.7840186

Cite this

Cheng, C. W. (2017). Interactive audio-visual performance system controlled by smartphone based on arm movements. In T.-H. Meen, S. D. Prior, & A. D. K.-T. Lam (Eds.), Proceedings of the IEEE International Conference on Advanced Materials for Science and Engineering: Innovation, Science and Engineering, IEEE-ICAMSE 2016 (pp. 516-519). Article 7840186 (Proceedings of the IEEE International Conference on Advanced Materials for Science and Engineering: Innovation, Science and Engineering, IEEE-ICAMSE 2016). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICAMSE.2016.7840186

Cheng, Chien Wen. / Interactive audio-visual performance system controlled by smartphone based on arm movements. Proceedings of the IEEE International Conference on Advanced Materials for Science and Engineering: Innovation, Science and Engineering, IEEE-ICAMSE 2016. editor / Teen-Hang Meen ; Stephen D. Prior ; Artde Donald Kin-Tak Lam. Institute of Electrical and Electronics Engineers Inc., 2017. pp. 516-519 (Proceedings of the IEEE International Conference on Advanced Materials for Science and Engineering: Innovation, Science and Engineering, IEEE-ICAMSE 2016).

@inproceedings{405da79a2ee045518f58494287973b51,

title = "Interactive audio-visual performance system controlled by smartphone based on arm movements",

abstract = "This research proposes an interactive audio-visual system for the new trend in performing arts that incorporates interactive technology into traditional performance. In order to break the limit of movement space and to simplify the hardware and software configuration, smartphones are used to replace regular wireless sensors and to track the arm movements of the performer. The detected sensor data are sent to the interactive systems on computers through WIFI for further analysis and interpretation of which the result will be used to control the real-time audio and video processing.",

keywords = "Interactive Music, Interactive Video, Live Electronics, Open Sound Control",

author = "Cheng, \{Chien Wen\}",

note = "Publisher Copyright: {\textcopyright} 2016 IEEE.; 2016 IEEE International Conference on Advanced Materials for Science and Engineering, IEEE-ICAMSE 2016 ; Conference date: 12-11-2016 Through 13-11-2016",

year = "2017",

month = feb,

day = "2",

doi = "10.1109/ICAMSE.2016.7840186",

language = "???core.languages.en\_GB???",

series = "Proceedings of the IEEE International Conference on Advanced Materials for Science and Engineering: Innovation, Science and Engineering, IEEE-ICAMSE 2016",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "516--519",

editor = "Teen-Hang Meen and Prior, \{Stephen D.\} and Lam, \{Artde Donald Kin-Tak\}",

booktitle = "Proceedings of the IEEE International Conference on Advanced Materials for Science and Engineering",

}

Cheng, CW 2017, Interactive audio-visual performance system controlled by smartphone based on arm movements. in T-H Meen, SD Prior & ADK-T Lam (eds), Proceedings of the IEEE International Conference on Advanced Materials for Science and Engineering: Innovation, Science and Engineering, IEEE-ICAMSE 2016., 7840186, Proceedings of the IEEE International Conference on Advanced Materials for Science and Engineering: Innovation, Science and Engineering, IEEE-ICAMSE 2016, Institute of Electrical and Electronics Engineers Inc., pp. 516-519, 2016 IEEE International Conference on Advanced Materials for Science and Engineering, IEEE-ICAMSE 2016, Tainan, Taiwan, 12/11/16. https://doi.org/10.1109/ICAMSE.2016.7840186

Interactive audio-visual performance system controlled by smartphone based on arm movements. / Cheng, Chien Wen.
Proceedings of the IEEE International Conference on Advanced Materials for Science and Engineering: Innovation, Science and Engineering, IEEE-ICAMSE 2016. ed. / Teen-Hang Meen; Stephen D. Prior; Artde Donald Kin-Tak Lam. Institute of Electrical and Electronics Engineers Inc., 2017. p. 516-519 7840186 (Proceedings of the IEEE International Conference on Advanced Materials for Science and Engineering: Innovation, Science and Engineering, IEEE-ICAMSE 2016).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Interactive audio-visual performance system controlled by smartphone based on arm movements

AU - Cheng, Chien Wen

PY - 2017/2/2

Y1 - 2017/2/2

N2 - This research proposes an interactive audio-visual system for the new trend in performing arts that incorporates interactive technology into traditional performance. In order to break the limit of movement space and to simplify the hardware and software configuration, smartphones are used to replace regular wireless sensors and to track the arm movements of the performer. The detected sensor data are sent to the interactive systems on computers through WIFI for further analysis and interpretation of which the result will be used to control the real-time audio and video processing.

AB - This research proposes an interactive audio-visual system for the new trend in performing arts that incorporates interactive technology into traditional performance. In order to break the limit of movement space and to simplify the hardware and software configuration, smartphones are used to replace regular wireless sensors and to track the arm movements of the performer. The detected sensor data are sent to the interactive systems on computers through WIFI for further analysis and interpretation of which the result will be used to control the real-time audio and video processing.

KW - Interactive Music

KW - Interactive Video

KW - Live Electronics

KW - Open Sound Control

UR - https://www.scopus.com/pages/publications/85015184725

U2 - 10.1109/ICAMSE.2016.7840186

DO - 10.1109/ICAMSE.2016.7840186

M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???

AN - SCOPUS:85015184725

T3 - Proceedings of the IEEE International Conference on Advanced Materials for Science and Engineering: Innovation, Science and Engineering, IEEE-ICAMSE 2016

SP - 516

EP - 519

BT - Proceedings of the IEEE International Conference on Advanced Materials for Science and Engineering

A2 - Meen, Teen-Hang

A2 - Prior, Stephen D.

A2 - Lam, Artde Donald Kin-Tak

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2016 IEEE International Conference on Advanced Materials for Science and Engineering, IEEE-ICAMSE 2016

Y2 - 12 November 2016 through 13 November 2016

ER -

Cheng CW. Interactive audio-visual performance system controlled by smartphone based on arm movements. In Meen TH, Prior SD, Lam ADKT, editors, Proceedings of the IEEE International Conference on Advanced Materials for Science and Engineering: Innovation, Science and Engineering, IEEE-ICAMSE 2016. Institute of Electrical and Electronics Engineers Inc. 2017. p. 516-519. 7840186. (Proceedings of the IEEE International Conference on Advanced Materials for Science and Engineering: Innovation, Science and Engineering, IEEE-ICAMSE 2016). doi: 10.1109/ICAMSE.2016.7840186

Interactive audio-visual performance system controlled by smartphone based on arm movements

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this