A Comparison of NoSQL and SQL Databases over the Hadoop and Spark Cloud Platforms Using Machine Learning Algorithms

Chao Hsien Lee; Zhe Wei Shih

doi:10.1109/ICCE-China.2018.8448621

A Comparison of NoSQL and SQL Databases over the Hadoop and Spark Cloud Platforms Using Machine Learning Algorithms

Chao Hsien Lee
, Zhe Wei Shih

Department of Electronic Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

5 Scopus citations

Abstract

Machine learning (ML) algorithms have been widely applied to data analytics and prediction. This paper extends our previous work, which proposed how to automatically convert data from the traditional SQL database to the new NoSQL database, to support the entity-relationship (ER) model. Based on our experimental results over two different cloud platforms, the NoSQL database can always provide better performance than the SQL database while executing ML algorithms.

Original language	English
Title of host publication	2018 IEEE International Conference on Consumer Electronics-Taiwan, ICCE-TW 2018
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Print)	9781538663011
DOIs	https://doi.org/10.1109/ICCE-China.2018.8448621
State	Published - 27 Aug 2018
Event	5th IEEE International Conference on Consumer Electronics-Taiwan, ICCE-TW 2018 - Taichung, Taiwan Duration: 19 May 2018 → 21 May 2018

Publication series

Name	2018 IEEE International Conference on Consumer Electronics-Taiwan, ICCE-TW 2018

Conference

Conference	5th IEEE International Conference on Consumer Electronics-Taiwan, ICCE-TW 2018
Country/Territory	Taiwan
City	Taichung
Period	19/05/18 → 21/05/18

Bibliographical note

Publisher Copyright:
© 2018 IEEE.

Access to Document

10.1109/ICCE-China.2018.8448621

Cite this

Lee, C. H., & Shih, Z. W. (2018). A Comparison of NoSQL and SQL Databases over the Hadoop and Spark Cloud Platforms Using Machine Learning Algorithms. In 2018 IEEE International Conference on Consumer Electronics-Taiwan, ICCE-TW 2018 Article 8448621 (2018 IEEE International Conference on Consumer Electronics-Taiwan, ICCE-TW 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICCE-China.2018.8448621

Lee, Chao Hsien ; Shih, Zhe Wei. / A Comparison of NoSQL and SQL Databases over the Hadoop and Spark Cloud Platforms Using Machine Learning Algorithms. 2018 IEEE International Conference on Consumer Electronics-Taiwan, ICCE-TW 2018. Institute of Electrical and Electronics Engineers Inc., 2018. (2018 IEEE International Conference on Consumer Electronics-Taiwan, ICCE-TW 2018).

@inproceedings{c893764ab544454a8381e2fd319b83e3,

title = "A Comparison of NoSQL and SQL Databases over the Hadoop and Spark Cloud Platforms Using Machine Learning Algorithms",

abstract = "Machine learning (ML) algorithms have been widely applied to data analytics and prediction. This paper extends our previous work, which proposed how to automatically convert data from the traditional SQL database to the new NoSQL database, to support the entity-relationship (ER) model. Based on our experimental results over two different cloud platforms, the NoSQL database can always provide better performance than the SQL database while executing ML algorithms.",

author = "Lee, \{Chao Hsien\} and Shih, \{Zhe Wei\}",

note = "Publisher Copyright: {\textcopyright} 2018 IEEE.; 5th IEEE International Conference on Consumer Electronics-Taiwan, ICCE-TW 2018 ; Conference date: 19-05-2018 Through 21-05-2018",

year = "2018",

month = aug,

day = "27",

doi = "10.1109/ICCE-China.2018.8448621",

language = "???core.languages.en\_GB???",

isbn = "9781538663011",

series = "2018 IEEE International Conference on Consumer Electronics-Taiwan, ICCE-TW 2018",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "2018 IEEE International Conference on Consumer Electronics-Taiwan, ICCE-TW 2018",

}

Lee, CH & Shih, ZW 2018, A Comparison of NoSQL and SQL Databases over the Hadoop and Spark Cloud Platforms Using Machine Learning Algorithms. in 2018 IEEE International Conference on Consumer Electronics-Taiwan, ICCE-TW 2018., 8448621, 2018 IEEE International Conference on Consumer Electronics-Taiwan, ICCE-TW 2018, Institute of Electrical and Electronics Engineers Inc., 5th IEEE International Conference on Consumer Electronics-Taiwan, ICCE-TW 2018, Taichung, Taiwan, 19/05/18. https://doi.org/10.1109/ICCE-China.2018.8448621

A Comparison of NoSQL and SQL Databases over the Hadoop and Spark Cloud Platforms Using Machine Learning Algorithms. / Lee, Chao Hsien; Shih, Zhe Wei.
2018 IEEE International Conference on Consumer Electronics-Taiwan, ICCE-TW 2018. Institute of Electrical and Electronics Engineers Inc., 2018. 8448621 (2018 IEEE International Conference on Consumer Electronics-Taiwan, ICCE-TW 2018).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - A Comparison of NoSQL and SQL Databases over the Hadoop and Spark Cloud Platforms Using Machine Learning Algorithms

AU - Lee, Chao Hsien

AU - Shih, Zhe Wei

PY - 2018/8/27

Y1 - 2018/8/27

N2 - Machine learning (ML) algorithms have been widely applied to data analytics and prediction. This paper extends our previous work, which proposed how to automatically convert data from the traditional SQL database to the new NoSQL database, to support the entity-relationship (ER) model. Based on our experimental results over two different cloud platforms, the NoSQL database can always provide better performance than the SQL database while executing ML algorithms.

AB - Machine learning (ML) algorithms have been widely applied to data analytics and prediction. This paper extends our previous work, which proposed how to automatically convert data from the traditional SQL database to the new NoSQL database, to support the entity-relationship (ER) model. Based on our experimental results over two different cloud platforms, the NoSQL database can always provide better performance than the SQL database while executing ML algorithms.

UR - https://www.scopus.com/pages/publications/85053935250

U2 - 10.1109/ICCE-China.2018.8448621

DO - 10.1109/ICCE-China.2018.8448621

M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???

AN - SCOPUS:85053935250

SN - 9781538663011

T3 - 2018 IEEE International Conference on Consumer Electronics-Taiwan, ICCE-TW 2018

BT - 2018 IEEE International Conference on Consumer Electronics-Taiwan, ICCE-TW 2018

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 5th IEEE International Conference on Consumer Electronics-Taiwan, ICCE-TW 2018

Y2 - 19 May 2018 through 21 May 2018

ER -

Lee CH, Shih ZW. A Comparison of NoSQL and SQL Databases over the Hadoop and Spark Cloud Platforms Using Machine Learning Algorithms. In 2018 IEEE International Conference on Consumer Electronics-Taiwan, ICCE-TW 2018. Institute of Electrical and Electronics Engineers Inc. 2018. 8448621. (2018 IEEE International Conference on Consumer Electronics-Taiwan, ICCE-TW 2018). doi: 10.1109/ICCE-China.2018.8448621

A Comparison of NoSQL and SQL Databases over the Hadoop and Spark Cloud Platforms Using Machine Learning Algorithms

Abstract

Publication series

Conference

Bibliographical note

Access to Document

Other files and links

Fingerprint

Cite this