Impact of Input Data Randomness on Training Performance of Basic Autoencoder and Stacked Autoencoder 


Vol. 47,  No. 1, pp. 178-187, Jan.  2022
10.7840/kics.2022.47.1.178


PDF
  Abstract

In this paper, we examine the impact of the input data randomness on the traning performance of the autoencoder. Assuming the input data follow a Gaussian distribution, we mathematically analyze that the randomness of the input data and the training performance of the autoencoder have a linear relationship, and demonstrate this finding through experiments. Experiments on the basic autoencoder and the stacked autoencoder confirm that the input data randomness and the training performance of the autoencoder have a linear relationship regardless of the number of hidden layers. In addition, we examine the training performance of autoencoder according to the mean and standard deviation of the input data. The results support that the mean of the input data has a negligible effect on the training loss of the autoencoder. Therefore, we ensure consistency between mathematical analysis and the experimental results that the number of nodes in the hidden layer increases, the training loss of the autoencoder and the impact of input data randomness decrease.

  Statistics
Cumulative Counts from November, 2022
Multiple requests among the same browser session are counted as one view. If you mouse over a chart, the values of data points will be shown.


  Cite this article

[IEEE Style]

J. Rheey, D. Jung, H. Park, "Impact of Input Data Randomness on Training Performance of Basic Autoencoder and Stacked Autoencoder," The Journal of Korean Institute of Communications and Information Sciences, vol. 47, no. 1, pp. 178-187, 2022. DOI: 10.7840/kics.2022.47.1.178.

[ACM Style]

Joohong Rheey, Daeun Jung, and Hyunggon Park. 2022. Impact of Input Data Randomness on Training Performance of Basic Autoencoder and Stacked Autoencoder. The Journal of Korean Institute of Communications and Information Sciences, 47, 1, (2022), 178-187. DOI: 10.7840/kics.2022.47.1.178.

[KICS Style]

Joohong Rheey, Daeun Jung, Hyunggon Park, "Impact of Input Data Randomness on Training Performance of Basic Autoencoder and Stacked Autoencoder," The Journal of Korean Institute of Communications and Information Sciences, vol. 47, no. 1, pp. 178-187, 1. 2022. (https://doi.org/10.7840/kics.2022.47.1.178)