Kernel Size Adjustment Based on Error Variance for Correntropy Learning Algorithms 


Vol. 46,  No. 2, pp. 225-230, Feb.  2021
10.7840/kics.2021.46.2.225


PDF
  Abstract

The MCC (maximization of correntropy criterion) as one of ITL (information theoretic learning) criteria, has the inverse of kernel size squared in its slope for maximization, and this term causes the system instability. Recently, studies for adaptively adjusting the kernel size of the slope with the inverse of kernel size squared being removed. In those studies, however, the process of minimum error sample extraction employed for impulsive noise robustness leads the kernel size to zero after convergence, so that the weight adjustment cannot continue. In this paper it is proposed that without the minimum error sample extraction, an averaging and smoothing process on the absolute values of a block of error samples can create an appropriate kernel size. In the experiment, the proposed algorithm continues its weight adjustment even after convergence and yields enhanced learning performance by about 2 dB of steady state MSE with faster convergence speed compared to the conventional algorithm.

  Statistics
Cumulative Counts from November, 2022
Multiple requests among the same browser session are counted as one view. If you mouse over a chart, the values of data points will be shown.


  Cite this article

[IEEE Style]

N. Kim, "Kernel Size Adjustment Based on Error Variance for Correntropy Learning Algorithms," The Journal of Korean Institute of Communications and Information Sciences, vol. 46, no. 2, pp. 225-230, 2021. DOI: 10.7840/kics.2021.46.2.225.

[ACM Style]

Namyong Kim. 2021. Kernel Size Adjustment Based on Error Variance for Correntropy Learning Algorithms. The Journal of Korean Institute of Communications and Information Sciences, 46, 2, (2021), 225-230. DOI: 10.7840/kics.2021.46.2.225.

[KICS Style]

Namyong Kim, "Kernel Size Adjustment Based on Error Variance for Correntropy Learning Algorithms," The Journal of Korean Institute of Communications and Information Sciences, vol. 46, no. 2, pp. 225-230, 2. 2021. (https://doi.org/10.7840/kics.2021.46.2.225)