[IEEE 2013 IEEE International Conference on Control System, Computing and Engineering (ICCSCE) -...

5
Phase Congruency Image and Sparse Classifier for Newborn Classifying Pain State Muhammad Naufal Mansor School of Mehatronic Engineering Universiti Malaysia Perlis Perlis, Malaysia [email protected] Mohd Nazri Rejab Department of Mechanical Politeknik Tuanku Syed Sirajuddin Perlis, Malaysia [email protected] Abstract—Most of infant pain cause changes in the face. Clinicians use image analysis to characterize the pathological faces. Nowadays, infant pain research is increasing dramatically due to high demand from all medical team. This paper presents a sparse and naïve Bayes classifier for the diagnosis of infant pain disorders. Phase congruency image and local binary pattern are proposed. The proposed algorithms provide very promising classification rate. Index Terms—Infant Pain, Phase congruency image, Local Binary Pattern, Sparse Classifier, Naïve Bayes Classifier. I. INTRODUCTION Nowadays, people have a problem of failing in handling their pain states due the factors such as lack of support, inspiration and motivation. It affects their attitude and deteriorates their performance in daily life and working ability. Recent days, the affective states of a human can be detected through visual modalities, including facial expressions, muscle movements, action units, and body movements [17]. Thus, objective assessments’ techniques have been proposed to facilitate pain for assessing the infant pain events and improve inter-judge agreements about pain events [10-16]. However, these types of assessments are subjective, inconsistent, time-consuming and prone to error [10-13]. After that, in [1-8], an overview of automatic pain recognition and classification of pain events is discussed. There are variety approaches that have been considered in previous work. As we know, there is no previous work in existing literature using Phase congruency image as features extraction algorithm and sparse classifier as classification technique in this research area. Therefore, a feature extraction method is proposed for the recognition of pain using Phase congruency image in this paper. Sparse classifier is used for testing the effectiveness of the Phase congruency image features in the recognition of pain in infant images. Fig. 1 shows the general block diagram of infant pain recognition. II. PROPOSED METHOD As illustrated in Fig. 1, the experimental procedures can be divided into the following stages: preprocessing, feature extraction, and classification. The original images are adopted from Classification of Pain Expressions (COPE) database. The Images are reduced to 100pixels x 120pixels, in order to reduce the time processing. In the preprocessing stage, we present our new pre-processing method for infant pain recognition. In the feature extraction stage, facial features such as Phase congruency image and Local Binary Pattern are employed as the feature vectors further. Finally, sparse classifier and naïve Bayes classifier are used to classify the feature vectors into the following category pairs: pain/nonpain. All experiments were processed in the MATLAB environment under Windows XP operating system using an Intel® Core ™ 2Duo CPU, 2.80 GHz processor. Fig. 1. Infant pain Experimental Design NO NO YES YES Results Validation End Start Preprocessing Data System Implementation & Testing Feature Extraction Decision Making Using Classifier 2013 IEEE International Conference on Control System, Computing and Engineering, 29 Nov. - 1 Dec. 2013, Penang, Malaysia 978-1-4799-1508-8/13/$31.00 ©2013 IEEE 450

Transcript of [IEEE 2013 IEEE International Conference on Control System, Computing and Engineering (ICCSCE) -...

Page 1: [IEEE 2013 IEEE International Conference on Control System, Computing and Engineering (ICCSCE) - Penang, Malaysia (2013.11.29-2013.12.1)] 2013 IEEE International Conference on Control

Phase Congruency Image and Sparse Classifier for Newborn Classifying Pain State

Muhammad Naufal Mansor School of Mehatronic Engineering

Universiti Malaysia Perlis Perlis, Malaysia

[email protected]

Mohd Nazri Rejab Department of Mechanical

Politeknik Tuanku Syed Sirajuddin Perlis, Malaysia

[email protected]

Abstract—Most of infant pain cause changes in the face. Clinicians use image analysis to characterize the pathological faces. Nowadays, infant pain research is increasing dramatically due to high demand from all medical team. This paper presents a sparse and naïve Bayes classifier for the diagnosis of infant pain disorders. Phase congruency image and local binary pattern are proposed. The proposed algorithms provide very promising classification rate.

Index Terms—Infant Pain, Phase congruency image, Local Binary Pattern, Sparse Classifier, Naïve Bayes Classifier.

I. INTRODUCTION

Nowadays, people have a problem of failing in handling their pain states due the factors such as lack of support, inspiration and motivation. It affects their attitude and deteriorates their performance in daily life and working ability. Recent days, the affective states of a human can be detected through visual modalities, including facial expressions, muscle movements, action units, and body movements [17]. Thus, objective assessments’ techniques have been proposed to facilitate pain for assessing the infant pain events and improve inter-judge agreements about pain events [10-16]. However, these types of assessments are subjective, inconsistent, time-consuming and prone to error [10-13]. After that, in [1-8], an overview of automatic pain recognition and classification of pain events is discussed. There are variety approaches that have been considered in previous work. As we know, there is no previous work in existing literature using Phase congruency image as features extraction algorithm and sparse classifier as classification technique in this research area.

Therefore, a feature extraction method is proposed for the recognition of pain using Phase congruency image in this paper. Sparse classifier is used for testing the effectiveness of the Phase congruency image features in the recognition of pain in infant images. Fig. 1 shows the general block diagram of infant pain recognition.

II. PROPOSED METHOD

As illustrated in Fig. 1, the experimental procedures can be divided into the following stages: preprocessing, feature extraction, and classification. The original images are adopted from Classification of Pain Expressions (COPE) database. The

Images are reduced to 100pixels x 120pixels, in order to reduce the time processing. In the preprocessing stage, we present our new pre-processing method for infant pain recognition. In the feature extraction stage, facial features such as Phase congruency image and Local Binary Pattern are employed as the feature vectors further. Finally, sparse classifier and naïve Bayes classifier are used to classify the feature vectors into the following category pairs: pain/nonpain. All experiments were processed in the MATLAB environment under Windows XP operating system using an Intel® Core ™ 2Duo CPU, 2.80 GHz processor.

Fig. 1. Infant pain Experimental Design

NO

NO YES

YES

Results Validation

End

Start

Preprocessing Data

System Implementation &

Testing

Feature Extraction

Decision Making Using Classifier

2013 IEEE International Conference on Control System, Computing and Engineering, 29 Nov. - 1 Dec. 2013, Penang, Malaysia

978-1-4799-1508-8/13/$31.00 ©2013 IEEE 450

Page 2: [IEEE 2013 IEEE International Conference on Control System, Computing and Engineering (ICCSCE) - Penang, Malaysia (2013.11.29-2013.12.1)] 2013 IEEE International Conference on Control

III. PRE-PROCESSING The our main step involved 3 subsection such as (a) Image

Subjects, (b) grayscale images (c) Feature Extraction (Phase congruency image and Local Binary Patten finally (d) Sparse classifier and naïve Bayes classifier.

A. Image Subjects Photographs were taken of the infants at baseline rest and

while experiencing several noxious stimuli: bodily disturbance, an air stimulus on the nose, friction on the external lateral surface of the heel, and the pain of a heel stick. The goal of the Infant COPE study design was to obtain a representative and challenging set of facial images for classification experiments [1-3].

Fig. 2. Infant COPE Database

B. Grayscale Image We convert the true color image of the subjects to the grayscale intensity image. The grayscale image eliminating the hue and saturation information while retaining the luminance [9] as shown in Fig.3.

Fig. 3. Grayscale Infant COPE Database Image

C. Noise Image Salt & Pepper noise was employed similar in [18]. In contrast from their studies, we expand the range of noise levels varied from 10% to 90% with increments of 20% to prone our

robustness. In Fig. 4, we present restoration results for the corrupted infant pain images.

Fig. 4. Noise Infant COPE Database Image

IV. FEATURE EXTRACTION A. Phase Congruency Image

Phase congruency image (PCI) provides a measure that is independent of the overall magnitude of the signal making it invariant to variations in image illumination and/or contrast as shown in Fig. 5. It can be shown that this measure of phase congruency is a function of the cosine of the deviation of each phase component from the mean

( ) ( )( )( )( )∑

∑ −=

n n

n n

xAxxA

xPCφφcos

)(1 (1)

This measure of phase congruency does not provide good

localization and it is also sensitive to noise. Kovesi [19-20] developed a modified measure consisting of the cosine minus the magnitude of the sine of the phase deviation; this produces a more localized response. For details of this phase congruency measure and its implementation see Kovesi [20-22].

Fig. 5. Phase congruency images of Infant COPE Database

2013 IEEE International Conference on Control System, Computing and Engineering, 29 Nov. - 1 Dec. 2013, Penang, Malaysia

451

Page 3: [IEEE 2013 IEEE International Conference on Control System, Computing and Engineering (ICCSCE) - Penang, Malaysia (2013.11.29-2013.12.1)] 2013 IEEE International Conference on Control

B. Local Binary Pattern The feature extraction algorithms used is Local Binary

Pattern (LBP) by [23-24]. LBP was introduced by Ojala et al. [25]. LBP value is computed by comparing it with those of its neighborhoods:

)(21

0, ci

p

i

iRP ggfLBP −×=∑

=

(2)

⎩⎨⎧

<≥

=0001

)(xx

xf (3)

where cg is the gray value of the center pixel, gi is the gray value of its neighbors, P is the number of neighbors and R is the radius of the neighborhood. LBP extracted the relevant information in a face image and encoded as efficiently as possible. The image face defined by LBP as shown in Fig 6.

Fig. 6. LBP of Infant COPE Database

V. CLASSIFIER A. Sparse Classifier

The Sparse Classifier (SC) is proposed in [26]. It is based on the assumption that the training samples of a particular class approximately form a linear basis for a new test sample belonging to the same class. If testkv , is the test sample

belonging to the thk class then,

k

n

iikik

knkknkkkkkktestk

k

v

vvvv

∈+=

∈++++=

∑=1

,,

,,2,2,1,1,, ...

α

ααα (4)

where sv ik ′, are the training samples of the thk class and

k∈ is the approximation error. Equation (5) expresses the assumption in terms of the training samples of a single class. Reconstruct a sample was done for each class by a linear combination of the training samples belonging to that class using.

ji

n

jjirecon viv

i

,1

,)( ∑=

= α (5)

The error between the reconstructed sample and the given test sample by

( ) ( ) 2,, irecontestktest vviverror −= (6)

Finally the class having the minimum error is the class of the given test sample. B. Naïve Bayes Classifier

The naïve Bayes classifier (NB) combines model with a decision rule. The common rule is to choose a better MAP decision rule. The algorithm of naïve Bayes classifier is shown as

( ) ( )cCfFpcCpclassify ii

n

ic==Π==

=1maxarg (7)

VI. EXPERIMENTAL RESULTS Conventional validation scheme is used for testing the

effectiveness of the results of the classifier. 80% of data are used for training and 20% of data are used for testing. Three analyses such as sensitivity, specificity and accuracy are conducted after extracting phase congruency features from each of the images under different noise levels with sparse and naïve Bayes classifier.

Fig. 7. Sensitivity Vs Different Noise Level

The result of the sensitivity analysis at various trials of sparse classifier with phase congruency is shown in Fig. 7. From the figure, it is observed that the sensitivity of the phase

2013 IEEE International Conference on Control System, Computing and Engineering, 29 Nov. - 1 Dec. 2013, Penang, Malaysia

452

Page 4: [IEEE 2013 IEEE International Conference on Control System, Computing and Engineering (ICCSCE) - Penang, Malaysia (2013.11.29-2013.12.1)] 2013 IEEE International Conference on Control

congruency + local binary pattern + sparse classifier is high compares to other approach.

Fig. 8. Specificity Vs Différent Noise Level

The result of the specificity analysis at various trials of sparse classifier with phase congruency is shown in Fig. 8. From the figure, it is observed that the specificity of the phase congruency + local binary pattern + sparse classifier is high compares to other approach.

Fig. 9. Accuracy Vs Différent Noise Level

The accuracy classification results of different features using phase congruency are tabulated in Fig.9. From the above figure, it is observed that the overall accuracy for the two case studies also varies or affects. From the above discussion, it is observed that the suggested features, of combination between phase congruency and local binary pattern can be used as a good discriminating parameter of normal and pathological (pain) infant. Moreover, it can be concluded that, the proposed classifiers can be used for maximum classification of infant pain since the classification accuracies are very promising and encouraging

VII. CONCLUSION

This paper presents a phase congruency extraction method based on different noise levels classification of pain. In order to test the effectiveness and reliability of the system, suggested sparse based classifier is used. Three experiments are conducted using the extracted features. The experimental results show that the suggested features give very promising classification accuracy of 88% for all the trial. The suggested method can be used to detect pain states of a newborn. In the future work, feature reduction will be applied to reduce feature dimension and other classification algorithms will be developed to improve the current results with less computation

ACKNOWLEDGMENT This research was conducted under Fundamental Research Grant Scheme (FRGS) which is contributed by Ministry of Higher Education Malaysia.

REFERENCES [1] S. C, Chuang, Shih F. Y., and. Slack M. R. "Machine

recognition and representation of neonatal facial displays of acute pain," Artificial Intelligence in Medicine 36(2), 2006, pp. 211-222.

[2] S. Brahnam, C. Chuang, S. S Randal, and Y. S Frank. "Machine assessment of neonatal facial expressions of acute pain," Decision Support Systems 43, 2007, pp. 1242-125.

[3] S. Brahnam , L. Nanni, and S. Randall. “Introduction to neonatal facial pain detection using common and advanced face classification techniques,” Advanced Computation Intelligence Paradigms in Healthcare, 1, Studies in Computational Intelligence (SCI) Series: Springer-Verlag, Berlin, 48, 2004, pp. 225-253

[4] S. Brahnam, F. C Cgao, Y. S Frank, and R. S Melinda. “SVM classification of neonatal facial image of pain,“ Proceedings of the 6th International Workshop on Fuzzy Login and Applications (WILF05),

[5] S. Brahnam and L. Nanni , "Neonatal facial pain detection using NNSOA and LSVM," Proceedings of the International Conference on Image Processing, Computer Vision, and Pattern Recognition (IPCV08), Las Vegas, vol. 2, 2008, pp. 352-357,

[6] L. Nanni, S. Brahnam, A. Lumini. "A local approach based on a local binary patterns variant texture descriptor for classifying pain states." Expert Systems with Applications 37(11) pp. 7888-7894

[7] S. Brahnam, C. F. Chuang, F. Y. Shih, and M. R. Slack, "SVM classification of neonatal facial images of pain," Fuzzy Logic and Applications, Isabelle Bloch, Alfredo Petrosino, Andrea G. B. Tettamanzi, editors, Lecture Notes in Computer Science, 3849, pp. 111-115

[8] K. Pun, and Y. Moon, "Recent advances in ear biometrics." pp. 144-149, 2004.

[9] C. Rafael Gonzalez, E. Richard Woods and L. Steven Eddins (2004). Digital Image Processing using MATLAB. Pearson Education. ISBN 978-81-7758-898-9.

[10] Spence K., Gillies D., Harrison D., Johnston L., Nagy S. A. Reliable pain assessment tool for clinical assessment in the neonatal intensive care unit. J Obstet Gynecol Neonatal Nurs.

2013 IEEE International Conference on Control System, Computing and Engineering, 29 Nov. - 1 Dec. 2013, Penang, Malaysia

453

Page 5: [IEEE 2013 IEEE International Conference on Control System, Computing and Engineering (ICCSCE) - Penang, Malaysia (2013.11.29-2013.12.1)] 2013 IEEE International Conference on Control

2003; 34:80-86. [11] Cignacco E., Mueller R., Hamers J.P.H. , Gessler P. Pain

assessment in the neonate using the Bernese Pain Scale for Newborns. Early Hum Dev. 2004; 78:115-121.

[12] Lawrence J., Alcock D., McGrath P., Kay S., Mac Murray S. B., Dulberg D. The development of a tool to assess neonatal pain. Neonatal Netw. 1993; 11:59-66.

[13] Krechel S.W., Bildner J. CRIES: a new neonatal postoperative pain measurement score. Initial testing of validity and reliability. Paediatr Anaesthesiol. 1995; 5:53-61.

[14] Stevens B., Johnston C., Petryshen P., Taddio A. Premature Infant Pain Profile: development and initial validation. Clin J Pain. 1996; 11:12-22.

[15] Hummel P., Lawlor-Klean P., Weiss M.G. Validity and reliability of the N-PASS assessment tool with acute pain. J Perinatol. 2009:1-5.

[16] Hummel P., Puchalski M., Creech S. D., Weiss M. G. Clinical reliability and validity of the N-PASS: neonatal pain, agitation and sedation scale with prolonged pain. J Perinatol. 2008; 16:55-60.

[17] Kwon O., Chan K., Hao J., and Lee T., "Emotion recognition by speech signals," in EUROSPEECH 2003, GENEVA, pp. 125-128, 2003.

[18] James C.C., Chen Y., and Stephen V. Rice Department of Computer and Information Science, University of Mississippi, “A Spatial Median Filter for Noise Removal in Digital Images”, IEEE, page(s): 618 623, 2008.

[19] Kovesi, P.D.: Invariant Measures of Image Features From Phase Information. PhD thesis, The University of Western Australia (1996)

[20] Kovesi, P.D.: Image features from phase congruency. Videre: Journal of Computer Vision Research 1 (1999) 1-26 http://mitpress.mit.edu/e-journals/Videre/.

[21] Kovesi, P.D.: Phase congruency: A low-level image invariant. Psychological Research 64 (2000) 136-148

[22] Kovesi, P.D.: MATLAB functions for computer vision and image analysis (1996-2003) http://www.csse.uwa.edu.au/»pk/Research/MatlabFns/.

[23] Lorris, N., Brahnam, S. and Alessandra, M. Selecting the Best Performing Rotation Invariant Patterns in Local Binary/Ternary Patterns. IPCV 2010 pp 369-375.

[24] Ahonen T, Hadid A and Pietikäinen. M. Face recognition with local binary patterns. Computer Vision, ECCV 2004 Proceedings, Lecture Notes in Computer Science 3021, Springer, 469-481. 2004

[25] Ojala, M. Pietikainen, D. and Harwood, A comparative sudy of texture measures with classification based on feature distributions, Elsevier J. Pattern Recognition, 29 (1): 51-59, 1996.

[26] Yang, Y. Wright, J. Ma Y. and Sastry, S. S. “Feature Selection in Face Recognition: A Sparse Representation Perspective”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 1 (2), pp. 210-227, 2009.

2013 IEEE International Conference on Control System, Computing and Engineering, 29 Nov. - 1 Dec. 2013, Penang, Malaysia

454