A knowledge enforcement network-based approach for classifying a photographer's images
Document Type
Article
Publication Date
12-15-2022
Abstract
Classification of photos captured by different photographers is an important and challenging problem in knowledge-based and image processing. Monitoring and authenticating images uploaded on social media are essential, and verifying the source is one key piece of evidence. We present a novel framework for classifying photos of different photographers based on the combination of local features and deep learning models. The proposed work uses focused and defocused information in the input images to extract contextual information. The model estimates the weighted gradient and calculates entropy to strengthen context features. The focused and defocused information is fused to estimate cross-covariance and define a linear relationship between them. This relationship results in a feature matrix fed to Knowledge Enforcement Network (KEN) for obtaining representative features. Due to the strong discriminative ability of deep learning models, we employ the lightweight and accurate MobileNetV2. The output of KEN and MobileNetV2 is sent to a classifier for photographer classification. Experimental results of the proposed model on our dataset of 46 photographer classes (46234 images) and publicly available datasets of 41 photographer classes (218303 images) show that the method outperforms the existing techniques by 5%-10% on average. The dataset created for the experimental purpose will be made available upon publication.
Keywords
Focused region classification, Defocused region classification, Low-high pass filters, Entropy features, Deep learning, Photographer identification
Divisions
Computer
Funders
Ministry of Education, Malaysia,Fundamental Research Grant Scheme (FRGS) (Grant No: FRGS/1/2020/ICT02/UM/02/4),National Natural Science Foundation of China (NSFC) (Grant No: 61672273),ISI-UTS Joint Research Cluster (TIH)
Publication Title
International Journal of Pattern Recognition and Artificial Intelligence
Volume
36
Issue
15
Publisher
World Scientific Publ Co Pte Ltd
Publisher Location
5 TOH TUCK LINK, SINGAPORE 596224, SINGAPORE