Conference Papers

Permanent URI for this collectionhttps://idr.nitk.ac.in/handle/123456789/28506

Browse

Filters

20242

Settings

Author: search.filters.author.Anand Kumar, M.Subject: search.filters.subject.Multimodal

Search Results

Now showing 1 - 2 of 2
  • No Thumbnail Available
    Item
    Creation and Classification of Kannada Meme Dataset: Exploring Domain and Troll Categories
    (Springer Science and Business Media Deutschland GmbH, 2024) Kundargi, S.Y.; N, N.; Anand Kumar, M.; Chakravarthi, B.R.
    In this pioneering research, the first-ever Kannada memes dataset is established, marking a groundbreaking contribution. This dataset encompasses 2002 memes, spanning various categories such as movies, politics, sports, trolls, and non-troll memes. The classification models have been meticulously fine-tuned for memes, incorporating image-based models using DenseNet169 and text-based models with BERT for text encoding. An innovative multimodal approach combines insights from images and text, acknowledging the comprehensive nature of meme content. Throughout the study, model strengths and weaknesses are assessed, emphasizing their reliance on cutting-edge technologies like Deep Learning and Natural Language Processing. Valuable improvements are recommended, such as the implementation of oversampling techniques and regular dataset updates to enhance relevance and accuracy. This work extends beyond immediate research, contributing to the development of adaptive meme classification systems, particularly for Kannada-speaking audiences within the evolving meme culture landscape. Notably, the results indicate that multimodal models achieved the best scores for domain classification, while image-based models excelled in troll meme classification, further highlighting the significance of this approach within the field. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.
  • No Thumbnail Available
    Item
    Multimodal Propaganda Detection in Memes with Tolerance-Based Soft Computing Method
    (Springer Science and Business Media Deutschland GmbH, 2024) Kelkar, S.; Ravi, S.; Ramanna, S.; Anand Kumar, M.
    This paper presents a tolerance-based near sets-based classifier applied to multimodal propaganda detection task using text and image data originating from Memes. Memes on the internet consist of an image superimposed with text and are very popular in social media. They are often used as a part of disinformation campaign whereby social media users are influenced via a number of rhetorical and psychological techniques known as persuasion techniques. The focus of this paper is on a subtask of the SemEval-2024 Multilingual Detection of Persuasion Techniques Competition in Memes to detect the presence or absence of a persuasion technique. We introduce a multimodal Tolerance Near Sets Classifier (MTNSC) trained on a combination of word embeddings (RoBERTa) and pre-trained image features (ResNet and ResNet-Memes) using the competition data. This work extends our earlier work in the Natural Language Processing domain where a tolerance-based near sets-based sentiment classifier was introduced. The proposed MTNSC achieves a macro F1 score of 70.15% and micro-F1 score of 75.33% on the test dataset demonstrating satisfactory performance of TNS-based classifiers in a multimodal setting. Our findings point to the model’s effectiveness when compared to a few leading submissions based on deep learning techniques. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.