Information Retrieval Techniques Research Articles

Enhancing Suggestion Detection in Online User Reviews through Integrated Information Retrieval and Deep Learning Approaches

In the aftermath of the COVID-19 pandemic, using web platforms as a communication medium and decision-making tool in online commerce has become widely acknowledged. User-generated comments, reflecting positive and negative sentiments towards specific items, serve as invaluable indicators, offering recommendations for product and organizational improvements. Consequently, the extraction of suggestions from mined opinions can enhance the efficacy of companies and organizations in this domain. Prevailing research in suggestion mining predominantly employs rule-based methodologies and statistical classifiers, relying on manually identified features. However, a recent trend has emerged wherein researchers explore solutions grounded in deep learning tools and techniques. This study aims to employ information retrieval techniques for the automated identification of suggestions. To this end, various methodologies, including distance measurement approaches, multilayer perceptron neural networks, support vector machines, regression logistics, convolutional neural networks utilizing TF-IDF, Bag of Words (BOW), and Word2Vec vectors, along with keyword extraction, have been integrated. The proposed approach is assessed using the SemEval2019 dataset to extract suggestions from the textual content of online user reviews. The obtained results demonstrate a notable enhancement in the F1 score, reaching 0.76 compared to prior research. The experiments further suggest that information retrieval-based approaches exhibit promising potential for this specific task.

CURRICULUM VITAE ANALYSIS USING MACHINE LEARNING ALGORITHM

We describe a system called CV analysis machine, that processes a set of given free-form textual resumes (in English for IT domain), creates a standardized profile for each candidate, and for a given job description, identifies a ranked shortlist of k candidates, along with a matching score for each. The resume scoring function is hand-crafted, hierarchical, and uses domain-knowledge from recruitment experts. We describe a simple neural- network system that automatically learns some weights used in the scoring function, based on feedback about whether the candidate has their grades on each portion and calculate the overall grade of each candidate and find all grades at a time. Companies often receive thousands of resumes for each job posting and employ dedicated screeners to short list qualified applicants. In this paper, we present PROSPECT, a decision support tool to help these screeners shortlist resumes efficiently. Prospect mines resumes to extract salient aspects of candidate profiles like skills, experience in each skill, education details and experience. Extracted information is presented in the form of facets to aid recruiters in the task of screening. We also employ Information Retrieval techniques to rank all applicants for a given job opening. In our experiments we show that extracted information improves our ranking by 30% there by making screening tasks simpler and more efficient. Keywords--e-recruitment,aptitude,personality prediction,credentials,Big five model of Personality

Utilizing BERT for Information Retrieval: Survey, Applications, Resources, and Challenges

Recent years have witnessed a substantial increase in the use of deep learning to solve various natural language processing (NLP) problems. Early deep learning models were constrained by their sequential or unidirectional nature, such that they struggled to capture the contextual relationships across text inputs. The introduction of bidirectional encoder representations from transformers (BERT) leads to a robust encoder for the transformer model that can understand the broader context and deliver state-of-the-art performance across various NLP tasks. This has inspired researchers and practitioners to apply BERT to practical problems, such as information retrieval (IR). A survey that focuses on a comprehensive analysis of prevalent approaches that apply pretrained transformer encoders like BERT to IR can thus be useful for academia and the industry. In light of this, we revisit a variety of BERT-based methods in this survey, cover a wide range of techniques of IR, and group them into six high-level categories: (i) handling long documents, (ii) integrating semantic information, (iii) balancing effectiveness and efficiency, (iv) predicting the weights of terms, (v) query expansion, and (vi) document expansion. We also provide links to resources, including datasets and toolkits, for BERT-based IR systems. Additionally, we highlight the advantages of employing encoder-based BERT models in contrast to recent large language models like ChatGPT, which are decoder-based and demand extensive computational resources. Finally, we summarize the comprehensive outcomes of the survey and suggest directions for future research in the area.

Evaluation of Natural Language Processing Techniques for Information Retrieval

Purpose: The main objective of the study was to investigate the evaluation of Natural Language Processing techniques for information retrieval.
 Methodology: The study adopted a desktop research methodology. Desk research refers to secondary data or that which can be collected without fieldwork. Desk research is basically involved in collecting data from existing resources hence it is often considered a low cost technique as compared to field research, as the main cost is involved in executive’s time, telephone charges and directories. Thus, the study relied on already published studies, reports and statistics. This secondary data was easily accessed through the online journals and library.
 Findings: The findings reveal that there exists a contextual and methodological gap relating to Natural Language Processing techniques for information retrieval. Preliminary empirical review revealed that NLP methods significantly improved the accuracy and efficiency of information retrieval systems. Through systematic evaluation, various NLP techniques, including tokenization, named entity recognition, semantic parsing, and word embeddings, were found to enhance retrieval performance across diverse datasets and domains. By considering context and user intent, researchers aimed to develop more contextually aware and personalized information retrieval systems. The study emphasized the need for further research to explore hybrid approaches and domain-specific adaptations, ultimately highlighting the transformative potential of NLP in revolutionizing information access and utilization.
 Unique Contribution to Theory, Practice and Policy: Information Foraging theory, Relevance theory and Cognitive Load theory may be used to anchor future studies on Natural Language Processing techniques. The study provided recommendations to enhance information retrieval systems. It suggested integrating advanced NLP techniques such as named entity recognition and sentiment analysis to improve query understanding and document relevance. Additionally, the study recommended adopting word embeddings and semantic parsing techniques for better semantic understanding of user queries and documents. It emphasized the importance of domain-specific adaptations and continuous evaluation of NLP techniques to tailor them to specific application domains and keep pace with evolving user needs and technological advancements.

Unsupervised Extractive Summarization with Learnable Length Control Strategies

Unsupervised extractive summarization is an important technique in information extraction and retrieval. Compared with supervised method, it does not require high-quality human-labelled summaries for training and thus can be easily applied for documents with different types, domains or languages. Most of existing unsupervised methods including TextRank and PACSUM rely on graph-based ranking on sentence centrality. However, this scorer can not be directly applied in end-to-end training, and the positional-related prior assumption is often needed for achieving good summaries. In addition, less attention is paid to length-controllable extractor, where users can decide to summarize texts under particular length constraint. This paper introduces an unsupervised extractive summarization model based on a siamese network, for which we develop a trainable bidirectional prediction objective between the selected summary and the original document. Different from the centrality-based ranking methods, our extractive scorer can be trained in an end-to-end manner, with no other requirement of positional assumption. In addition, we introduce a differentiable length control module by approximating 0-1 knapsack solver for end-to-end length-controllable extracting. Experiments show that our unsupervised method largely outperforms the centrality-based baseline using a same sentence encoder. In terms of length control ability, via our trainable knapsack module, the performance consistently outperforms the strong baseline without utilizing end-to-end training. Human evaluation further evidences that our method performs the best among baselines in terms of relevance and consistency.

GPDminer: a tool for extracting named entities and analyzing relations in biological literature

PurposeThe expansion of research across various disciplines has led to a substantial increase in published papers and journals, highlighting the necessity for reliable text mining platforms for database construction and knowledge acquisition. This abstract introduces GPDMiner(Gene, Protein, and Disease Miner), a platform designed for the biomedical domain, addressing the challenges posed by the growing volume of academic papers.MethodsGPDMiner is a text mining platform that utilizes advanced information retrieval techniques. It operates by searching PubMed for specific queries, extracting and analyzing information relevant to the biomedical field. This system is designed to discern and illustrate relationships between biomedical entities obtained from automated information extraction.ResultsThe implementation of GPDMiner demonstrates its efficacy in navigating the extensive corpus of biomedical literature. It efficiently retrieves, extracts, and analyzes information, highlighting significant connections between genes, proteins, and diseases. The platform also allows users to save their analytical outcomes in various formats, including Excel and images.ConclusionGPDMiner offers a notable additional functionality among the array of text mining tools available for the biomedical field. This tool presents an effective solution for researchers to navigate and extract relevant information from the vast unstructured texts found in biomedical literature, thereby providing distinctive capabilities that set it apart from existing methodologies. Its application is expected to greatly benefit researchers in this domain, enhancing their capacity for knowledge discovery and data management.

RANCANG BANGUN APLIKASI STEGANOGRAFI UNTUK MENGAMANKAN PESAN MENGGUNAKAN METODE LEAST SIGNIFICANT BIT (LSB) BERBASIS ANDROID

The Internet, an interconnected network, has become one of the most widespread data communications medias in the world. With the development of various illegal information retrieval techniques, many people try to get information that does not belong to them. Various techniques to protect sensitive information from unauthorized persons are widely used to protect important information. Steganography is a technique for hiding message files from the public who know their existence. This technique is often used to avoid suspicion or people who want to know the contents of the message file. Steganography is the science and technique of writing hidden messages so that no one else knows about their existence. Therefore, the application of plain-text steganography is inserted into the Least Significant Bit (LSB) encrypted image carrier. This allows mobile users to send the author's message to the recipient securely..

Cultural Adaptation of Recipes

Abstract Building upon the considerable advances in Large Language Models (LLMs), we are now equipped to address more sophisticated tasks demanding a nuanced understanding of cross-cultural contexts. A key example is recipe adaptation, which goes beyond simple translation to include a grasp of ingredients, culinary techniques, and dietary preferences specific to a given culture. We introduce a new task involving the translation and cultural adaptation of recipes between Chinese- and English-speaking cuisines. To support this investigation, we present CulturalRecipes, a unique dataset composed of automatically paired recipes written in Mandarin Chinese and English. This dataset is further enriched with a human-written and curated test set. In this intricate task of cross-cultural recipe adaptation, we evaluate the performance of various methods, including GPT-4 and other LLMs, traditional machine translation, and information retrieval techniques. Our comprehensive analysis includes both automatic and human evaluation metrics. While GPT-4 exhibits impressive abilities in adapting Chinese recipes into English, it still lags behind human expertise when translating English recipes into Chinese. This underscores the multifaceted nature of cultural adaptations. We anticipate that these insights will significantly contribute to future research on culturally aware language models and their practical application in culturally diverse contexts.

Information Retrieval and Machine Learning Methods for Academic Expert Finding

In the context of academic expert finding, this paper investigates and compares the performance of information retrieval (IR) and machine learning (ML) methods, including deep learning, to approach the problem of identifying academic figures who are experts in different domains when a potential user requests their expertise. IR-based methods construct multifaceted textual profiles for each expert by clustering information from their scientific publications. Several methods fully tailored for this problem are presented in this paper. In contrast, ML-based methods treat expert finding as a classification task, training automatic text classifiers using publications authored by experts. By comparing these approaches, we contribute to a deeper understanding of academic-expert-finding techniques and their applicability in knowledge discovery. These methods are tested with two large datasets from the biomedical field: PMSC-UGR and CORD-19. The results show how IR techniques were, in general, more robust with both datasets and more suitable than the ML-based ones, with some exceptions showing good performance.

Classification and visualization: Twitter sentiment analysis of Malaysia’s private hospitals

Malaysia has many private’s hospitals. Thus, feedback is important to improve service quality, becoming reviews for other patients. Reviews use the channel service provided on social media, such as Twitter. Nevertheless, online reviews are unstructured and enormous in volume, which leads to difficulties in comparing private hospitals. In addition, no single websites compare private hospitals based on users’ interests, bilingual reviews, and less time-consuming. Due to that, this study aims to classify and visualize the Twitter sentiment analysis of private hospitals in Malaysia. The scope focuses on five factors: 1) administrative procedure, 2) cost, 3) communication, 4) expertise, and 5) service. Term frequency-inverse document frequency is used for text mining, information retrieval techniques, and the Naïve Bayes, a machine learning algorithm for the classification. The user can visualize the specified state’s private hospitals and compare them with any selected state. The system’s functionality and usability have been tested to ensure it meets the objectives. Functionality testing proved that the private hospital’s Twitter sentiment could be predicted based on the training and testing data as intended, with 77.13% and 77.96% accuracy for English and Bahasa Melayu, respectively, while the system usability scale based on the usability testing resulted in an average final score of 95.42%.

Content-based image retrieval based on corel dataset using deep learning

A popular technique for retrieving images from huge and unlabeled image databases are content-based-image-retrieval (CBIR). However, the traditional information retrieval techniques do not satisfy users in terms of time consumption and accuracy. Additionally, the number of images accessible to users are growing due to web development and transmission networks. As the result, huge digital image creation occurs in many places. Therefore, quick access to these huge image databases and retrieving images like a query image from these huge image collections provides significant challenges and the need for an effective technique. Feature extraction and similarity measurement are important for the performance of a CBIR technique. This work proposes a simple but efficient deep-learning framework based on convolutional-neural networks (CNN) for the feature extraction phase in CBIR. The proposed CNN aims to reduce the semantic gap between low-level and high-level features. The similarity measurements are used to compute the distance between the query and database image features. When retrieving the first 10 pictures, an experiment on the Corel-1K dataset showed that the average precision was 0.88 with Euclidean distance, which was a big step up from the state-of-the-art approaches.

DECIPHERING USER FEEDBACK: CLUSTERING OF DIGITAL WELL-BEING SYSTEM REVIEWS

This research holds significant importance in the realm of digital well-being, addressing the increasing concern over digital addiction. By analyzing user feedback on digital well-being systems, the study provides valuable insights into the effectiveness of these systems in moderating digital habits. It contributes to understanding how digital detox applications can mitigate compulsive smartphone use, thereby enhancing mental health. The study stands out for its unique approach to clustering user feedback on two popular digital well-being systems, Space and Google Well-being app. This original approach provides a novel perspective on user interaction with digital well-being tools, distinguishing it from existing literature which primarily focuses on general usage patterns and the impact on mental health. The purpose of this research is to systematically analyze and cluster user feedback on digital well-being systems. It also incorporates information retrieval techniques like topic modeling to extract main topics from these reviews. This methodology allows for an in-depth understanding of user feedback, going beyond mere statistical analysis to capture the nuances of user experiences and expectations. The findings of this research have significant implications for software developers and stakeholders in the digital well-being domain.

Towards a Method to Enable the Selection of Physical Models within the Systems Engineering Process: A Case Study with Simulink Models

The use of different techniques and tools is a common practice to cover all stages in the development life-cycle of systems generating a significant number of work products. These artefacts are frequently encoded using diverse formats, and often require access through non-standard protocols and formats. In this context, Model-Based Systems Engineering (MBSE) emerges as a methodology to shift the paradigm of Systems Engineering practice from a document-oriented environment to a model-intensive environment. To achieve this major goal, a formalised application of modelling is employed throughout the life-cycle of systems to generate various system artefacts represented as models, such as requirements, logical models, and multi-physics models. However, the mere use of models does not guarantee one of the main challenges in the Systems Engineering discipline, namely, the reuse of system artefacts. Considering the fact that models are becoming the main type of system artefact, it is necessary to provide the capability to properly and efficiently represent and retrieve the generated models. In light of this, traditional information retrieval techniques have been widely studied to match existing software assets according to a set of capabilities or restrictions. However, there is much more at stake than the simple retrieval of models or even any piece of knowledge. An environment for model reuse must provide the proper mechanisms to (1) represent any piece of data, information, or knowledge under a common and shared data model, and (2) provide advanced retrieval mechanisms to elevate the meaning of information resources from text-based descriptions to concept-based ones. This need has led to novel methods using word embeddings and vector-based representations to semantically encode information. Such methods are applied to encode the information of physical models while preserving their underlying semantics. In this study, a text corpus from MATLAB Simulink models was preprocessed using Natural Language Processing (NLP) techniques and trained to generate word vector representations. Then, the presented method was validated using a testbed of MATLAB Simulink physical models in which verbalisations of models are transformed into vectors. The effectiveness of the proposed solution was assessed through a use case study. Evaluation of the results demonstrates a precision value of 0.925, a recall value of 0.865, and an F1 score of 0.884.

Numerical analysis-oriented Kruskal algorithm for the analysis and integration of effective components of university music pedagogy

Abstract This paper constructs a collection of effective teaching methods based on the improved K-Means clustering algorithm for clustering and dividing effective components of music teaching in colleges and universities. By analyzing the personalized content recommendation system, we can construct a recommendation system based on teaching content using information retrieval and filtering techniques. The collaborative filtering recommendation algorithm is used to ensure the accurate placement of teaching content. The Kruskal algorithm is used to find the minimum spanning tree of teaching effective components, and the K-means clustering principle is applied to the division of music teaching effective components, and the cluster of effective teaching components is divided by the clustering algorithm. According to the findings, mind-body integration and the teaching goal of valuing creativity were classified as effective teaching components in music. Personal aesthetics had a 0.6 influence on musical creativity, and a free environment had a 0.3 influence.

Concept2Vec: concept vector generation for biomedical literature using concept modelling

<span>In the biomedical field due to tremendous medical research, every year the medical papers generated is very huge. In order to process these tremendous amounts of textual data, the information retrieval techniques are combined with machine learning methods like natural language processing (NLP) for finding the useful insights in data for NLP tasks. In this work, we have addressed the challenges involved in existing NLP techniques like Word2Vec, Doc2Vec, and Biosent2Vec and followed by the traditional classification of articles with Concept2Vec and random forest classification. Concept vector techniques are emerging methods in NLP and in information retrieval systems. Pretrained concept encoders are available in Machine learning, whereas no such exists in biomedical domain. In this paper a proposal on Concept2Vec trained from biomedical text is highlighted. Our work accurately emphasizes on the quality of semantics defined between the medical terms, which can help the medical practitioners in taking errorless decisions. In this work 20 thousand biomedical documents are considered for Concept2Vec embeddings and the proposed approach have shown best concept similarity in terms of relevant measures compared with existing approaches such as Word2Vec, global vectors (GloVe), fastText, and BioSentVec, bidirectional encoder representations from transformers (BERT), biomedical-BERT.</span>

UniLoc: Unified Fault Localization of Continuous Integration Failures

Continuous integration (CI) practices encourage developers to frequently integrate code into a shared repository. Each integration is validated by automatic build and testing such that errors are revealed as early as possible. When CI failures or integration errors are reported, existing techniques are insufficient to automatically locate the root causes for two reasons. First, a CI failure may be triggered by faults in source code and/or build scripts, whereas current approaches consider only source code. Second, a tentative integration can fail because of build failures and/or test failures, whereas existing tools focus on test failures only. This article presents UniLoc, the first unified technique to localize faults in both source code and build scripts given a CI failure log, without assuming the failure’s location (source code or build scripts) and nature (a test failure or not). Adopting the information retrieval (IR) strategy, UniLoc locates buggy files by treating source code and build scripts as documents to search and by considering build logs as search queries. However, instead of naïvely applying an off-the-shelf IR technique to these software artifacts, for more accurate fault localization, UniLoc applies various domain-specific heuristics to optimize the search queries, search space, and ranking formulas. To evaluate UniLoc, we gathered 700 CI failure fixes in 72 open source projects that are built with Gradle. UniLoc could effectively locate bugs with the average mean reciprocal rank value as 0.49, mean average precision value as 0.36, and normalized discounted cumulative gain value as 0.54. UniLoc outperformed the state-of-the-art IR-based tool BLUiR and Locus. UniLoc has the potential to help developers diagnose root causes for CI failures more accurately and efficiently.

Asymmetric low-rank double-level cooperation for scalable discrete cross-modal hashing

As an efficient information retrieval technique, cross-modal hashing has received increasing attention. However, the remaining challenges include (1) designing effective kernelization techniques to sufficiently strengthen the connections among different samples in kernel space and improve the class separability of data; (2) learning robust compact common representations to fully extract the correlation information between different modalities; and (3) fully leveraging underlying semantic information and embedding it into optimal hash codes. To conquer these challenges, we propose a novel algorithm called Asymmetric Low-rank Double-level Cooperation Hashing (ALDCH). First, we propose a novel Nonlinear Normalized Space Kernelization submodule (NNSK) to obtain the high-quality kernelized features, which can not only capture the more powerful nonlinear structure representations but also better express the nonlinear intra-modal correlations among the original features. To learn high-quality compact representations, we further propose a novel Low-rank Double-level Cooperation Mapping submodule (LDCM) with the L21-norm constraint, which can enhance the correlation of the coefficient spaces from different modalities and enable the samples to learn constrained and compact hash representations. Besides, our proposed method fully utilizes the underlying semantic label information by introducing the Semantic Pairwise Correlation Learning submodule (SPCL). Extensive experiments conducted on benchmark datasets demonstrate the accuracy and efficiency of ALDCH, which outperforms many state-of-the-art methods.

Improving information retrieval through correspondence analysis instead of latent semantic analysis

The initial dimensions extracted by latent semantic analysis (LSA) of a document-term matrix have been shown to mainly display marginal effects, which are irrelevant for information retrieval. To improve the performance of LSA, usually the elements of the raw document-term matrix are weighted and the weighting exponent of singular values can be adjusted. An alternative information retrieval technique that ignores the marginal effects is correspondence analysis (CA). In this paper, the information retrieval performance of LSA and CA is empirically compared. Moreover, it is explored whether the two weightings also improve the performance of CA. The results for four empirical datasets show that CA always performs better than LSA. Weighting the elements of the raw data matrix can improve CA; however, it is data dependent and the improvement is small. Adjusting the singular value weighting exponent often improves the performance of CA; however, the extent of the improvement depends on the dataset and the number of dimensions.

A Survey on Event-Based News Narrative Extraction

Narratives are fundamental to our understanding of the world, providing us with a natural structure for knowledge representation over time. Computational narrative extraction is a subfield of artificial intelligence that makes heavy use of information retrieval and natural language processing techniques. Despite the importance of computational narrative extraction, relatively little scholarly work exists on synthesizing previous research and strategizing future research in the area. In particular, this article focuses on extracting news narratives from an event-centric perspective. Extracting narratives from news data has multiple applications in understanding the evolving information landscape. This survey presents an extensive study of research in the area of event-based news narrative extraction. In particular, we screened more than 900 articles, which yielded 54 relevant articles. These articles are synthesized and organized by representation model, extraction criteria, and evaluation approaches. Based on the reviewed studies, we identify recent trends, open challenges, and potential research lines.

A Hybrid Virtual Assistant for Legal Domain Based on Information Retrieval and Knowledge Graphs

Virtual assistants have gained popularity across various domains, including the legal field, where they serve to offer guidance and aid in the form of law retrieval. In this research, our aim is to develop a legal virtual assistant that combines knowledge graphs (KGs) and information retrieval (IR) techniques. This hybrid approach allows us to provide accurate answers extracted from structured interconnected data while simultaneously cater to a diverse range of legal inquiries. We categorize these inquiries into a few distinct use cases: definition lookup, law component lookup, sanctions, and domain knowledge. Our system encompasses a chatbot platform, knowledge graph querying, and information retrieval. Specifically, we construct a VA system over a legal knowledge graph pertaining to the Indonesian Act concerning Manpower or Labor (UU Ketenagakerjaan) and the Indonesian Act concerning the Creation of Jobs (UU Cipta Kerja). This marks the creation of the first legal virtual assistant in the Indonesian context that combines KG and IR methodologies. To evaluate the effectiveness of our prototype system, we conduct tests using a variety of labor law-related questions, ranging in difficulty. The integration of knowledge graphs and information retrieval proves to significantly improve the support provided for a wide range of potential applications in the legal field.