Information Retrieval Algorithms Research Articles

Machine Learning-based Human Resource Management Information Retrieval and Classification Algorithm

Efficient human resource management (HRM) is essential for company achievement in today’s fast-paced corporate world. Businesses must find effective ways to retrieve and categorise the ever-growing amount of HR-related knowledge. This work presents a new method for retrieving and classifying HRM data using machine learning. Modern natural language processing (NLP) and CNN methods are used by the algorithm we developed to handle unorganized human resources (HR) information, including worker records, job postings, and certificates. HR decision-making is facilitated by the system’s ability to derive insightful information from the information using sophisticated text mining and machine learning algorithms.The two main parts of the method are classification and data extraction. HR workers can more easily obtain the required knowledge thanks to information retrieval, which makes it possible to search HR data quickly and accurately. Contrarily, categorisation optimises the division of human resources information into pertinent classifications, including job positions, competencies, and achievement grades. We assess our algorithm’s effectiveness on various datasets from actual HR datasets. The outcomes show how well our strategy works to streamline HRM procedures, cut down on manual labour, and increase the precision of decisions. Furthermore, our technology is compatible with corporate human resources offices and educational settings because it complies with worldwide university requirements.This study belongs to the growing body of knowledge in HRM. It provides a useful tool for businesses looking to improve employee relations, simplify HR procedures, and attract and retain talent. The suggested method is a valuable resource for academics and businesses alike because of its versatility and compliance with global educational norms.

Comparative Evaluation of Pre-Trained Language Models for Biomedical Information Retrieval.

Finding relevant information in the biomedical literature increasingly depends on efficient information retrieval (IR) algorithms. Cross-Encoders, SentenceBERT, and ColBERT are algorithms based on pre-trained language models that use nuanced but computable vector representations of search queries and documents for IR applications. Here we investigate how well these vectorization algorithms estimate relevance labels of biomedical documents for search queries using the OHSUMED dataset. For our evaluation, we compared computed scores to provided labels by using boxplots and Spearman's rank correlations. According to these metrics, we found that Sentence-BERT moderately outperformed the alternative vectorization algorithms and that additional fine-tuning based on a subset of OHSUMED labels yielded little additional benefit. Future research might aim to develop a larger dedicated dataset in order to optimize such methods more systematically, and to evaluate the corresponding functions in IR tools with end-users.

A RECENT SURVEY ON TEXT MINING TOOLS & TECHNIQUES IN THE BIO-MEDICAL DOMAIN

Text mining in the biomedical domain has emerged as a crucial technique that capitalizes on the advancements of natural language processing and machine learning methodologies to extract valuable insights from the biomedical texts available to us from different sources. This research paper explores the methods and recent advancements in text mining techniques for the biomedical field. We analyze various approaches, including Named Entity Recognition (NER), information retrieval, and machine learning algorithms, focusing on their application to biomedical data.Biomedical text mining aims to extract valuable information from a vast and diverse array of unstructured medical text data available from different sources, which can significantly contribute to the advancements in medical research and healthcare improvement. This research paper reflects a comprehensive exploration of fundamental concepts of biomedical textual data mining, its techniques, software, applications of biomedical textual data mining, a literature survey on clinical text mining, and its key challenges. It examines the effectiveness of these techniques in identifying and categorizing biomedical entities like genes, proteins, diseases, and drugs. Through case studies and empirical evaluations, we demonstrate how text mining contributes to knowledge discovery, improves data management, and supports decision-making in healthcare and research. This study aims to provide a detailed overview of state-of-the-art biomedical text mining, offering insights into future directions and potential improvements in this rapidly evolving field.

A neuro-fuzzy algorithm for query expansion and information retrieval

A neuro-fuzzy algorithm for query expansion and information retrieval

Efficient DNA Coding Algorithm for Polymerase Chain Reaction Amplification Information Retrieval

Polymerase Chain Reaction (PCR) amplification is widely used for retrieving information from DNA storage. During the PCR amplification process, nonspecific pairing between the 3’ end of the primer and the DNA sequence can cause cross-talk in the amplification reaction, leading to the generation of interfering sequences and reduced amplification accuracy. To address this issue, we propose an efficient coding algorithm for PCR amplification information retrieval (ECA-PCRAIR). This algorithm employs variable-length scanning and pruning optimization to construct a codebook that maximizes storage density while satisfying traditional biological constraints. Subsequently, a codeword search tree is constructed based on the primer library to optimize the codebook, and a variable-length interleaver is used for constraint detection and correction, thereby minimizing the likelihood of nonspecific pairing. Experimental results demonstrate that ECA-PCRAIR can reduce the probability of nonspecific pairing between the 3’ end of the primer and the DNA sequence to 2–25%, enhancing the robustness of the DNA sequences. Additionally, ECA-PCRAIR achieves a storage density of 2.14–3.67 bits per nucleotide (bits/nt), significantly improving storage capacity.

LESS LiDAR: A Full-Waveform and Discrete-Return Multispectral LiDAR Simulator Based on Ray Tracing Algorithm

Light detection and ranging (LiDAR) is a widely used technology for the acquisition of three-dimensional (3D) information about a wide variety of physical objects and environments. However, before conducting a campaign, a test is typically conducted to assess the potential of the utilized algorithm for information retrieval. It might not be a real campaign but rather a simulation to save time and costs. Here, a multi-platform LiDAR simulation model considering the location, direction, and wavelength of each emitted laser pulse was developed based on the large-scale remote sensing (RS) data and image simulation framework (LESS) model, which is a 3D radiative transfer model for simulating passive optical remote sensing signals using the ray tracing algorithm. The LESS LiDAR simulator took footprint size, returned energy, multiple scattering, and multispectrum LiDAR into account. The waveform and point similarity were assessed with the LiDAR module of the discrete anisotropic radiative transfer (DART) model. Abstract and realistic scenes were designed to assess the simulated LiDAR waveforms and point clouds. A waveform comparison in the abstract scene with the DART LiDAR module showed that the relative error was lower than 1%. In the realistic scene, airborne and terrestrial laser scanning were simulated by LESS and DART LiDAR modules. Their coefficients of determination ranged from 0.9108 to 0.9984. Their mean was 0.9698. The number of discrete returns fitted well and the coefficient of determination was 0.9986. A terrestrial point cloud comparison in the realistic scene showed that the coefficient of determination between the two sets of data could reach 0.9849. The performance of the LESS LiDAR simulator was also compared with the DART LiDAR module and HELIOS++. The results showed that the LESS LiDAR simulator is over three times faster than the DART LiDAR module and HELIOS++ when simulating terrestrial point clouds in a realistic scene. The proposed LiDAR simulator offers two modes for simulating point clouds: single-ray and multi-ray modes. The findings demonstrate that utilizing a single-ray simulation approach can significantly reduce the simulation time, by over 28 times, without substantially affecting the overall point number or ground pointswhen compared to employing multiple rays for simulations. This new LESS model integrating a LiDAR simulator has great potential in terms of simultaneously simulating LiDAR data and optical images based on the same 3D scene and parameters. As a proof of concept, the normalized difference vegetation index (NDVI) results from multispectral images and the vertical profiles from multispectral LiDAR waveforms were simulated and analyzed. The results showed that the proposed LESS LiDAR simulator can fulfill its design goals.

Information retrieval algorithms and neural ranking models to detect previously fact-checked information

Although in the last decade several fact-checking organizations have emerged to verify misinformation, fake news has continued to proliferate, especially through social media platforms. Even though adopting improved detection strategies is of utmost importance, the fact-checking process could be optimized by verifying whether a claim has been previously fact-checked. Despite some ad-hoc information retrieval approaches having been recently proposed, the utility of modern (neural) retrieval systems have not been investigated yet. In this paper, we consider the standard two-phases retriever-reranker architecture and benchmark different state-of-the-art techniques from the information retrieval and Q&A literature. We design several experiments on a real-world Twitter dataset to analyze the efficiency and the effectiveness of the benchmark approaches. Our results show that combining standard and neural approaches is the most promising research direction to improve retrievers performance and that complex (neural) rerankers might still be efficient in practice since there is no need to process a high number of documents to improve ranking performance.

Bibliometric‐enhanced legal information retrieval: Combining usage and citations as flavors of impact relevance

AbstractBibliometric‐enhanced information retrieval uses bibliometrics (e.g., citations) to improve ranking algorithms. Using a data‐driven approach, this article describes the development of a bibliometric‐enhanced ranking algorithm for legal information retrieval, and the evaluation thereof. We statistically analyze the correlation between usage of documents and citations over time, using data from a commercial legal search engine. We then propose a bibliometric boost function that combines usage of documents with citation counts. The core of this function is an impact variable based on usage and citations that increases in influence as citations and usage counts become more reliable over time. We evaluate our ranking function by comparing search sessions before and after the introduction of the new ranking in the search engine. Using a cost model applied to 129,571 sessions before and 143,864 sessions after the intervention, we show that our bibliometric‐enhanced ranking algorithm reduces the time of a search session of legal professionals by 2 to 3% on average for use cases other than known‐item retrieval or updating behavior. Given the high hourly tariff of legal professionals and the limited time they can spend on research, this is expected to lead to increased efficiency, especially for users with extremely long search sessions.

Analysis on the Multimedia Information Retrieval Algorithm Based on Enterprise Correlation Financial Analysis under the Background of Big Data

At present, based on the background of the big data era, the operation of enterprises has a great impact, and relevance is a principle set to meet the needs of enterprise operation and management. In today’s digital and network era, multimedia has become the main part of the Internet information transmission, and multidisciplinary art and science communion has promoted the development of the multimedia information retrieval. As a result, this paper examines the correlation of big data against the background of financial and multimedia information retrieval algorithms.

Clustering and Mining Algorithm of Factor Structure Data of Physical Education Teachers' Teaching Behavior Based on Internet Information Retrieval Algorithm

Integrating visual word list and Rocchio algorithm, constructs an implicit relevance feedback retrieval model in semantic space, and judges information retrieval preference. User demand mining is introduced, Jensen-Shannon divergence is used to calculate the relative entropy distance between the probability distributions of document sets, and similarity matching is calculated to complete interactive information retrieval. Teaching ability is gradually formed by teachers in long-term teaching practice, and is stably and comprehensively reflected in teaching viewpoints, teaching methods, teaching skills, teaching style and so on. The weight analysis of each index in the evaluation index system was carried out by using the analytic hierarchy process, and the selection of the evaluation subject was completed through the third round of expert questionnaires, and the evaluation criteria were formulated in combination with the opinions of tutors and some expert teachers.

Similarity matching method of power distribution system operating data based on neural information retrieval

Operation control of power systems has become challenging with an increase in the scale and complexity of power distribution systems and extensive access to renewable energy. Therefore, improvement of the ability of data-driven operation management, intelligent analysis, and mining is urgently required. To investigate and explore similar regularities of the historical operating section of the power distribution system and assist the power grid in obtaining high-value historical operation, maintenance experience, and knowledge by rule and line, a neural information retrieval model with an attention mechanism is proposed based on graph data computing technology. Based on the processing flow of the operating data of the power distribution system, a technical framework of neural information retrieval is established. Combined with the natural graph characteristics of the power distribution system, a unified graph data structure and a data fusion method of data access, data complement, and multi-source data are constructed. Further, a graph node feature-embedding representation learning algorithm and a neural information retrieval algorithm model are constructed. The neural information retrieval algorithm model is trained and tested using the generated graph node feature representation vector set. The model is verified on the operating section of the power distribution system of a provincial grid area. The results show that the proposed method demonstrates high accuracy in the similarity matching of historical operation characteristics and effectively supports intelligent fault diagnosis and elimination in power distribution systems.

Study on Library Management System Based on Data Mining and Clustering Algorithm

In order to improve the information retrieval and resource sharing abilities of the library and establish an intelligent library information management system, alibrary management system based on data mining and clustering algorithm is proposed. The system development is divided into two modules: library mining algorithm design and information management system software development. Library data mining design and clustering algorithm of library management system development. System development is divided into two modules: library mining algorithm design and information management system software development. Big data fusion and feature clustering methods is used to design intelligent information retrieval algorithms in library information management to establish library management database. Realizing the development and design of library management system under embedded environment, and finally experimental test analysis is carried out. Results show that the use of the proposed method for library information management can improve the accuracy of book recommendation, which is 16.7% higher than traditional methods on average. It has good data mining, and has good performance indicators in data recall and precision. Therefore, this algorithm is not only a means of automated management of library systems, but also an effective means to realize library information modernization.

Benchmarking for Recommender System (MFRISE)

The advent of the internet age offers overwhelming choices of movies and shows to viewers which create need of comprehensive Recommendation Systems (RS). Recommendation System will suggest best content to viewers based on their choice using the methods of Information Retrieval, Data Mining and Machine Learning algorithms. The novel Multifaceted Recommendation System Engine (MFRISE) algorithm proposed in this paper will help the users to get personalized movie recommendations based on multi-clustering approach using user cluster and Movie cluster along with their interaction effect. This will add value to our existing parameters like user ratings and reviews. In real-world scenarios, recommenders have many non-functional requirements of technical nature. Evaluation of Multifaceted Recommendation System Engine must take these issues into account in order to produce good recommendations. The paper will show various technical evaluation parameters like RMSE, MAE and timings, which can be used to measure accuracy and speed of Recommender system. The benchmarking results also helpful for new recommendation algorithms. The paper has used MovieLens dataset for purpose of experimentation. The studied evaluation methods consider both quantitative and qualitative aspects of algorithm with many evaluation parameters like mean squared error (MSE), root mean squared error (RMSE), Test Time and Fit Time are calculated for each popular recommender algorithm (NMF, SVD, SVD++, SlopeOne, Co- Clustering) implementation. The study identifies the gaps and challenges faced by each above recommender algorithm. This study will also help researchers to propose new recommendation algorithms by overcoming identified research gaps and challenges of existing algorithms.

Retraction Note: Research on Chinese and English language information retrieval algorithm based on bilingual theme model

Retraction Note: Research on Chinese and English language information retrieval algorithm based on bilingual theme model

Natural Language Semantic Answering: Application to Medicinal Plants and Coronavirus

This paper describes PryRe (Preguntas y Respuestas) {Questions and answers}, a question answering system that receives as input a question in Spanish and returns the answer. An information retrieval algorithm identifies the meaning of the question using its semantic properties. To do this, it is necessary to implement natural language processing modules. PryRe identifies the question using a triplet R (C, V), where R is the relation or link, C is the concept or main idea, and V is the value of the concept. For example, in the question: ¿Cuál es la hierba que mejora la digestion? {What is the herb that improves digestion?}, the answer is Manzanilla {Chamomile}. To obtain this response, a process of query analysis and design is executed. The analysis consists of identifying the answer, we call this process the semantic identification of the question. The PryRe algorithms are explained in detail. The tests have been carried out with some sources on herbalism [15] and on 2019-nCoV [14] in an Ontology; they show an acceptable accuracy of 83%. Resources used in this work are (1) the OM notation, which is used to describe ontologies, and (2) the deductive capability of PryRe. PryRe consults this ontology to answer the questions using cases that are described in its algorithm.

LibACA, pyACA, and ACA-Code: Audio content analysis in 3 languages

The three packages libACA, pyACA, and ACA-Code provide reference implementations for basic approaches and algorithms for the analysis of musical audio signals in three different languages: C++, Python, and Matlab. All three packages cover the same algorithms, such as extraction of low level audio features, fundamental frequency estimation, as well as simple approaches to chord recognition, musical key detection, and onset detection. In addition, it implementations of more generic algorithms useful in audio content analysis such as dynamic time warping and the Viterbi algorithm are provided. The three packages thus provide a practical cross-language and cross-platform reference to students and engineers implementing audio analysis algorithms and enable implementation-focused learning of algorithms for audio content analysis and music information retrieval.

Machine Reading at Scale: A Search Engine for Scientific and Academic Research

The Internet, much like our universe, is ever-expanding. Information, in the most varied formats, is continuously added to the point of information overload. Consequently, the ability to navigate this ocean of data is crucial in our day-to-day lives, with familiar tools such as search engines carving a path through this unknown. In the research world, articles on a myriad of topics with distinct complexity levels are published daily, requiring specialized tools to facilitate the access and assessment of the information within. Recent endeavors in artificial intelligence, and in natural language processing in particular, can be seen as potential solutions for breaking information overload and provide enhanced search mechanisms by means of advanced algorithms. As the advent of transformer-based language models contributed to a more comprehensive analysis of both text-encoded intents and true document semantic meaning, there is simultaneously a need for additional computational resources. Information retrieval methods can act as low-complexity, yet reliable, filters to feed heavier algorithms, thus reducing computational requirements substantially. In this work, a new search engine is proposed, addressing machine reading at scale in the context of scientific and academic research. It combines state-of-the-art algorithms for information retrieval and reading comprehension tasks to extract meaningful answers from a corpus of scientific documents. The solution is then tested on two current and relevant topics, cybersecurity and energy, proving that the system is able to perform under distinct knowledge domains while achieving competent performance.

Automatic construction of generic stop words list for hausa text

<span lang="EN-US">Stop-words are words having the highest frequencies in a document without any significant information. They are characterized by having common relations within a cluster. They are the noise of the text that are evenly distributed over a document. Removal of stop words improve the performance and accuracy of information retrieval algorithms and machine learning at large. It saves the storage space by reducing the vector space dimension, and helps in effective documents indexing. This research generated a list of Hausa stop words automatically using aggregated method by combining frequency and statistics methods. The experiments are conducted using a primarily collected Hausa corpus consisting of 841 Hausa news articles of size 646862 words and finally a list of distinct 81 Hausa stop words is generated.</span>

Transferrable Framework Based on Knowledge Graphs for Generating Explainable Results in Domain-Specific, Intelligent Information Retrieval

In modern industrial systems, collected textual data accumulates over time, offering an important source of information for enhancing present and future industrial practices. Although many AI-based solutions have been developed in the literature for a domain-specific information retrieval (IR) from this data, the explainability of these systems was rarely investigated in such domain-specific environments. In addition to considering the domain requirements within an explainable intelligent IR, transferring the explainable IR algorithm to other domains remains an open-ended challenge. This is due to the high costs, which are associated with intensive customization and required knowledge modelling, when developing new explainable solutions for each industrial domain. In this article, we present a transferable framework for generating domain-specific explanations for intelligent IR systems. The aim of our work is to provide a comprehensive approach for constructing explainable IR and recommendation algorithms, which are capable of adopting to domain requirements and are usable in multiple domains at the same time. Our method utilizes knowledge graphs (KG) for modeling the domain knowledge. The KG provides a solid foundation for developing intelligent IR solutions. Utilizing the same KG, we develop graph-based components for generating textual and visual explanations of the retrieved information, taking into account the domain requirements and supporting the transferability to other domain-specific environments, through the structured approach. The use of the KG resulted in minimum-to-zero adjustments when creating explanations for multiple intelligent IR algorithms in multiple domains. We test our method within two different use cases, a semiconductor manufacturing centered use case and a job-to-applicant matching one. Our quantitative results show a high capability of our approach to generate high-level explanations for the end users. In addition, the developed explanation components were highly adaptable to both industrial domains without sacrificing the overall accuracy of the intelligent IR algorithm. Furthermore, a qualitative user-study was conducted. We recorded a high level of acceptance from the users, who reported an enhanced overall experience with the explainable IR system.

Method to integrate speakers identification, speech recognition, and information retrieval algorithms for speaker-based information retrieval.

Method to integrate speakers identification, speech recognition, and information retrieval algorithms for speaker-based information retrieval.