Answer To Question Research Articles

Data or mathematics? Solutions to semantic problems in artificial intelligence

Data support is already driving the development of artificial intelligence. But it cannot solve the semantic problem of artificial intelligence. This requires improving the semantic understanding ability of artificial intelligence. Therefore, a question answering system based on semantic problem processing is proposed in this study. The question answering system utilizes an improved unsupervised method to extract keywords. This technology integrates the semantic feature information of text into traditional word graph model algorithms. On this basis, semantic similarity information is used to calculate and allocate the initial values and edge weights of each node in the PageRank model. And corresponding restart probability matrices and transition probability matrices are constructed for iterative calculation and keyword extraction. Simultaneously, an improved semantic dependency tree was utilized for answer extraction. The improved keyword extraction method shows a decreasing trend in P and R values. The improved answer extraction method has a maximum P-value of 0.876 in the training set and 0.852 in the test set. In a question answering system based on keyword and answer extraction, the improved method has lower loss function values and running time. The improved method has a larger area under ROC. The results of the validation analysis confirm that the improved method in this experiment has high accuracy and robustness when dealing with semantic problems.

GS-CBR-KBQA: Graph-structured case-based reasoning for knowledge base question answering

Knowledge Base Question Answering (KBQA) task is an important research direction in natural language processing. Due to the flexibility and ambiguity of natural language, users’ questions often have more complex query types and richer semantic information. To address this issue, this paper proposes the GS-CBR-KBQA model, a Case-Based Reasoning model tailored for KBQA to improve the semantic parsing accuracy and interpretability of natural language questions. The model integrates Knowledge-oriented Programming Language (KoPL) reasoning graphs with query information, employing a Graph Auto-Encoder and the RoBERTa pretrained language model for a highly effective case retrieval. This integration leads to a more robust knowledge retrieval and application approach, particularly innovative in capturing the relationships within KoPL graphs. The model addresses explicitly complex questions such as multi-hop reasoning and questions involving intricate entity relationships. Finally, our extensive experiments show that the model performs excellently in accuracy and F1 metrics on benchmark datasets such as WebQSP and ComplexWebQuestions, particularly in complex question-answering. The code of our model is available at https://anonymous.4open.science/r/GS-CBR-KBQA.

Building efficient and effective OpenQA systems for low-resource languages

Question answering (QA) is the task of answering questions posed in natural language with free-form natural language answers extracted from a given passage. In the OpenQA variant, only a question text is given, and the system must retrieve relevant passages from an unstructured knowledge source and use them to provide answers, which is the case in the mainstream QA systems on the Web. QA systems currently are mostly limited to the English language due to the lack of large-scale labeled QA datasets in non-English languages. In this paper, we show that effective, low-cost OpenQA systems can be developed for low-resource contexts. The key ingredients are (1) weak supervision using machine-translated labeled datasets and (2) a relevant unstructured knowledge source in the target language context. Furthermore, we show that only a few hundred gold assessment examples are needed to reliably evaluate these systems. We apply our method to Turkish as a challenging case study, since English and Turkish are typologically very distinct and Turkish has limited resources for QA. We present SQuAD-TR, a machine translation of SQuAD2.0, and we build our OpenQA system by adapting ColBERT-QA and retraining it over Turkish resources and SQuAD-TR using two versions of Wikipedia dumps spanning two years. We obtain a performance improvement of 24–32% in the Exact Match (EM) score and 22–29% in the F1 score compared to the BM25-based and DPR-based baseline QA reader models. Our results show that SQuAD-TR makes OpenQA feasible for Turkish, which we hope encourages researchers to build OpenQA systems in other low-resource languages. We make all the code, models, and the dataset publicly available at https://github.com/boun-tabi/SQuAD-TR.

MédicoBERT: A Medical Language Model for Spanish Natural Language Processing Tasks with a Question-Answering Application Using Hyperparameter Optimization

The increasing volume of medical information available in digital format presents a significant challenge for researchers seeking to extract relevant information. Manually analyzing voluminous data is a time-consuming process that constrains researchers’ productivity. In this context, innovative and intelligent computational approaches to information search, such as large language models (LLMs), offer a promising solution. LLMs understand natural language questions and respond accurately to complex queries, even in the specialized domain of medicine. This paper presents MédicoBERT, a medical language model in Spanish developed by adapting a general domain language model (BERT) to medical terminology and vocabulary related to diseases, treatments, symptoms, and medications. The model was pre-trained with 3 M medical texts containing 1.1 B words. Furthermore, with promising results, MédicoBERT was adapted and evaluated to answer medical questions in Spanish. The question-answering (QA) task was fine-tuned using a Spanish corpus of over 34,000 medical questions and answers. A search was then conducted to identify the optimal hyperparameter configuration using heuristic methods and nonlinear regression models. The evaluation of MédicoBERT was carried out using metrics such as perplexity to measure the adaptation of the language model to the medical vocabulary in Spanish, where it obtained a value of 4.28, and the average F1 metric for the task of answering medical questions, where it obtained a value of 62.35%. The objective of MédicoBERT is to provide support for research in the field of natural language processing (NLP) in Spanish, with a particular emphasis on applications within the medical domain.

From text to multimodal: a survey of adversarial example generation in question answering systems

AbstractIntegrating adversarial machine learning with question answering (QA) systems has emerged as a critical area for understanding the vulnerabilities and robustness of these systems. This article aims to review adversarial example-generation techniques in the QA field, including textual and multimodal contexts. We examine the techniques employed through systematic categorization, providing a structured review. Beginning with an overview of traditional QA models, we traverse the adversarial example generation by exploring rule-based perturbations and advanced generative models. We then extend our research to include multimodal QA systems, analyze them across various methods, and examine generative models, seq2seq architectures, and hybrid methodologies. Our research grows to different defense strategies, adversarial datasets, and evaluation metrics and illustrates the literature on adversarial QA. Finally, the paper considers the future landscape of adversarial question generation, highlighting potential research directions that can advance textual and multimodal QA systems in the context of adversarial challenges.

Training to Increase Social Awareness and Responsibility of Children in Child Development Centers (Ppa) Bet'el Oesapa Tengah

Community service activities carried out by Christian psychology study program students in 2023 with the theme Love and Humanity presented 12 young participants at PPA Bet’el Oesapa Tengah. The aim was to provide knowledge and skill training so that the participants could understand what social care is, the benefits of social care and the responsibility thereof, and be able to distinguish between the forms of disadvantages of social care and responsibility. In terms of skills, participants were able to understand how to develop a caring attitude within themselves and know the consequences if they don’t carry out their responsibilities. First, a training need analysis (TNA) was carried out for resource persons in the field to explore the needs of the participants, then a common thread was drawn to find out the problem and a conclusion was drawn on the interventions that were suitable for the participants according to the theme “Positive Psychology.” The training comprised of lectures, question–answers, simulation, and role-play methods for the transfer of knowledge and skills. Qualitative and descriptive measurements were used for the pretest and posttest analyes, respectively, finally reflecting two main aspects; the cognitive and affective processes obtained from the participant’s answers submitted after the main activities were carried out. Keywords: social concern, responsibility

A generalist vision-language foundation model for diverse biomedical tasks.

Traditional biomedical artificial intelligence (AI) models, designed for specific tasks or modalities, often exhibit limited flexibility in real-world deployment and struggle to utilize holistic information. Generalist AI holds the potential to address these limitations due to its versatility in interpreting different data types and generating tailored outputs for diverse needs. However, existing biomedical generalist AI solutions are typically heavyweight and closed source to researchers, practitioners and patients. Here, we describe BiomedGPT, the first open-source and lightweight vision-language foundation model, designed as a generalist capable of performing various biomedical tasks. BiomedGPT achieved state-of-the-art results in 16 out of 25 experiments while maintaining a computing-friendly model scale. We also conducted human evaluations to assess the capabilities of BiomedGPT in radiology visual question answering, report generation and summarization. BiomedGPT exhibits robust prediction ability with a low error rate of 3.8% in question answering, satisfactory performance with an error rate of 8.3% in writing complex radiology reports, and competitive summarization ability with a nearly equivalent preference score to human experts. Our method demonstrates that effective training with diverse data can lead to more practical biomedical AI for improving diagnosis and workflow efficiency.

Natural Language Processing Pretraining Language Model for Computer Intelligent Recognition Technology

Computer intelligent recognition technology refers to the use of computer vision, Natural Language Processing (NLP), machine learning and other technologies to enable computers to recognize, analyze, understand and answer human language and behavior. The common applications of computer intelligent recognition technology include image recognition, NLP, face recognition, target tracking, and other fields. NLP is a field of computer science, which involves the interaction between computers and natural languages. NLP technology can be used to process, analyze and generate natural language data, such as text, voice and image. Common NLP technology applications include language translation, emotion analysis, text classification, speech recognition and question answering system. Language model is a machine learning model, which uses a large number of text data for training to learn language patterns and relationships in text data. Although the language model has made great progress in the past few years, it still faces some challenges, including: poor semantic understanding, confusion in multilingual processing, slow language processing and other shortcomings. Therefore, in order to optimize these shortcomings, this article would study the pre-training language model based on NLP technology, which aimed at using NLP technology to optimize and improve the performance of the language model, thus optimizing the computer intelligent recognition technology. The model had a higher language understanding ability and more accurate prediction ability. In addition, the model could learn language rules and structures by using a large number of corpus, so as to better understand natural language. Through experiments, it could be known that the data size and total computing time of the traditional Generative Pretrained Transformer-2 (GPT-2) language model were 10 GB and 97 hours respectively. The data size and total computing time of BERT (Bidirectional Encoder Representations from Transformer) were 12 GB and 86 hours respectively. The data size and total computing time of the pre-training language model based on NLP were 18 GB and 71 hours respectively. Obviously, the pre-training language model based on NLP had a larger data size and shorter computing time. The experimental results showed that the NLP technology could better optimize the language model and effectively improve its various capabilities. This article opened up a new development direction for computer intelligent recognition technology and provided excellent technical support for the development of language models.

Automated SPARQL Template for Flexible Question Answering

The knowledge bases required the query language SPARQL, which consists of subject, property, and object. SPARQL is a structured query language and is difficult to understand. That issue becomes a problem in natural language processing queries. One situation in question answering is how to translate natural language into a structural SPARQL. This work aims to develop an automated SPARQL template algorithm regardless of the pattern structure of the query triples. It provides a more varied SPARQL query for data retrieval named Flexible SPARQL. This approach initially lies in combining elements of RDF with basic techniques of natural language processing to generate a template of SPARQL. In this work, the approach to making automatic templates is proposed without regard to the pattern of the triple structure or the location of the subject and object. Template-based research that exists today still uses rules to determine the position of subjects, objects, and properties in the SPARQL structure. Therefore, this work used the QALD 7 question set and DBpedia dataset. The previous systems utilized the same questions and data sets. Despite the simple proposed approaches that do not use complex, sophisticated techniques, they have shown promising results compared to the previous systems. The accuracy result from 215 questions is 73% and micro-Recall 0.701, micro-Precision 0.664, micro-F-Measure 0.682, macro-Recall 0.711, macro-Precision 0.592, macro-F-Measure 0.646. Overall, the Flexible SPARQL system has higher results on several measurements that define a promising approach. However, it's important to note that Flexible SPARQL generally tends to fail at generating complex SPARQL, which is a limitation of the system.

Advancing Accuracy in Multimodal Medical Tasks Through Bootstrapped Language-Image Pretraining (BioMedBLIP): Performance Evaluation Study.

Medical image analysis, particularly in the context of visual question answering (VQA) and image captioning, is crucial for accurate diagnosis and educational purposes. Our study aims to introduce BioMedBLIP models, fine-tuned for VQA tasks using specialized medical data sets such as Radiology Objects in Context and Medical Information Mart for Intensive Care-Chest X-ray, and evaluate their performance in comparison to the state of the art (SOTA) original Bootstrapping Language-Image Pretraining (BLIP) model. We present 9 versions of BioMedBLIP across 3 downstream tasks in various data sets. The models are trained on a varying number of epochs. The findings indicate the strong overall performance of our models. We proposed BioMedBLIP for the VQA generation model, VQA classification model, and BioMedBLIP image caption model. We conducted pretraining in BLIP using medical data sets, producing an adapted BLIP model tailored for medical applications. In VQA generation tasks, BioMedBLIP models outperformed the SOTA on the Semantically-Labeled Knowledge-Enhanced (SLAKE) data set, VQA in Radiology (VQA-RAD), and Image Cross-Language Evaluation Forum data sets. In VQA classification, our models consistently surpassed the SOTA on the SLAKE data set. Our models also showed competitive performance on the VQA-RAD and PathVQA data sets. Similarly, in image captioning tasks, our model beat the SOTA, suggesting the importance of pretraining with medical data sets. Overall, in 20 different data sets and task combinations, our BioMedBLIP excelled in 15 (75%) out of 20 tasks. BioMedBLIP represents a new SOTA in 15 (75%) out of 20 tasks, and our responses were rated higher in all 20 tasks (P<.005) in comparison to SOTA models. Our BioMedBLIP models show promising performance and suggest that incorporating medical knowledge through pretraining with domain-specific medical data sets helps models achieve higher performance. Our models thus demonstrate their potential to advance medical image analysis, impacting diagnosis, medical education, and research. However, data quality, task-specific variability, computational resources, and ethical considerations should be carefully addressed. In conclusion, our models represent a contribution toward the synergy of artificial intelligence and medicine. We have made BioMedBLIP freely available, which will help in further advancing research in multimodal medical tasks.

Thai Question-Answering System Using Similarity Search and LLM

A question-answering (QA) system is essential to an organization where numerous QA pairs respond to customer queries. Choosing the right pair corresponding to the query is a complex task. Although the QA system from a commercial product like ChatGPT provides an excellent solution, it is costly, and the fine-tuned Large Language Model (LLM) cannot be downloaded for private use at the local site. In addition, the cost of using such LLM may significantly increase when the number of users grows. We propose a Thai QA system that can swiftly respond and correctly match the user query to the reference answer in the QA dataset. The proposed system encodes both QA pairs and a query into individual embeddings and finds a couple of QA pairs that are most related to the query by using the fast similarity search called Faiss (Facebook AI Similarity Search.) Afterward, the relevant QA pairs and the query are fed to the fine-tuned LLM (WangchanBERTa - pretraining multilingual transformer-based) to choose the single best match QA pair. The fine-tuned WangchanBERTa can retrieve the correct answer and respond to the query naturally. The experiment conducted on the Thai Wiki QA dataset indicates the superior ROUGE values, precision, recall, F1-score, and runtime of the proposed system against other strategies.

Feature engineering in learning-to-rank for community question answering task

Community question answering (CQA) forums are Internet-based platforms where users ask questions about a topic and other expert users try to provide solutions. Many CQA forums such as Quora, Stackoverflow, Yahoo!Answer, StackExchange exist with a lot of user-generated data. These data are leveraged in automated CQA ranking systems where similar questions (and answers) are presented in response to the user's query. In this work, we empirically investigate a few aspects of this domain. First, in addition to traditional features like Term Frequency (TF), Inverse Document Frequency (IDF), Best Match 25 (BM25), etc., we introduce a Bidirectional Encoder Representations from Transformers (BERT)-based feature that captures the semantic similarity between the question and answer. Second, most of the existing research works have focus on features extracted only from the question part; features extracted from answers have not been explored extensively. We combine both types of features in a linear fashion. Third, using our proposed concepts, we conduct an empirical investigation with different rank-learning algorithms, some of which have not been used so far in CQA domain. On three standard CQA datasets, our proposed framework achieves state-of-the-art performance (0.56, 0.58 and 0.60 NDCG@10 values). We also analyze the importance of the features we use in our investigation. This work is expected to guide the practitioners to devise a better set of features for the CQA retrieval task.

Promoting convergence and efficacy of open‐domain question answering via unsupervised clustering

AbstractOpen‐Domain Question Answering (ODQA) has attracted increasing interests due to its extensive applications in search engines and smart robots. In the experiments, it is observed that the convergence of the method has a huge effect on the generalizability performance. Motivated by this observation, an unsupervised clustering technique (namely, ClusSampling) is proposed to promote both the convergence and efficacy of existing ODQA methods via unsupervised clustering. Specifically, unsupervised clustering is first conducted and then negative samples are selected for higher similarity to the questions. In addition, the authors propose to use gap statistics to determine the optimal number of clusters. Experimental results show that the method achieves notable speedup during training and produces accuracy gains of 5.3% and 2.2 on two widely used benchmarks.

Nonfactoid Question Answering as Query-Focused Summarization With Graph-Enhanced Multihop Inference.

Nonfactoid question answering (QA) is one of the most extensive yet challenging applications and research areas in natural language processing (NLP). Existing methods fall short of handling the long-distance and complex semantic relations between the question and the document sentences. In this work, we propose a novel query-focused summarization method, namely a graph-enhanced multihop query-focused summarizer (GMQS), to tackle the nonfactoid QA problem. Specifically, we leverage graph-enhanced reasoning techniques to elaborate the multihop inference process in nonfactoid QA. Three types of graphs with different semantic relations, namely semantic relevance, topical coherence, and coreference linking, are constructed for explicitly capturing the question-document and sentence-sentence interrelationships. Relational graph attention network (RGAT) is then developed to aggregate the multirelational information accordingly. In addition, the proposed method can be adapted to both extractive and abstractive applications as well as be mutually enhanced by joint learning. Experimental results show that the proposed method consistently outperforms both existing extractive and abstractive methods on two nonfactoid QA datasets, WikiHow and PubMedQA, and possesses the capability of performing explainable multihop reasoning.

AutoTQA: Towards Autonomous Tabular Question Answering through Multi-Agent Large Language Models

With the growing significance of data analysis, several studies aim to provide precise answers to users' natural language questions from tables, a task referred to as tabular question answering (TQA). The state-of-the-art TQA approaches are limited to handling only single-table questions. However, real-world TQA problems are inherently complex and frequently involve multiple tables, which poses challenges in directly extending single-table TQA designs to handle multiple tables, primarily due to the limited extensibility of the majority of single-table TQA methods. This paper proposes AutoTQA, a novel Auto nomous T abular Q uestion A nswering framework that employs multi-agent large language models (LLMs) across multiple tables from various systems (e.g., TiDB, BigQuery). AutoTQA comprises five agents: the User , responsible for receiving the user's natural language inquiry; the Planner , tasked with creating an execution plan for the user's inquiry; the Engineer , responsible for executing the plan step-by-step; the Executor , provides various execution environments (e.g., text-to-SQL) to fulfill specific tasks assigned by the Engineer ; and the Critic , responsible for judging whether to complete the user's natural language inquiry and identifying gaps between the current results and initial tasks. To facilitate the interaction between different agents, we have also devised agent scheduling algorithms. Furthermore, we have developed LinguFlow, an open-source, low-code visual programming tool, to quickly build and debug LLM-based applications, and to accelerate the creation of various external tools and execution environments. We also implemented a series of data connectors, which allows AutoTQA to access various tables from multiple systems. Extensive experiments show that AutoTQA delivers outstanding performance on four representative datasets.

Robust Visual Question Answering: Datasets, Methods, and Future Challenges.

Visual question answering requires a system to provide an accurate natural language answer given an image and a natural language question. However, it is widely recognized that previous generic VQA methods often tend to memorize biases present in the training data rather than learning proper behaviors, such as grounding images before predicting answers. Therefore, these methods usually achieve high in-distribution but poor out-of-distribution performance. In recent years, various datasets and debiasing methods have been proposed to evaluate and enhance the VQA robustness, respectively. This paper provides the first comprehensive survey focused on this emerging fashion. Specifically, we first provide an overview of the development process of datasets from in-distribution and out-of-distribution perspectives. Then, we examine the evaluation metrics employed by these datasets. Third, we propose a typology that presents the development process, similarities and differences, robustness comparison, and technical features of existing debiasing methods. Furthermore, we analyze and discuss the robustness of representative vision-and-language pre-training models on VQA. Finally, through a thorough review of the available literature and experimental analysis, we discuss the key areas for future research from various viewpoints.

How an Android Expresses “Now Loading…”: Examining the Properties of Thinking Faces

The “thinking face” is a facial signal used to convey being in thought. For androids, the thinking face may be important to achieve natural human–robot interaction. However, the facial pattern necessary for portraying the thinking face remains unclear and has not yet been investigated in androids. The current study aims to (a) identify the facial patterns when people are engaged in answering complex questions (i.e., thinking face) and (b) clarify whether implementing the observed thinking faces in an android can facilitate natural human–robot interaction. In Study 1, we analyze the facial movements of 40 participants after they are prompted with difficult questions and indicate five facial patterns that corresponded to thinking faces. In Study 2, we further focus on the pattern of furrowing of the brows and narrowing of the eyes among the observed thinking facial patterns and implement this pattern in an android. The results show that thinking faces enhance the perception of being in thought, genuineness, human-likeness, and appropriateness in androids while decreasing eeriness. The free-description data also revealed that negative emotions are attributed to the thinking face. In Study 3, we compared the thinking vs. neutral faces in a question–answer situation. The results showed that the android's thinking face facilitated the perception of being in thought and human-likeness. These findings suggest that the thinking face of androids can facilitate natural human–robot interaction.

Comparative Analysis of State-of-the-Art Q A Models: BERT, RoBERTa, DistilBERT, and ALBERT on SQuAD v2 Dataset

In the rapidly evolving landscape of natural language processing (NLP) and artificial intelligence, recent years have witnessed significant advancements, particularly in text-based question-answering (QA) systems. The Stanford Question Answering Dataset (SQuAD v2) has emerged as a prominent benchmark, offering diverse language understanding challenges. This study conducts a thorough examination of cutting-edge QA models—BERT, DistilBERT, RoBERTa, and ALBERT—each featuring distinct architectures, focusing on their training and performance on SQuAD v2. The analysis aims to uncover the unique strengths of each model, providing insights into their capabilities and exploring the impact of different training techniques on their performance. The primary objective is to enhance our understanding of text-based QA systems' evolution and their effectiveness in real-world scenarios. The results of this comparative study are poised to influence the utilization and development of these models in both industry and research. The investigation meticulously evaluates BERT, ALBERT, RoBERTa, and DistilBERT QA models using the SQuAD v2 dataset, emphasizing instances of accurate responses and identifying areas where completeness may be lacking. This nuanced exploration contributes to the ongoing discourse on the advancement of text-based question-answering systems, shedding light on the strengths and limitations of each QA model. Based on the results obtained, ALBERT achieved an exact match of 86.85% and an F1 score of 89.91% on the SQuAD v2 dataset, demonstrating superior performance in both answerable ('HasAns') and unanswerable ('NoAns') questions. BERT and RoBERTa also showed strong performance, while DistilBERT lagged slightly behind. This study provides a significant contribution to the advancement of text-based question-answering systems, offering insights that can shape the utilization of these models in both industry and research domains.

Comprehending and Reducing LLM Hallucinations

The integration of large language models (LLM) into many artificial intelligence applications shows the best performance in tasks such as text mining, typing, question answering. Despite his success, his LL.M. The biggest concern is the emergence of so-called "hallucinations", especially in text-based systems and Q&amp;As that rely on LL M. These hearings may lead to the spread of misinformation or fraud. This article explains the basics of AI illusions and highlights their importance in AI. Work involves deploying visualizations to a variety of tasks, including machine translation, surveys, interviews, content writing, LLM maps, and visualization questions. Additionally, this article explores potential strategies to reduce negative perceptions in order to increase the overall credibility of the LL.M.

A Question Answering System Application Integrated with Chatbot Using NLP

Objective : A Question Answering System Application integrated with Chatbot using NLP is a platform designed to meet the needs of students, enabling effective communication between students and teachers while encouraging effective problem-solving and interactive knowledge exchange. Methods: The interface provides an optional space for learning inquiry, encouraging students to share their questions and concerns. This user-friendly interface allows students to easily submit questions, which are quickly distributed and reported to the appropriate teacher or expert. Findings: A Question Answering System Application integrated with Chatbot using NLP enables greater engagement and supports learning by providing a framework for resolving education-related questions. Novelty: It promotes effective problem-solving, improves interaction between students and teachers, and ultimately encourages students to take control of their learning. Keywords: Query Chatbot, Natural Language Processing (NLP), Question Answering System Application, Collaborative Learning, Automated Answering System