Parallel Datasets Research Articles

Improved GAN-based deep learning approach for strain field prediction and failure analysis of precast bridge slab joints

Nonlinear finite element analysis (FEA) is crucial for understanding complex stress-strain behaviors and assessing potential structural failure risks. Building on the recent success of deep learning (DL) methods in physical field predictions, there has been growing interest in forecasting internal force fields of structures beyond the existing data scope. In this study, a data-driven strain field analysis model based on an improved Generative Adversarial Network (GAN) is proposed. To enrich the input data, this novel approach incorporates the Signed Distance Field (SDF) derived from the characteristics of the original Finite Element (FE) models. The generator, based on U-Net, is enhanced with channel attention mechanisms and loss penalty terms, forming the core of the improved GAN. The effectiveness of the proposed method is demonstrated using two parallel datasets comprising 3-Headed bar tension models across two planes. Subsequently, the generated strain field is subjected to feature extraction using the 2D-Principal Component Analysis (2D-PCA) method, followed by structural failure determination through the K-Nearest Neighbor (KNN) algorithm. The results indicate that the proposed improved approach achieves a significant reduction in Root Mean Square Error (RMSE) of 20.71 % and 13.21 % across the two datasets, with the structural failure determination method reaching an F1-score of 0.971. Thus, the intelligent strain field analysis method introduced here effectively predicts strain distributions and promptly identifies failure states, offering valuable insights for further numerical analysis and structural design.

Initial exploration into sarcasm and irony through machine translation

In this paper, we investigate sarcasm and irony as seen through a novel perspective of machine translation. We employ various techniques for translation, comparing both manually and automatically translated datasets of irony and sarcasm. We first clarify the definitions of irony and sarcasm and present an exhaustive field review of studies on irony both from purely linguistic as well as computational linguistic perspectives. We also propose a novel evaluation metric for the purpose of evaluating translations of figurative language, with a focus on machine-translated irony and sarcasm. The constructed English and Chinese parallel dataset includes polarized content from tweets as well as forum posts, categorized by irony types. The preferred translation model, mBART-50, is identified through a thorough experimental process. Optimal translation settings and the best-finetuned model for irony are explored, with the most effective model being finetuned on both ironic and non-ironic data. We also experimented which types of irony are best suitable for training in this specific task — short microblogging messages or longer forum posts. Moreover, we compare the capabilities of a well fine-tuned mBART to a prompt-based method using the recently popular ChatGPT model, with the conclusion that the former still outperforms the latter, although ChatGPT without any training can be considered as a “good enough” ad hoc solution in the case of a lack of data for training. Finally, we verify if the translated data – either manually, or with an MT model – can be used as training data in a task of irony detection. We believe that the presented research can be expanded into languages other than the presented here Chinese and English, which together with the ability to detect various categories of irony, could contribute to deepening the understanding of figurative language, especially irony and sarcasm.

Språk, land och kommunikativa mönster

Swedish is spoken both in Sweden and Finland, and Finland is a bilingual country with Swedish as a national language alongside Finnish. This makes it possible to explore the same language in two different societies, and two different languages in the same society. However, few comparative studies have been conducted with parallel datasets in both national languages of Finland. The project Communicative patterns in two languages in Finland therefore compares Finnish and Finland Swedish internally and to Sweden Swedish in similar institutional settings. In this article I present the research area of the project by discussing results from two pilot studies.

Systematic biases in reference-based plasma cell-free DNA fragmentomic profiling

Plasma cell-free DNA (cfDNA) fragmentation patterns are emerging directions in cancer liquid biopsy with high translational significance. Conventionally, the cfDNA sequencing reads are aligned to a reference genome to extract their fragmentomic features. In this study, through cfDNA fragmentomics profiling using different reference genomes on the same datasets in parallel, we report systematic biases in such conventional reference-based approaches. The biases in cfDNA fragmentomic features vary among races in a sample-dependent manner and therefore might adversely affect the performances of cancer diagnosis assays across multiple clinical centers. In addition, to circumvent the analytical biases, we develop Freefly, a reference-free approach for cfDNA fragmentomics profiling. Freefly runs ∼60-fold faster than the conventional reference-based approach while generating highly consistent results. Moreover, cfDNA fragmentomic features reported by Freefly can be directly used for cancer diagnosis. Hence, Freefly possesses translational merit toward the rapid and unbiased measurement of cfDNA fragmentomics.

AMPD: an Analects-Mandarin parallel dataset for bidirectional translation

ABSTRACT In the field of natural language processing, there is no specialized dataset for the Analects, which makes it difficult to assess whether language models can find the semantic relevance between the Analects and modern Mandarin. To address this issue, this paper proposes a dataset named AMPD (Analects-Mandarin Parallel Dataset), which includes the Analects and its corresponding modern Mandarin, keywords and their annotations in the Analects, as well as sentiment. Additionally, we propose four baseline tasks and benchmark them by implementing currently popular algorithms respectively.

LAMPAT: Low-Rank Adaption for Multilingual Paraphrasing Using Adversarial Training

Paraphrases are texts that convey the same meaning while using different words or sentence structures. It can be used as an automatic data augmentation tool for many Natural Language Processing tasks, especially when dealing with low-resource languages, where data shortage is a significant problem. To generate a paraphrase in multilingual settings, previous studies have leveraged the knowledge from the machine translation field, i.e., forming a paraphrase through zero-shot machine translation in the same language. Despite good performance on human evaluation, those methods still require parallel translation datasets, thus making them inapplicable to languages that do not have parallel corpora. To mitigate that problem, we proposed the first unsupervised multilingual paraphrasing model, LAMPAT (Low-rank Adaptation for Multilingual Paraphrasing using Adversarial Training), by which monolingual dataset is sufficient enough to generate a human-like and diverse sentence. Throughout the experiments, we found out that our method not only works well for English but can generalize on unseen languages as well. Data and code are available at https://github.com/phkhanhtrinh23/LAMPAT.

Parallel multivariate deep learning models for time-series prediction: A comparative analysis in Asian stock markets

<span lang="EN-US">This study investigates deep learning models for financial data prediction and examines whether the architecture of a deep learning model and time-series data properties affect prediction accuracy. Comparing the performance of convolutional neural network (CNN), long short-term memory (LSTM), Stacked-LSTM, CNN-LSTM, and convolutional LSTM (ConvLSTM) when used as a prediction approach to a collection of financial time-series data is the main methodology of this study. In this instance, only those deep learning architectures that can predict multivariate time-series data sets in parallel are considered. This research uses the daily movements of 4 (four) Asian stock market indices from 1 January 2020 to 31 December 2020. Using data from the early phase of the spread of the Covid-19 pandemic that has created worldwide economic turmoil is intended to validate the performance of the analyzed deep learning models. Experiment results and analytical findings indicate that there is no superior deep learning model that consistently makes the most accurate predictions for all states' financial data. In addition, a single deep learning model tends to provide more accurate predictions for more stable time-series data, but the hybrid model is preferred for more chaotic time-series data.</span>

Improving neural machine translation for low resource languages through non-parallel corpora: a case study of Egyptian dialect to modern standard Arabic translation

Machine translation for low-resource languages poses significant challenges, primarily due to the limited availability of data. In recent years, unsupervised learning has emerged as a promising approach to overcome this issue by aiming to learn translations between languages without depending on parallel data. A wide range of methods have been proposed in the literature to address this complex problem. This paper presents an in-depth investigation of semi-supervised neural machine translation specifically focusing on translating Arabic dialects, particularly Egyptian, to Modern Standard Arabic. The study employs two distinct datasets: one parallel dataset containing aligned sentences in both dialects, and a monolingual dataset where the source dialect is not directly connected to the target language in the training data. Three different translation systems are explored in this study. The first is an attention-based sequence-to-sequence model that benefits from the shared vocabulary between the Egyptian dialect and Modern Arabic to learn word embeddings. The second is an unsupervised transformer model that depends solely on monolingual data, without any parallel data. The third system starts with the parallel dataset for an initial supervised learning phase and then incorporates the monolingual data during the training process.

PMScenes: A Parallel Mine Dataset for Autonomous Driving in Surface Mines

PMScenes: A Parallel Mine Dataset for Autonomous Driving in Surface Mines

Measuring, Testing, and Identifying Heterogeneity of Large Parallel Datasets

Measuring, Testing, and Identifying Heterogeneity of Large Parallel Datasets

An incremental singular value decomposition approach for large-scale spatially parallel & distributed but temporally serial data – applied to technical flows

The article presents a strategy and its algorithm to compile a simulation-accompanying, incremental Singular Value Decomposition (SVD) for time-evolving, spatially parallel discrete data sets. The framework addresses state-of-the-art PDE solvers for computational science and engineering applications. An important characteristic of such applications is that the spatial size of the data is often time-invariant and significantly exceeds the temporal size due to the large computational grid in 3D applications. Typical examples, which are also considered in this article, relate to results extracted from unsteady flow simulations. Herein, the flow data, which progresses over time, is frequently calculated spatially parallel based on domain decomposition strategies, which allow to parallelize the simulation on distributed memory machines following a Single Instruction Multiple Data (SIMD) concept.With a view to the memory-efficient reuse of (compressed) simulation results and their CPU time-saving, sufficiently accurate generation, the paper scrutinizes the efficiency of incremental/parallel SVD approaches for such simulation examples. To improve the computational efficiency, the introduction of a bunch matrix is proposed, which enables the aggregation of multiple time steps and SVD updates, and significantly increases the efficiency. The suggested strategy is verified and validated by simple 2D laminar single-phase flows and subsequently applied to more complex 2D and 3D turbulent two-phase flows. Emphasis is given to (a) the accuracy of SVD-based reconstruction, (b) the physical realizability of the reconstructed quantities, (c) the independence of domain partitioning, (d) an efficient snapshot bunching, and (e) related implementation aspects. In addition, the influence of lower and (adaptive) upper rank thresholds on the effort and accuracy is evaluated. A final application renders the practical benefits of the approach and refers to a merchant ship in head waves at Re = 1.4×107 and Fn = 0.26. The simulation involves 2880 processor cores and the related full-rank snapshot matrix has (108×104) entries. With a numerical overhead of O(10%), this snapshot matrix can be incrementally generated and compressed by O(95%). The compression is accompanied by only small errors in the integral force and local wave elevation of O(10−2%). This qualifies the method for an efficient subsequent data processing.

Chinese Text De-Colloquialization Technique Based on Back-Translation Strategy and End-to-End Learning

With the development of the Internet, there has been a significant increase in various types of textual information. However, when people engage in the composition of formal texts, they often incorporate their colloquial habits, which can diminish the professionalism and formality of the text. Existing research on Chinese texts primarily focuses on correcting misspelt characters that are visually or phonetically similar, as well as obvious grammatical errors, such as redundancy, omissions, and incorrect word order. However, there is limited research addressing the correction of text that exhibits colloquial expressions without apparent grammatical errors or misspelt characters. This article proposes a novel technique that utilizes deep learning methods to directly transform colloquial textual expressions into formal written expressions. Firstly, a parallel corpus dataset of written and spoken language is constructed using a back-translation strategy. Then, an end-to-end learning mechanism based on neural machine translation is employed, with colloquial text as the source language and written text as the target language. This allows the model to directly transform the colloquial text into text with a formal style. Finally, an evaluation of the proposed approach is conducted using the bilingual evaluation understudy (BLEU) and manual assessment techniques. The experimental results demonstrate that the technology proposed in this paper performs well in the task of de-colloquialization in Chinese texts. The contribution of this paper lies in proposing an automated method for collecting a substitute for manually annotated parallel corpora of spoken and written language, which significantly saves time and reduces the manual cost of constructing the dataset. Furthermore, the application of end-to-end learning techniques from neural machine translation to the task of de-colloquialization allows the trained model to directly generate written language flexibly based on the input of spoken language. This presents a novel solution for the task of the de-colloquialization of Chinese text.

SNPtotree-Resolving the Phylogeny of SNPs on Non-Recombining DNA.

Genetic variants on non-recombining DNA and the hierarchical order in which they accumulate are commonly of interest. This variant hierarchy can be established and combined with information on the population and geographic origin of the individuals carrying the variants to find population structures and infer migration patterns. Further, individuals can be assigned to the characterized populations, which is relevant in forensic genetics, genetic genealogy, and epidemiologic studies. However, there is currently no straightforward method to obtain such a variant hierarchy. Here, we introduce the software SNPtotree v1.0, which uniquely determines the hierarchical order of variants on non-recombining DNA without error-prone manual sorting. The algorithm uses pairwise variant comparisons to infer their relationships and integrates the combined information into a phylogenetic tree. Variants that have contradictory pairwise relationships or ambiguous positions in the tree are removed by the software. When benchmarked using two human Y-chromosomal massively parallel sequencing datasets, SNPtotree outperforms traditional methods in the accuracy of phylogenetic trees for sequencing data with high amounts of missing information. The phylogenetic trees of variants created using SNPtotree can be used to establish and maintain publicly available phylogeny databases to further explore genetic epidemiology and genealogy, as well as population and forensic genetics.

Oncogenic K-Ras suppresses global miRNA function

K-Ras frequently acquires gain-of-function mutations (K-RasG12D being the most common) that trigger significant transcriptomic and proteomic changes to drive tumorigenesis. Nevertheless, oncogenic K-Ras-induced dysregulation of post-transcriptional regulators such as microRNAs (miRNAs) during oncogenesis is poorly understood. Here, we report that K-RasG12D promotes global suppression of miRNA activity, resulting in the upregulation of hundreds of targets. We constructed a comprehensive profile of physiological miRNA targets in mouse colonic epithelium and tumors expressing K-RasG12D using Halo-enhanced Argonaute pull-down. Combining this with parallel datasets of chromatin accessibility, transcriptome, and proteome, we uncovered that K-RasG12D suppressed the expression of Csnk1a1 and Csnk2a1, subsequently decreasing Ago2 phosphorylation at Ser825/829/832/835. Hypo-phosphorylated Ago2 increased binding to mRNAs while reducing its activity to repress miRNA targets. Our findings connect a potent regulatory mechanism of global miRNA activity to K-Ras in a pathophysiological context and provide a mechanistic link between oncogenic K-Ras and the post-transcriptional upregulation of miRNA targets.

Integer codes correcting single errors and detecting burst errors within two bytes

AbstractThe need for fast communication has led to the introduction of 100 Gbps optics in local area networks (LANs). To avoid retransmission of corrupted packets, in some LANs, the CRC codes were replaced by Reed‐Solomon (RS) codes. Although this solution has met its primary goal, it has two drawbacks: first, the payload size was significantly reduced, and second, each network node had to be equipped with much more complex hardware, which increased the cost of the network. Starting from the fact that the vast majority of corrupted packets contain only single errors, in this paper, a simple strategy for error control in 100 Gbps optical LANs is presented. More precisely, instead of protecting the data with the CRC or RS codes, using integer codes is suggested that can correct single errors and detect two types of burst errors: l‐bit burst errors within one b‐bit byte and h‐bit burst errors within two b‐bit bytes (1 ≤ h < l < b). Unlike the CRC or RS codes, the proposed ones use integer and lookup table operations, which are supported by all processors. In addition, the proposed codes can be interleaved without delay and without using any additional hardware. This feature allows the decoder not only to process larger data sets in parallel, but also to detect all double burst errors.

Interpretable deep learning survival predictive tool for small cell lung cancer.

Small cell lung cancer (SCLC) is an aggressive and almost universally lethal neoplasm. There is no accurate predictive method for its prognosis. Artificial intelligence deep learning may bring new hope. By searching the Surveillance, Epidemiology, and End Results database (SEER), 21,093 patients' clinical data were eventually included. Data were then divided into two groups (train dataset/test dataset). The train dataset (diagnosed in 2010-2014, N = 17,296) was utilized to conduct a deep learning survival model, validated by itself and the test dataset (diagnosed in 2015, N = 3,797) in parallel. According to clinical experience, age, sex, tumor site, T, N, M stage (7th American Joint Committee on Cancer TNM stage), tumor size, surgery, chemotherapy, radiotherapy, and history of malignancy were chosen as predictive clinical features. The C-index was the main indicator to evaluate model performance. The predictive model had a 0.7181 C-index (95% confidence intervals, CIs, 0.7174-0.7187) in the train dataset and a 0.7208 C-index (95% CIs, 0.7202-0.7215) in the test dataset. These indicated that it had a reliable predictive value on OS for SCLC, so it was then packaged as a Windows software which is free for doctors, researchers, and patients to use. The interpretable deep learning survival predictive tool for small cell lung cancer developed by this study had a reliable predictive value on their overall survival. More biomarkers may help improve the prognostic predictive performance of small cell lung cancer.

A parallel CF tree clustering algorithm for mixed-type datasets

Many traditional clustering algorithms are incapable of processing mixed-type datasets in parallel, limiting their applications in big data. In this paper, we propose a CF tree clustering algorithm based on MapReduce to handle mixed-type datasets. Mapper phase and reducer phase are the two primary phases of MR-CF. In the mapper phase, the original CF tree algorithm is modified to collect intermediate CF entries, and in the reducer phase, k-prototypes is extended to cluster CF entries. To avoid the high costs associated with I/O overheads and data serialization, MR-CF loads a dataset from HDFS only once. We first analyze the time complexity, space complexity, and I/O complexity of MR-CF. We also compare it with sklearn BIRCH, Apache Mahout k-means, k-prototypes, and mrk-prototypes on several real-world datasets and synthetic datasets. Experiments on two mixed-type big datasets reveal that MR-CF reduces execution time by 45.4% and 61.3% when compared to k-prototypes, and it reduces execution time by 73.8% and 55.0% when compared to mrk-prototypes.

A Novel Detector Geometry for X-Ray CT

State-of-the-art x-ray computed tomography (CT) scanners all employ the conventional detector geometry which forms an arc concentric to the x-ray source. While each collected projection forms an equiangular dataset, the distance of each projection sample to the iso-center is nonuniformly spaced. During the cone-beam to parallel-beam conversion, both channel-wise and view-wise rebinning are required, leading to a degraded spatial resolution and an increased aliasing artifact. In this paper, we propose a novel detector geometry that acquires evenly spaced projection samples relative to the iso-center and only view-wise rebinning is required to form a parallel dataset. To ensure that the detector cell size is independent of the cell position, the source-to-detector distance varies as a function of the detector fan-angle. Each detector module is tilted to guarantee the orthogonality of the detector surface to the x-ray. Extensive computer simulations were performed to demonstrate the efficacy of our design. Spatial resolution was measured with the modulation transfer function (MTF) and the proposed design offers a 12.6% improvement. When the equiangular configuration was re-tuned to match the spatial resolution, the proposed design exhibits an 8.8% noise reduction. In addition, aliasing artifacts were significantly reduced at locations away from the iso-center.

Sentiment Analysis of Multilingual Dataset of Bahraini Dialects, Arabic, and English

Sentiment analysis is an application of natural language processing (NLP) that requires a machine learning algorithm and a dataset. In some cases, the dataset availability is scarce, particularly with Arabic dialects, precisely the Bahraini ones, which necessitates using an approach such as translation, where a rich source language is exploited to create the target language dataset. In this study, a dataset of Amazon product reviews in Bahraini dialects is presented. This dataset was generated using two cascading stages of translation—a machine translation followed by a manual one. Machine translation was applied using Google Translate to translate English Amazon product reviews into Standard Arabic. In contrast, the manual approach was applied to translate the resulting Arabic reviews into Bahraini ones by qualified native speakers utilizing constructed customized forms. The resulting parallel dataset of English, Standard Arabic, and Bahraini dialects is called English_Modern Standard Arabic_Bahraini Dialects product reviews for sentiment analysis “E_MSA_BDs-PR-SA”. The dataset is balanced, composed of 2500 positive and 2500 negative reviews. The sentiment analysis process was implemented using a stacked LSTM deep learning model. The Bahraini dialect product dataset can be utilized in the transfer learning process for sentimentally analyzing another dataset in Bahraini dialects.

TECHNOLOGY FOR GRAMMATICAL ERRORS CORRECTION IN UKRAINIAN TEXT CONTENT BASED ON MACHINE LEARNING METHODS

Context. Most research in grammatical and stylistic error correction focuses on error correction in English-language textual content. Thanks to the availability of large data sets, a significant increase in the accuracy of English grammar correction has been achieved. Unfortunately, there are few studies on other languages. Systems for the English language are constantly developing and currently actively use machine learning methods: classification (sequence tagging) and machine translation. A large amount of parallel or manually labelled data is required to build a high-quality machine learning model for correcting grammatical/stylistic errors in the texts of those morphologically complex languages. Manual data annotation requires a lot of effort by professional linguists, which makes the creation of text corpora, especially in morphologically rich languages, mainly Ukrainian, a time- and resource-consuming process.
 Objective of the study is to develop a technology for correcting errors in Ukrainian-language texts based on machine learning methods using a small set of annotated parallel data.
 Method. For this study, machine learning algorithms were selected when developing a system for correcting errors in Ukrainianlanguage texts using an optimal pipeline, including pre-processing and selecting text content and generating features in small annotated data corpora. The neural network’s use with a new architecture, a review of state-of-the-art methods, and a comparison of different pipeline stages will make it possible to determine such a combination of them, allowing a high-quality error correction model in Ukrainian-language texts.
 Results. A machine learning model for error correction in Ukrainian-language texts has been developed. A universal scheme for creating an error correction system for different languages is proposed. According to the results, the neural network can correct simple sentences written in Ukrainian. However, creating a full-fledged system will require spell-checking using dictionaries and checking rules, both simple and based on the result of parsing dependencies or other features. The pre-trained neural translation model mT5 has the best performance among the three models. To save computing resources, it is also possible to use a pre-trained BERT-type neural network as an encoder and a decoder. Such a neural network has half the number of parameters as other pretrained machine translation models and shows satisfactory results in correcting grammatical and stylistic errors.
 Conclusions. The created model shows excellent classification results on test data. The calculated machine translation quality metrics allow only a partial comparison of the models since most of the words and phrases in the original and corrected sentences are the same. The best value for both BLEU (0.908) and METEOR (0.956) is obtained for mT5, which is consistent with the case study in which the most accurate error corrections without changing the initial value of the sentence are obtained for such a neural network. The M2M100 has a higher BLEU score (0.847) than the “Ukrainian Roberta” Encoder-Decoder (0.697). However, subjectively evaluating the results of the correction of examples, the M2M100 does a much worse job than the other two models. For METEOR, M2M100 (0.925) also has a higher score than the “Ukrainian Roberta” Encoder-Decoder (0.876).