Syntactic Sequences Research Articles

ALSI-Transformer: Transformer-Based Code Comment Generation With Aligned Lexical and Syntactic Information

Code comments explain the operational process of a computer program and increase the long-term productivity of programming tasks such as debugging and maintenance. Therefore, developing methods that automatically generate natural language comments from programming code is required. With the development of deep learning, various excellent models in the natural language processing domain have been applied for comment generation tasks, and recent studies have improved performance by simultaneously using the lexical information of the code token and the syntactical information obtained from the syntax tree. In this paper, to improve the accuracy of automatic comment generation, we introduce a novel syntactic sequence, Code-Aligned Type sequence (CAT), to align the order and length of lexical and syntactic information, and we propose a new neural network model, Aligned Lexical and Syntactic information-Transformer (ALSI-Transformer), based on a transformer that encodes the aligned multi-modal information with convolution and embedding aggregation layers. Through in-depth experiments, we compared ALSI-Transformer with current baseline methods using standard machine translation metrics and demonstrate that the proposed method achieves state-of-the-art performance in code comment generation.

Polish Comparative Adjectives and Adverbs

The paper investigates the morphosyntax of Polish synthetic comparative adjectives and adverbs. It is argued that we can predict the distribution of different classes of adjectival roots and suffixes if we adopt the idea that both types of morphemes lexicalize syntactic constituents, the central tenet of Nanosyntax. The paper makes a case for two central claims. One is that the syn-sem properties of adjectives can be described with a finegrained syntactic sequence proposed for Slovak in Vanden Wyngaerd et al. (2020). The other one is that the lexical properties of Polish gradable adverbs follow from the syntactic representation of the adverb as properly containing the syntactic representation of the adjective.

THE TYPOLOGY OF QUANTITATIVE QUALIFIERS MARKING “MULTIPLE, EXCESSIVE, EXTREME” IN OLD TURKIC

Adjectives and adverbs, which are responsible for qualifying nouns, nouns and verbs according to the common and classical grammatical approach, are units that characterize these word categories from a wide variety of aspects. The fact that the same lexical units qualify both nouns and denominal words and verbs is related to their syntactic duties. In this respect, the units in the category with available functions are called “qualifiers”. Considering that the most convenient approach for the typology of world languages is to evaluate historical periods diachronically, the importance of archaic forms for qualifiers will come to the fore even more. Therefore, in order to study the qualifiers of Turkic, thefirst written inventory of the language in question and the various circles included in the scope of this period (VIII-XI century) will be the field from which the most appropriate data document will be obtained. Because the texts written in this period, especially in the Buddhist and Islamic environment, are very rich in terms of qualifiers. In this article, typologies of qualifiers identified in the first written inventory of Turkic between the eighth and eleventh centuries are examined. Since the existence of quite a variety of qualifiers makes it difficult to study these units in Turkic, the study will focus on the quantity qualifiers declaring “multiple, excessive, extreme”and from this point of view, it will be tried to reach the general qualifier characters. The general anatomy of the qualifiers will be revealed with a classification over the grammaticalization stages, conceptual relations and syntactic sequences of the quantity qualifiers to be discussed. In this way, both diachronic and synchronicfindings will be reached and findings that will contribute to language universality and language typology will be revealed.

Szeregi składniowe w staropolskich apokryfach Starego i Nowego Testamentu (na przykładzie Historyi barzo cudnej o stworzeniu nieba i ziemie i Rozmyślania przemyskiego)

Syntactic Sequences in Old Polish Apocrypha of the Old and New Testament (Based on Historya barzo cudna o stworzeniu nieba i ziemie and Rozmyślanie przemyskie)
 Researchers of Old Polish texts notice that they contain stylistic devices called syntactic sequences, a particular type of which are synonymous sequences. The aim of the article is to characterize synonymous sequences in Polish medieval Biblical-apocryphal writings, and to indicate their importance for the stylistics of Old Polish literature. Furthermore, the author of the article wants to find out why the copyists/authors of the texts decided to use such sequences in those writingss. The basis for the analysis includes some examples of syntactic sequences from The Przemyśl Meditation (Rozmyślanie Przemyskie) and The Marvellous Story on the Creation of Heaven and Earth (Historya barzo cudna o stworzeniu nieba i ziemie) by Krzysztof Pussman. However, the author of the article does not focus on the genetic aspects of text analysis. He is not interested in the origin of the sequences. What is important for him is to determine the function of the word connections in question, and to identify the reasons for using them in the translation.

Параграфемные средства экспрессивности в англоязычном дискурсе моды

The purpose of the study is to identify the main functions of paragraphemic means in the English-language media discourse of the fashion industry. The article analyses a complex of paragraphemic means, including punctuation, font variation and variation in the text’s planar syntagmatics. The work is novel in that when describing the English-language fashion discourse, it is ascertained that functionality of paragraphemic means enhances and enriches semantics of the text’s verbal component in terms of shifting the ideological focus of social values perception, it is proved that syngraphemics is not so much a means of differentiating between units of syntactic sequence of elements as a powerful means of emotional-evocative expressiveness of the text. As a result, it is proved that the expressive function of nonverbal means of the English-language discourse enhances the framing set by verbal and figurative components of information structures.

“ze davar shehu ktsat muzar [That’s a thing which is a bit strange]”:The |ze (copula) NP she‑Relative Clause|—Construction in Spoken Hebrew DiscourseDiscussion

In this article I explore a complex syntactic sequence in spoken Hebrew discourse that is composed of a deictic subject pronoun (ze) followed by a predicative phrase consisting of a noun phrase (NP) and a relative clause (RC) which is introduced by the general subordinator she-, schematically |ze (copula) NP she‑RC|. I demonstrate that this sequence is regularly used by speakers to perform the social act of stancetaking and that in these cases the functional content of the RC is evaluative with regard to the preceding NP. My analysis is supported by quantitative evidence from a survey contrasting evaluative with non‑evaluative uses of this sequence, from which I conclude that when it is used as a stancetaking device the sequence |ze (copula) NP she‑RC| shows signs of an emergent construction. My discussion of this phenomenon contributes to the research of RCs in conversational Hebrew and across languages to the extent that it recognises an evaluative use of RCs, which adds to the most frequently employed and widely acknowledged uses of RCs in discourse, i.e. (1) providing new information concerning a referent or (2) facilitating an interlocutor in identifying a previously mentioned referent. Moreover, this article is also a contribution to the study of how grammatical means are used for and shaped by the ubiquitous enactment of stance in naturally occurring discourse.

Cognitive Study for Language as a Complex Adaptive System: Evidence from Chinese WeChat Communications

The nature of language has always been the core issue of academic inquiry. Form and function, symbol and representation, linearity and system, static and dynamic, inner and outer, mind and brain, etc. are always the hot arguing topics in both linguistics and philosophical fields. The complex adaptive theory argues that language understanding requires whole-hearted intelligent participation and the adaptive selection of complex systems, which is the overall response of human beings to the external world and language stimulus. In order to prove this, this article chooses Chinese daily language on the WeChat as examples so as to provide evidence for explaining the complexity of language expression and language understanding. With thoughtful analysis and discussion by exploring the essential features of language evidence, this paper concludes that language understanding goes beyond the syntactic sequences of words and involves the whole cognition and adaptation of human being to the environment; semantic generation needs to mobilize the comprehensive coordination of all elements of human cognitive systems to produce the overall effect. It further indicates that thinking is literal and coherent, and suitable for logical modeling. This conclusion is in accordance with the biological and neural science claim by the second generation of cognitive science.

Имя LONDON как основная реализация лондонского текста английской лингвокультуры

The article analyses the lexeme London, especially the syntagmatic sequences with it which are regarded as key realisations of the London supertext that the name of the capital generated in the English language and literature. Supertext is viewed as a language unit – an emic text, which is the semantic invariant for a group of texts that have a similar topic. At the level of mental representations, any ethno-specific cultural concept, for instance, corresponds to its supertext which may be either real (verbalised) or potential. In accordance with this conception, the London text is constituted by a set of semantic components and contains mental algorithms for their predication. Being deployed from its text paradigm (sort of mental matrix), it may be translated (that is verbalised) by means of semantically related syntactic sequences. The article establishes the etymology of the lexeme London and considers its derivatives. The necessity of analysing the etymology of the word lies in the fact that the London supertext incorporates both contemporary or relatively stable meaning and the initial diachronic meaning to be looked for in the lexeme that names it. The latter constitutes the “memory” of the supertext, which is present in it in posse as a set of virtualised semantic components. Further examined are a corpus of set phrases and phraseological units containing the lexeme in question. A study of the derivatives of the lexeme London (ten in number) has yielded a fuller access to the structural components of the supertext considered. The study has taken into account two sememes of each derivative – those of its stem and of its affix. As the article demonstrates, the semantics of the derivatives largely depends on the realisations of the supertext which they are part of. It has been revealed that a number of the derivatives analysed have the status of rare or nonce-words. The stem of the derivative ensures a concrete filling of a general schematic or frame-type action expressed by the affix. Set phrases (114) and phraseological units (15) with the word London have been considered as realisations of various semantic components of the London text. These units and phrases account for the inclusion of the supertext into intertextual paradigms, and reflect the standard object-to-object relations that are typical of the British civilisation. Among the set phrases, the article distinguishes compound non-idiomatic nominations (75), bound non-idiomatic terms (25), and phraseological units featuring various degrees of idiomaticity (14). Phraseological units permit tracing the historical stages in the formation of the London text, and testify to a high frequency of the use of its name. Phraseological units also incorporate realisations of the peripheral components of the supertext, resulting from the actualisation of its idiolectal semantic components.

Les mécanismes de construction de mots en godié, langue kru de Côte D'Ivoire

This article analyzes the mechanisms of word building in Godié, a Kru language spoken in Côte d’Ivoire. Two processes underly these mechanisms: morphological and syntactic methods. Morphological processes refer to constructed words and syntactic processes refer to lexicalized syntactic sequences. At the morphological level, are generated by the constructed word by suffix and words constructed by juxtaposing two or three tokens. The language has three verbal derivative suffixes. These are -lɩ, -nö and -mà. There is no process in the language whereby a verb is derived from a noun. For words constructed by juxtaposition of tokens, there are generally three types obtained by. In other words, two or three nouns can combine to create new words; as a noun and an adjective can combine to create new words. As for new words, created by combining two or three names, it has been shown that the Internal underlying structure of bipartite type derived from a tripartite structure surface. However, the existence of the tripartite structure is allowed; but it emerges, within the language, from idiosyncratic phenomena. Even in lexicalized syntactic sequences, it was also observed that internal bipartite structure underneath. Moreover, between words constructed by combining three formants and lexicalized syntactic sequences, the limit is blurred. In the language, words constructed as syntactic lexicalized sequence may be a dictionary entry. Our study shows that the concept of a morphological right head is untenable. In the language, in fact, words may be constructed with both left and with right morphological heads. In addition, some words are constructed with morphological head whatsoever, as in many languages around the world.

Sur les pas de Flaubert: approches sensibles du paysage

When on his first extended trip away from Normandy, to Southern France, the Pyrenees, and Corsica, Flaubert claimed in his travel notes that he wanted his sentences to smell of the leather of his shoes. This collection of essays, edited by Philippe Antoine, begins by evoking the whiff of Flaubert's travelling feet, asking questions about the connections between the ambulatory reality experienced by writers such as Flaubert, and the practice of writing. As Antoine remarks in his own article in this collection, on Par les champs et par les grèves, Flaubert's travel writing stresses the corporeal, mobilizing all the senses in its attempts to get to grips with the realities of the world experienced through the journey; Antoine suggests that in the account of his tour around Brittany, Flaubert optimistically works towards dismantling the boundaries between mind and matter, travelling and writing, sensory pleasure and the pleasure of the sentence. The essays assembled here, which focus on nineteenth-century travel writing, give prominence to the practice of walking. The walk is figured as an experience that facilitates the embrace of sensory perception. As in studies on the senses (such as The Varieties of Sensory Experience: A Sourcebook in the Anthropology of the Senses, ed. by David Howes (Toronto: University of Toronto Press, 1991), or Paul Rodaway, Sensuous Geographies: Body, Sense and Place (London: Routledge, 1994)), the dominance of the visual is downplayed in favour of discussion of the significance of the aural and the olfactory. Alain Guyot's article examines the presence of soundscapes in Chateaubriand's travel writing, arguing that striking examples of sonority tend to be positioned at textually significant points, such as at the end of syntactic sequences or as the climax of episodes. Sarga Moussa compares the representation of the senses in the Oriental landscapes described by Chateaubriand, Lamartine, and Flaubert, privileging nocturnal experiences so as to debunk the authority of the visual. The problem lies in the somewhat misleading title of the collection and the prominence it gives to Flaubert: these heterogeneous essays deal with nineteenth-century trips to Spain, Tenerife, and Tibet, among other destinations; of the twelve articles, only two focus primarily on Flaubert. Attention is given mainly to writers whose works either predate the publication of Flaubert's travel writing or make no connection with Flaubert: Sophie Lécole discusses Théophile Gautier's Voyage en Espagne; Pierre Dufief examines the Goncourt brothers' trip to Algeria; Lauric Guillaud draws on comparison with Baudelaire in an article on Rosny Aîné's ‘wonderlands’ of travel. The essays here follow less in the footsteps of Flaubert's stinky sandals than in the wake of Jean-Pierre Richard's study of nineteenth-century writers' perceptions and sensations of the material world in his Littérature et sensation (Paris: Seuil, 1954), a work which receives surprisingly fleeting reference across the collection. Interest in this volume will lie less in the attention directed towards Flaubert, and more in the wider realms of nineteenth-century travel writing and studies of the representation of the senses.

Author verification using a Graph-based Representation

This paper presents a methodology for tackling the authorship verification problem. The approach is based on comparing the similarity between a given unknown document against the known documents using a graph representation that captures the syntactic sequence of texts and a graph similarity measure. An unknown document can be classified as having been written by the same author if the majority of the comparisons surpass a predefined threshold. The best results were obtained on the Clef PAN 2014 dataset: 79% for the Spanish and 68% for English, showing that the proposed methodology could be a way for determining a document authorship.

Syntax processing properties of generic cortical circuits

Higher cognitive functioning is assumed to be largely symbolic/representational and compositional in nature. At various processing stages, from perceptual to motor, discrete structural elements with intricate temporal dependencies are combined into increasingly complex constructs [1]. Mapping such complex computational processes to the underlying neuronal infrastructure and assessing the properties of the neuronal system responsible for their implementation is not straightforward, but it is likely to yield important insights into the nature of neural computation. In order to address these issues, we adopt ideas and formalisms developed by theoretical linguistics to study the nature of rule-like or compositional behavior in the language domain, namely the acquisition of formal (artificial) grammars. The Artificial Grammar Learning (AGL) paradigm has a long tradition in psycholinguistic research (see, e.g. [2] for an overview), as a means to study the nature of syntactic processing and implicit sequence learning. With mere exposure and without performance feedback, human beings implicitly acquire knowledge about the structural regularities implemented by complex rule systems. In this work, we investigate to which extent generic cortical microcircuits can support formally explicit symbolic computations, instantiated by the same grammars used in the human AGL literature and implementing various types of local and non-adjacent dependencies between the sequence elements, thus requiring varying degrees of computational complexity and online processing memory to be adequately learned. We use concrete implementations of input-driven recurrent networks composed of noisy, spiking neurons, built according to the reservoir computing framework and dynamically shaped by a variety of synaptic and intrinsic plasticity mechanisms operating concomitantly [3]. Additionally, we compare supervised and unsupervised learning rules for the decoding algorithms, with varying degrees of biological plausibility. We show that, when shaped by plasticity, these models are capable of acquiring the structure of simple (regular) grammars. When asked to judge string legality (in a manner similar to human subjects), the networks perform at a qualitatively comparable level. We uncover which plasticity mechanisms are crucial for the task, with the aim of specifying a minimal model. Furthermore, the capability of the networks to process (bounded) recursive constructions including multiple patterns of non-adjacent dependencies accurately reflects recent results of human performance, highlighting inherent limitations imposed by the nature of neuronal processing.

Past tense in the brain's time: Neurophysiological evidence for dual-route processing of past-tense verbs

A controversial issue in neuro- and psycholinguistics is whether regular past-tense forms of verbs are stored lexically or generated productively by the application of abstract combinatorial schemas, for example affixation rules. The success or failure of models in accounting for this particular issue can be used to draw more general conclusions about cognition and the degree to which abstract, symbolic representations and rules are psychologically and neurobiologically real. This debate can potentially be resolved using a neurophysiological paradigm, in which alternative predictions of the brain response patterns for lexical and syntactic processing are put to the test. We used magnetoencephalography (MEG) to record neural responses to spoken monomorphemic words ('hide'), pseudowords ('smide'), regular past-tense forms ('cried') and ungrammatical (overregularised) past-tense forms ('flied') in a passive listening oddball paradigm, in which lexically and syntactically modulated stimuli are known to elicit distinct patterns of the mismatch negativity (MMN) brain response. We observed an enhanced ('lexical') MMN to monomorphemic words relative to pseudowords, but a reversed ('syntactic') MMN to ungrammatically inflected past tenses relative to grammatical forms. This dissociation between responses to monomorphemic and bimorphemic stimuli indicates that regular past tenses are processed more similarly to syntactic sequences than to lexically stored monomorphemic words, suggesting that regular past tenses are generated productively by the application of a combinatorial scheme to their separately represented stems and affixes. We suggest discrete combinatorial neuronal assemblies, which bind classes of sequentially occurring lexical elements into morphologically complex units, as the neurobiological basis of regular past tense inflection.

Syntactic sequencing in Hebbian cell assemblies

Hebbian cell assemblies provide a theoretical framework for the modeling of cognitive processes that grounds them in the underlying physiological neural circuits. Recently we have presented an extension of cell assemblies by operational components which allows to model aspects of language, rules, and complex behaviour. In the present work we study the generation of syntactic sequences using operational cell assemblies timed by unspecific trigger signals. Syntactic patterns are implemented in terms of hetero-associative transition graphs in attractor networks which cause a directed flow of activity through the neural state space. We provide regimes for parameters that enable an unspecific excitatory control signal to switch reliably between attractors in accordance with the implemented syntactic rules. If several target attractors are possible in a given state, noise in the system in conjunction with a winner-takes-all mechanism can randomly choose a target. Disambiguation can also be guided by context signals or specific additional external signals. Given a permanently elevated level of external excitation the model can enter an autonomous mode, where it generates temporal grammatical patterns continuously.

OS CONSTITUINTES DE SN DO KATUKINA

In our study we discuss the NP internal disponsition in the Katukina language, questioning the nature of its lexical itens - dissylabics and oxitones - which can be formed by syntactic contents sequence. So this leads us to suspect that Katukina is agluting languages.

Phonetic, syntactic and conceptual analysis driven speech recognition system and method

A new approach to speech recognition that reacts to concepts conveyed through speech, which shifts the balance of power in speech recognition from straight sound recognition and statistical models to a more powerful and complete approach determining and addressing conveyed concepts. A probabilistically unbiased multi-phoneme recognition process is employed, followed by a phoneme stream analysis process that builds the list of candidate words derived from recognized phonemes, followed by a permutation analysis process that produces sequences of candidate words with high potential of being syntactically valid, and finally, by processing targeted syntactic sequences in a conceptual analysis process to generate the utterance's conceptual representation that can be used to produce an adequate response. Applications include improving accuracy or automatically generating punctuation for transcription and dictation, word or concept spotting in audio streams, concept spotting in electronic text, customer support, call routing and other command/response scenarios.

Multi-phoneme streamer and knowledge representation speech recognition system and method

A system and method related to a new approach to speech recognition that reacts to concepts conveyed through speech. In its fullest implementation, the system and method shifts the balance of power in speech recognition from straight sound recognition and statistical models to a more powerful and complete approach determining and addressing conveyed concepts. This is done by using a probabilistically unbiased multi-phoneme recognition process, followed by a phoneme stream analysis process that builds the list of candidate words derived from recognized phonemes, followed by a permutation analysis process that produces sequences of candidate words with high potential of being syntactically valid, and finally, by processing targeted syntactic sequences in a conceptual analysis process to generate the utterance's conceptual representation that can be used to produce an adequate response. The invention can be employed for a myriad of applications, such as improving accuracy or automatically generating punctuation for transcription and dictation, word or concept spotting in audio streams, concept spotting in electronic text, customer support, call routing and other command/response scenarios.

Basal ganglia neural mechanisms of natural movement sequences

Natural rodent grooming and other instinctive behavior serves as a natural model of complex movement sequences. Rodent grooming has syntactic (rule-driven) sequences and more random movement patterns. Both incorporate the same movements--only the serial structure differs. Recordings of neural activity in the dorsolateral striatum and the substantia nigra pars reticulata indicate preferential activation during syntactic sequences over more random sequences. Neurons that are responsive during syntactic grooming sequences are often unresponsive or have reverse activation profiles during kinematically similar movements that occur in flexible or random grooming sequences. Few neurons could be categorized as strictly movement related--instead they were activated only in the context of particular sequential patterns of movements. Particular sequential patterns included "syntactic chain" grooming sequences of paw, head, and body movements and also "warm-up" sequences, which consist of head and body/limb movements that precede locomotion after a period of quiet resting (Golani 1992). Activation during warm-up was less intense and less frequent than during grooming sequences, but both sequences activated neurons above baseline levels, and the same neurons sometimes responded to both sequences. The fact that striatal neurons code 2 natural sequences which are made up of different constituent movements suggests that the basal ganglia may have a generalized role in sequence control. The basal ganglia are modulated by the context of the sequence and may play an executive function in the complex natural patterns of sequenced behaviour.

A spy to spy on a spy: From type to token representation with cell assemblies

The idea of representing words with cell assemblies is very appealing. However, syntactic sequences need to be represented as well. This cannot be done by using the activity levels of assemblies. Instead, structural relations and operations between assemblies are needed to achieve serial order in syntactic word strings.

Action sequencing is impaired in D1A-deficient mutant mice.

The role of dopamine in the production of behaviour is multifarious in that it can influence different aspects of movement (e.g. movement initiation, sensorimotor integration, and movement sequencing). A characteristic of the dopamine system which seems to be critical for the expression of this diverse influence is its varied receptor population. Previous studies have shown that specific receptor subtype activation leads to specific behavioural responses or alterations of selective aspects of movement. It is known that one of the important influences of dopamine includes sequential co-ordination of 'syntactic' patterns of grooming movements because moderate loss of the dopaminergic nigrostriatal projections specifically disrupts these patterns without affecting grooming actions in a general fashion (Berridge, K.C. Psychobiology, 15, 336, 1989). The specific receptors of the dopamine family which play a key part in this co-ordination of movement sequences is not known. In the present study, we examined the serial order of particular syntactic sequences or chains of grooming actions in mice lacking D1A receptors to explore the relationship between this receptor subtype and movement sequencing. Mutant mice had shorter grooming bouts and a disruption of the organization of sequential patterns compared with wild-type littermate controls. Sequential disruption was reflected in the failure of D1A mutants to follow the syntactic pattern of grooming to completion. This sequential disruption deficit appeared to be specific, as mutant mice initiated more syntactic chains than wild-type controls even though they were less likely to complete them. These results support the hypothesis that D1A receptor activation plays a part in the sequencing of natural action. This conclusion has important implications for the understanding of the functional heterogeneity of dopamine receptor subtypes and of the aetiology of symptoms observed in patients with basal ganglia disease.