Strategy Switching Research Articles

Head west or left, east or right: interactions between memory systems in neurocognitive aging

Cognitive aging is accompanied by decline in multiple domains of memory. Here, we developed a T-maze task that required rats to learn competing hippocampal, and striatal navigation strategies in succession, across days. A final session increased demands on cognitive flexibility and required within-day switching between strategies, emphasizing capacities that engage the prefrontal cortex. Background characterization in young and aged rats used a water maze protocol optimized for individual differences in hippocampal integrity. Consistent with earlier work, young adults acquired place strategies in the T-maze faster than response, whereas the opposite was observed in aged rats with impaired spatial memory. The novel result was that aged animals with preserved spatial memory displayed a qualitatively distinct pattern, acquiring place and response strategies equally rapidly, without disruption when switching between them. Subsequent in situ hybridization for the plasticity-related immediate-early gene Arc revealed that while increasing demands on cognitive flexibility and within-day strategy switching potently engaged the prefrontal cortex in young adult and aged-impaired rats, Arc expression was insensitive in aged rats with normal spatial memory and superior switching abilities. Together, the results indicate that cognitive aging is an emergent property of the interactions between memory systems, and that successful cognitive outcomes reflect a distinct neuroadaptive process rather than a slower rate of aging.

Foraging strategy switch of a top marine predator according to seasonal resource differences

The spatio-temporal variability in marine resources influences the foraging behaviour and success of top marine predators. However, little is known about the links between these animals and ocean productivity, specifically, how plankton density influences their foraging behaviour. Southern elephant seals (Mirounga leonina) have two annual at-sea foraging trips: a two month post-breeding foraging trip (Nov – Jan) that coincides with elevated summer productivity; and an eight month post-moulting foraging trip (Feb – Oct) over winter, when productivity is low. Physical parameters are often used to describe seal habitat, whereas information about important biological parameters is lacking. We used electronic tags deployed on elephant seals during both trips to determine their movement and foraging behaviour. The tags also recorded light, which measured the bio-optical properties of the water column, the bulk of which is presumably influenced by phytoplankton. We investigated the relationship between plankton density and seal foraging behaviour; comparing trends between summer and winter trips. We found a positive relationship between plankton density and foraging behaviour, which did not vary seasonally. We propose that profitable concentrations of seal prey are more likely to coincide with planktonic aggregations, but we also acknowledge that trophic dynamics may shift in response to seasonal trends in productivity. Seal prey (mid-trophic level) and plankton (lower-trophic level) are expected to overlap in space and time during summer trips when peak phytoplankton blooms occur. In contrast, aggregated patches of lower trophic levels are likely to be more dispersed during winter trips when plankton density is considerably lower and heterogeneous. These results show that southern elephant seals are able to exploit prey resources in different ways throughout the year as demonstrated by the variation observed between seal foraging behaviour and trophic dynamics.

Pharmacotherapeutic strategies for patients treated for depression in UK primary care: a database analysis

Objective:To investigate long-term patterns of antidepressant treatment in patients in primary care in the UK, and to assess their healthcare resource use and disease outcomes.Research design and methods:A retrospective longitudinal cohort study was conducted using the Clinical Practice Research Datalink. The study population comprised patients aged ≥18 years with depression receiving a prescription for antidepressant monotherapy between 1 January 2006 and 31 December 2011 with no antidepressants within the preceding 6 months. Recovery was defined by timing of antidepressant prescriptions (≥6 months without treatment). Treatment lines and strategies (switching, combining, augmenting and resuming medication) were analyzed. Healthcare resource use for the different treatment strategies and periods of no therapy was assessed.Results:Data from 123,662 patients (287,564 treatment lines) were analyzed. Switching and resumption of treatment were more frequent than other strategies. Recovery was highest with first-line monotherapy (45% of patients), while as a second-line strategy switching was more successful (43%) than combination or augmentation. In subsequent lines of treatment, switching was associated with successively lower rates of recovery (31% in the third line and 24% from the fourth line onwards). Similar rates were observed for resumption. Healthcare resource use was greater during antidepressant use than treatment-free periods. Augmentation was associated with the highest proportions of patients with a psychiatrist referral, psychologist referral and psychiatric hospitalization.Conclusions:This study provides extensive real-world information on the prescribing patterns and treatment outcomes for a large cohort of patients treated for depression with antidepressants in primary care. Switching is more frequently used than augmentation or combination treatment, with decreasing effectiveness across successive lines. Key limitations of the study were: (i) risk of selection bias due to the use of inclusion criteria based on depression diagnoses recorded by the practitioner; and (ii) reliance on prescribing patterns as proxies for clinical outcomes, such as recovery.

Relationships Between Strategy Switching and Strategy Switch Costs in Young and Older Adults: A Study in Arithmetic Problem Solving

Background/Study Context: This study investigated age-related differences in within-item strategy switching (i.e., revising initial strategy choices to select a better strategy while solving a given problem) and in strategy switch costs (i.e., longer latencies when participants switch strategies than when they do not switch strategy during strategy execution).Methods: In a computational estimation task, participants had to give approximate products to two-digit multiplication problems (e.g., 41 × 67) while rounding up (i.e., do 50 × 70 for 41 × 67) or rounding down (i.e., do 40 × 60 for 41 × 67) operands to their nearest decades. After executing a cued strategy during 1000 ms, participants had the possibility to switch to another strategy (or repeat the same strategy) in a selection condition. In an execution condition, participants were forced to repeat the same strategy or to switch to another strategy.Results: It was found that (1) older adults were less able than young adults to switch strategy after starting to execute a cued strategy (36.1% vs. 45.8%); (2) older adults showed larger switch costs than young adults (422 vs. 223 ms); and (3) strategy switches and strategy switch costs correlated in older adults but not in young adults.Conclusion: These findings have important implications for our understanding of the mechanisms underlying within-item strategy switching and aging effects on these mechanisms as well as, more generally, of strategic variations during cognitive aging.

Simultaneous fault detection and control for switched systems with actuator faults

This paper is concerned with the fault detection and control problem for discrete-time switched systems. The actuator faults, especially ‘outage cases’, are considered. The detector/controller is designed simultaneously such that the closed-loop system switches under an average dwell time, and when a fault is detected, an alarm is generated and then the controller is switched to allow the norm of the states of the subsystem to increase within the acceptable limits. Thus, a switching strategy which combines average dwell time switching with event-driven switching is proposed. Under this switching strategy, the attention is focused on designing the detector/controller such that estimation errors between residual signals and faults are minimised for the fulfillment of fault detection objectives; simultaneously, the closed-loop system becomes asymptotically stable for the fulfillment of control objectives. A two-step procedure is adopted to obtain the solutions through satisfying a set of linear matrix inequalities. An example comprising of three cases is considered. Through these cases, it is demonstrated that the fault detection and control for switched systems using a two-stage switching strategy and asynchronous switching are feasible.

N-methyl-D-aspartate receptor-mediated glutamate transmission in nucleus accumbens plays a more important role than that in dorsal striatum in cognitive flexibility.

Cognitive flexibility is a critical ability for adapting to an ever-changing environment in humans and animals. Deficits in cognitive flexibility are observed in most schizophrenia patients. Previous studies reported that the medial prefrontal cortex-to-ventral striatum and orbital frontal cortex-to-dorsal striatum circuits play important roles in extra- and intra-dimensional strategy switching, respectively. However, the precise function of striatal subregions in flexible behaviors is still unclear. N-methyl-D-aspartate receptors (NMDARs) are major glutamate receptors in the striatum that receive glutamatergic projections from the frontal cortex. The membrane insertion of Ca2+-permeable α-amino-3-hydroxy-5-methyl-4-isoxazole-propionic acid receptors (AMPARs) depends on NMDAR activation and is required in learning and memory processes. In the present study, we measured set-shifting and reversal learning performance in operant chambers in rats and assessed the effects of blocking NMDARs and Ca2+-permeable AMPARs in striatal subregions on behavioral flexibility. The blockade of NMDARs in the nucleus accumbens (NAc) core by AP5 impaired set-shifting ability by causing a failure to modify prior learning. The suppression of NMDAR-mediated transmission in the NAc shell induced a deficit in set-shifting by disrupting the learning and maintenance of novel strategies. During reversal learning, infusions of AP5 into the NAc shell and core impaired the ability to learn and maintain new strategies. However, behavioral flexibility was not significantly affected by blocking NMDARs in the dorsal striatum. We also found that the blockade of Ca2+-permeable AMPARs by NASPM in any subregion of the striatum did not affect strategy switching. These findings suggest that NMDAR-mediated glutamate transmission in the NAc contributes more to cognitive execution compared with the dorsal striatum.

Strategy switching in the stabilization of unstable dynamics.

In order to understand mechanisms of strategy switching in the stabilization of unstable dynamics, this work investigates how human subjects learn to become skilled users of an underactuated bimanual tool in an unstable environment. The tool, which consists of a mass and two hand-held non-linear springs, is affected by a saddle-like force-field. The non-linearity of the springs allows the users to determine size and orientation of the tool stiffness ellipse, by using different patterns of bimanual coordination: minimal stiffness occurs when the two spring terminals are aligned and stiffness size grows by stretching them apart. Tool parameters were set such that minimal stiffness is insufficient to provide stable equilibrium whereas asymptotic stability can be achieved with sufficient stretching, although at the expense of greater effort. As a consequence, tool users have two possible strategies for stabilizing the mass in different regions of the workspace: 1) high stiffness feedforward strategy, aiming at asymptotic stability and 2) low stiffness positional feedback strategy aiming at bounded stability. The tool was simulated by a bimanual haptic robot with direct torque control of the motors. In a previous study we analyzed the behavior of naïve users and we found that they spontaneously clustered into two groups of approximately equal size. In this study we trained subjects to become expert users of both strategies in a discrete reaching task. Then we tested generalization capabilities and mechanism of strategy-switching by means of stabilization tasks which consist of tracking moving targets in the workspace. The uniqueness of the experimental setup is that it addresses the general problem of strategy-switching in an unstable environment, suggesting that complex behaviors cannot be explained in terms of a global optimization criterion but rather require the ability to switch between different sub-optimal mechanisms.

Dynamic complementarities in innovation strategies

Using a panel of Irish manufacturing plants over the period 1991–2008 we test for dynamic complementarities in the joint use of internal R&D and external knowledge sources. We find little evidence, either from considering successive cross-sectional waves of comparable surveys, or in terms of the strategy switch choices of specific plants, that there has been a systematic move towards the joint use of internal and external knowledge in innovation. We then test formally for the presence of complementarities in the joint use of internal R&D and external innovation linkages. In static terms we find no evidence of complementarity, but in dynamic terms find evidence that strategy switches by individual plants towards a more ‘open’ strategy are accompanied by increased innovation outputs.

Adaptive Behavior and Strategy Switching

Using the Agent-based Computational Finance (ACF) method, we build an artificial stock market with heterogeneous adaptive investors and investigate the evolutionary and interacting relationship between rational investors and irrational investors. We find that with strategy switching, there is a symbiosis among the three kinds of investors in the ACF experiments, although the rational investors are often dominant in the market. And our main findings are robust with agents' scale. When the initial values change, the market ecology achieves new equilibrium.

Brain network function during shifts in learning strategies in portal hypertension animals.

Patients with minimal hepatic encephalopathy exhibit early impairments in their ability to shift attentional set. We employed a task-switching protocol to evaluate brain network changes. Strategy switching requires the modification of both the relevant stimulus dimension and the required memory system. Rats were trained in an allocentric (A) and a cue-guided (C) task using a four-arm maze. To examine priming, we changed the order in which the tasks were presented. Five groups of animals were used: a SHAM (sham-operated) A-C group (n=10), a SHAM C-A group (n=8), a PH (portal hypertension) A-C group (n=8), PH C-A group (n=8), and a naïve group (n=10). The triple portal vein ligation method was used to create an animal model of the early evolutive phase of PH. The animals were tested in the four-arm radial water maze in a single 10-trial session each day for six days (three days for the allocentric task and three days for the cue-guided task). The metabolic activities of the brains were studied with cytochrome oxidase histochemistry, and brain network changes were assessed with principal component analysis. The behavioural results revealed significant increases in the numbers of correct choices across training days in all groups studied, and facilitation of the acquisition of the second task was present in the C-A groups. Moreover, different brain network activities were found; in the experimental groups, the performance of A-C switch involved the prefrontal cortex, and the key structures involved in the C-A switch in the other groups were the dentate gyrus of the dorsal hippocampus and the basolateral and central amygdala. These networks have a common nucleus of structures (i.e., the parietal cortex and the dorsal and ventral striatum), whereas other structures were specifically involved in each type of strategy, suggesting that these regions are part of both circuits and may interact with one another during learning.

Content-Priority-Aware Chunk Scheduling Over Swarm-Based P2P Live Streaming System: From Theoretical Analysis to Practical Design

In this work, we revisit two chunk, which is the smallest video data unit for scheduling and transmission, scheduling policies that are essentially mutually exclusive but beneficial for swarm-based P2P live streaming systems. The first is content-diversified oriented (cd-oriented) policy, which regards each chunk of equal importance and schedules chunks to be sent in a near-random fashion. With this approach, peers hold different parts of stream content and contribute their available bandwidth to the system. The second is importance-first oriented (if-oriented) policy, which gives each chunk a content-dependent priority, usually in a rate-distortion (RD) sense, and first schedules the highest-priority chunk to be sent. In doing so, important chunks are more likely to be successfully received before their playback; the reconstructed video quality is thus enhanced under poor network conditions. We successfully identify a simple methodology, which operates on the data availability domain, to leverage both policies. (Data availability here means the set of data units that the user can get from its source(s)). This allows us to deploy dynamic strategy switch scheduling in practical systems to further improve the received video quality of each peer. Simulation results show that our data-availability driven dynamic strategy switch not only overcomes the drawbacks of the two individual policies but also retains the benefits of both. Most importantly, it bridges the gap between rate-distortion analysis on compressed video and P2P content delivery research.

How age-related strategy switching deficits affect wayfinding in complex environments

Although most research on navigation in aging focuses on allocentric processing deficits, impaired strategy switching may also contribute to navigational decline. Using a specifically designed task involving navigating a town-like virtual environment, we assessed the ability of young and old participants to switch from following learned routes to finding novel shortcuts. We found large age differences in the length of routes taken during testing and in use of shortcuts, as, while nearly all young participants switched from the egocentric route-following strategy to the allocentric wayfinding strategy, none of the older participants stably switched. Although secondary tasks confirmed that older participants were impaired both at strategy switching and allocentric processing, the difficulty in using shortcuts was selectively related to impaired strategy switching. This may in turn relate to dysfunction of the prefrontal-noradrenergic network responsible for coordinating switching behavior. We conclude that the large age difference in performance at the shortcutting task demonstrates for the first time, how strategy switching deficits can have a severe impact on navigation in aging.

Thalamic and parietal brain morphology predicts auditory category learning

Auditory categorization is a vital skill involving the attribution of meaning to acoustic events, engaging domain-specific (i.e., auditory) as well as domain-general (e.g., executive) brain networks. A listener's ability to categorize novel acoustic stimuli should therefore depend on both, with the domain-general network being particularly relevant for adaptively changing listening strategies and directing attention to relevant acoustic cues. Here we assessed adaptive listening behavior, using complex acoustic stimuli with an initially salient (but later degraded) spectral cue and a secondary, duration cue that remained nondegraded. We employed voxel-based morphometry (VBM) to identify cortical and subcortical brain structures whose individual neuroanatomy predicted task performance and the ability to optimally switch to making use of temporal cues after spectral degradation. Behavioral listening strategies were assessed by logistic regression and revealed mainly strategy switches in the expected direction, with considerable individual differences. Gray-matter probability in the left inferior parietal lobule (BA 40) and left precentral gyrus was predictive of “optimal” strategy switch, while gray-matter probability in thalamic areas, comprising the medial geniculate body, co-varied with overall performance. Taken together, our findings suggest that successful auditory categorization relies on domain-specific neural circuits in the ascending auditory pathway, while adaptive listening behavior depends more on brain structure in parietal cortex, enabling the (re)direction of attention to salient stimulus properties.

Exogenous BDNF facilitates strategy set-shifting by modulating glutamate dynamics in the dorsal striatum

Brain-derived neurotrophic factor (BDNF) signaling via tropomyosin-related kinase B (trkB) receptors exerts modulatory effects on glutamatergic transmission, learning, memory and reward processing. Although the role of BDNF in the regulation of mnemonic and affective/motivational processes is well studied, whether this neurotrophin could also regulate executive functions is not known. In the present study, we assessed the effects of intrastriatal infusions on BDNF (1–100 ng/hemisphere) in mice performing an operant strategy set-shifting task that required the animals to eliminate a visual cue-based strategy and adopt a new egocentric spatial response strategy to achieve rewards. Exogenous BDNF administration facilitated the acquisition of strategy shifting by minimizing response perseveration to the previously acquired strategy and this effect resemble an inverted-U shaped dose–response pattern. Faster acquisition of strategy switching in BDNF-infused animals was dependent upon the activation of striatal trkB receptors. Moreover, activation of mGluR2/3 receptors by the selective group II metabotropic receptor agonist LY379268 abolished BDNF-induced cognitive enhancement suggesting the involvement of presynaptic glutamatergic activity. Assessment of striatal glutamate dynamics using electrochemical recordings indicated that local application of BDNF directly induces glutamate release by activating presynaptic trkB receptors on glutamatergic terminals, and this effect followed a bell-shaped dose–response pattern similar to strategy shifting performance. These data suggest that activation of BDNF-trkB signaling in the dorsal striatum improves strategy switching by effectively minimizing response conflicts, and this effect primarily involves facilitation of glutamatergic transmission.

AB0275 Switching biologic therapies in ra - a daily life observation

BackgroundSwitching between biologic agents nowadays is a common procedure when treating Rheumatoid Arthritis (RA) patients. However, there is no optimal treatment strategy available and switching biologic therapies still is an...

Effects of execution duration on within-item strategy switching in young and older adults

This study aimed at determining whether previously found age-related differences in within-item strategy switching is modulated by duration of engagement in initial strategy execution. In a computational estimation task, young and older adults had to find estimates to arithmetic problems like 37×64 while either rounding down (i.e., 30×60) or rounding up (i.e., 40×70) both operands to the closest decades. Participants were asked to execute a cued strategy for different durations (i.e., 1, 2, or 3 s), before deciding whether the cued strategy was the best strategy and to switch to the best strategy if the cued strategy was not the best. The main findings revealed that (1) young and older adults were able to switch strategies, especially when they started to execute poorer strategy on a given item; (2) older adults switched strategy less often than young adults, and (3) both young and older participants switched strategy less frequently for long than for short durations. These findings suggest that to be able to switch strategy within item, participants should not be too much engaged in execution of the initially selected strategy, and that duration of engagement in initial strategy execution does not modulate age-related differences in within-item strategy execution.

Strategy switching in the Japanese stock market

This paper investigates the expectation formation process of Japanese stock market professionals. By utilizing a monthly forecast survey dataset on the TOPIX distributed by QUICK Corporation, we sort forecasters into buy-side and sell-side professionals. We empirically demonstrate that the buy-side and sell-side professionals use either fundamental or trend-following strategies throughout their expectation formation processes and that they switch between fundamental and trend-following strategies over time. We also discuss that strategy switching can be key in understanding the persistent deviation of the TOPIX from the fundamentals.

Characteristics study of an electronic systems design strategy

PurposeThis work seeks to present the theoretical study considerations and the characteristics of a general design methodology in optimal time for electronic systems using numerical methods and optimal control theory. Through this, the design problem of a system is formulated in terms of optimal control in minimal time.Design/methodology/approachThis general design methodology includes the traditional design strategy (TDS), and the modified traditional design strategy (MTDS), where the model of the system is part of the optimization procedure but an objective function of the optimization process is constructed such as includes the traditional objective function and some penalty functions that feign the model of the system. Many special control functions are introduced artificially to generalize the methodology and produce several design trajectories for the same optimization process – the first and final trajectories correspond to TDS and MTDS, respectively. The combination of these trajectories produce an infinite number of design strategies, some of these are quasi‐optimal in time and only one is optimal in time.FindingsQualitative and numeric results of this iterative process are generated in a personal computer in a C++ language elaborated with a visual C++ graphic user interface. An algorithm is constructed to form an optimal in time design strategy switching from a MTDS subset to a TDS subset. Results of measured times are analyzed, showing that there is a control input U, such that the objective function is minimized in a minimum time.Originality/valueThese ideas are proposed using method of gradient optimization and special acceleration effect.

Information Acquisition During Online Decision Making: A Model-Based Exploration Using Eye-Tracking Data

We propose a model of eye-tracking data to understand information acquisition patterns on attribute-by-product matrices, which are common in online choice environments such as comparison websites. The objective is to investigate how consumers gather product and attribute information from moment to moment. We propose a hierarchical hidden Markov model that consists of three connected layers: a lower layer that describes the eye movements, a middle layer that identifies information acquisition processes, and an upper layer that captures strategy switching. The proposed model accounts for the data better than several alternative models. The results show that consumers switch frequently between acquisition strategies, and they obtain information on only two or three attributes or products in a particular acquisition strategy before switching. Horizontal and contiguous eye movements play an important role in information acquisition. Furthermore, our results shed new light on the phenomenon of gaze cascades during choice. We discuss the implications for Web design, online retailing, and new directions for research on online choice. This paper was accepted by Pradeep Chintagunta, marketing.

The medial prefrontal cortex is critical for memory retrieval and resolving interference.

The prefrontal cortex (PFC) is known to be critically involved in strategy switching, attentional set shifting, and inhibition of prepotent responses. A central feature of this kind of behavioral flexibility is the ability to resolve conflicting response tendencies, suggesting a general role of the PFC in resolving interference. If so, the PFC should also be involved in memory retrieval, which involves competition between potential retrieval targets. Moreover, the PFC should be needed whenever interference is high, regardless of the strategic or attentional requirements of the task. To test this hypothesis, we temporarily inactivated the mPFC with muscimol and tested rats on several olfactory learning tasks. Rats given muscimol were able to learn a few discrimination problems when they were learned one at a time. However, they were severely impaired when they had to learn and remember many odors concurrently. Rats given muscimol also suffered greater interference when learning two lists of conflicting odor discrimination problems. Additionally, temporary mPFC inactivation during the acquisition of one set of odor memories actually improved the ability to learn a new set of conflicting odor memories. This paradoxical release from interference suggests that the mPFC plays an important role in acquiring and promoting the long term retrieval of memories. These results suggest that the mPFC plays a general role in resolving interference and that this is a key aspect of behavioral flexibility.