Event Abstract Back to Event Practically trivial parallel data processing gives neuroscience laboratories easy access to advanced analysis methods Michael Denker1*, Bernd Wiebelt2, Denny Fliegner3, Markus Diesmann1 and Abigail Morrison2 1 RIKEN Brain Science Institute, Japan 2 Bernstein Center for Computational Neuroscience, Germany 3 Max Planck Institute for Dynamics and Self-Organization , Germany In addition to the increasing amounts of data gushing out from neuroscientific experiments, the complexity of modern data analysis techniques places new demands on the computing infrastructure required for data processing. In particular, the observation that neuronal data typically exhibit non-stationary statistics complicates the task of finding the correct null-hypothesis to assess the significance of a variety of test parameters. Modern computer resources enable a data-based approach to tackle significance estimation: surrogate techniques. In this framework the original data is modified in a specific way so as to keep some aspects of the data (e.g., the non-stationary nature of the data), while deliberately destroying others (i.e., those described by the test parameter). Repeating this procedure many times estimates the distribution of the test parameter under the null hypothesis. However, the required resources exceed the speed and memory constraints of a classical serial program design and require scientists to parallelize their analysis processes on distributed computer systems. Here, we explore step-by-step how to transform on-the-fly a typical data analysis program into a parallelized application. This approach is facilitated by the observation that a typical task in neuronal data analysis constitutes an embarrassingly parallel problem: the analysis can be divided up into independent parts that can be computed in parallel without communication. In particular for surrogate-based analysis programs, finding the decomposition of the analysis program into independent components is often trivial due to the inherent repetition of analysis steps. On the conceptual level, we demonstrate how in general to identify those parts of a serial program best suited for parallel execution. On the level of the practical implementation, we introduce four methods that assist in managing and distributing the parallelized code. By combining readily available high-level scientific programming languages and techniques for job control with metaprogramming no knowledge of system-level parallelization and the hardware architecture is required. We describe the solutions in a general fashion to facilitate the transfer of insights to the specific software and operating system environment of a particular laboratory. The details of our technique accompanied by concrete examples form a chapter of the new book “Analysis of parallel spike trains” edited by Sonja Grün and Stefan Rotter and published at Springer 2010. Conference: Neuroinformatics 2010 , Kobe, Japan, 30 Aug - 1 Sep, 2010. Presentation Type: Poster Presentation Topic: Electrophysiology Citation: Denker M, Wiebelt B, Fliegner D, Diesmann M and Morrison A (2010). Practically trivial parallel data processing gives neuroscience laboratories easy access to advanced analysis methods. Front. Neurosci. Conference Abstract: Neuroinformatics 2010 . doi: 10.3389/conf.fnins.2010.13.00110 Copyright: The abstracts in this collection have not been subject to any Frontiers peer review or checks, and are not endorsed by Frontiers. They are made available through the Frontiers publishing platform as a service to conference organizers and presenters. The copyright in the individual abstracts is owned by the author of each abstract or his/her employer unless otherwise stated. Each abstract, as well as the collection of abstracts, are published under a Creative Commons CC-BY 4.0 (attribution) licence (https://creativecommons.org/licenses/by/4.0/) and may thus be reproduced, translated, adapted and be the subject of derivative works provided the authors and Frontiers are attributed. For Frontiers’ terms and conditions please see https://www.frontiersin.org/legal/terms-and-conditions. Received: 15 Jun 2010; Published Online: 15 Jun 2010. * Correspondence: Michael Denker, RIKEN Brain Science Institute, Wako, Japan, mdenker@brain.riken.jp Login Required This action requires you to be registered with Frontiers and logged in. To register or login click here. Abstract Info Abstract The Authors in Frontiers Michael Denker Bernd Wiebelt Denny Fliegner Markus Diesmann Abigail Morrison Google Michael Denker Bernd Wiebelt Denny Fliegner Markus Diesmann Abigail Morrison Google Scholar Michael Denker Bernd Wiebelt Denny Fliegner Markus Diesmann Abigail Morrison PubMed Michael Denker Bernd Wiebelt Denny Fliegner Markus Diesmann Abigail Morrison Related Article in Frontiers Google Scholar PubMed Abstract Close Back to top Javascript is disabled. Please enable Javascript in your browser settings in order to see all the content on this page.
Read full abstract