Job File Research Articles

Olmsted’s pencil sharpener

The documentary history of Olmsted, Jr’s search for a patent (number 1,070,284) unfolds in Job File 2919 of the Olmsted Associates records, housed at the Library of Congress and accessible digitall...

Lightweight job submission and file sharing schemes for a teaching ecosystem for parallel computing courses

Parallel computing has been widely used in various industries. Many colleges and universities have launched courses on parallel computing and can build teaching ecosystems to serve these courses. Job submission and file sharing are two essential functionalities. This paper builds a teaching ecosystem for parallel computing courses and proposes lightweight job submission and file sharing schemes for the ecosystem. The job submission scheme supports Pthread, OpenMP, and MPI (message passing interface) jobs. It has five working modes: demonstration, experiment, examination, research, and maintenance. In particular, the examination mode can be applied for online examinations. For the fair use of resources, the job submission scheme not only limits the submission times of each student and the run time of each job but also designs a fair job scheduling algorithm. The ecosystem adopts Samba to supply file sharing services. To ensure the safety of the shared files, this paper proposes a lightweight attribute-based access control mechanism. This mechanism uses Python logical expressions to describe access rules; thus, it is not only easy to use but also able to describe complicated rules. In addition, the ecosystem has a well-structured module design that facilitates functionality expansion and modification. Experiments verify the feasibility and validity of the ecosystem.

Development of a Robotic Structural Steel Cutting System

Curved buildings and structures are getting popular and digital fabrication of the structural steels has been successfully tried in several ways. This study presents a development of a robotic system cutting structural steels and marking texts on the steels using digital information of shapes. A configuration of the overall system is explained based on functional decomposition of conventional cutting systems. The cutting system consists of a robotic system and a handling system, and the main functions of the cutting system are classified as translation, orientation, alignment, and cutting. A digital model of the system was created and tested in a robot simulation system. A robot tool-path generation system was also developed. The tool-path generation system uses the DSTV file, an industry standard for the shape of a structural steel, to generate robot job files. This study also provides robot workspaces in which the cutting tool can safely access and cut the workpieces. The proposed system was tested for cutting structural steels clamped in front of the robot. The results show that the generated tool-paths are valid in cutting the structural steel and the possibility of an overall robotic system for cutting structural steels.

Work-related injury factors and safety climate perception in truck drivers.

The trucking industry has a high burden of work-related injuries. This study examined factors, such as safety climate perceptions, that may impact injury risk. A random sample of 9800 commercial driver's license holders (CDL) were sent surveys, only 4360 were eligible truck drivers. Descriptive statistics and logistic regression models were developed to describe the population and identify variables associated with work-related injury. 2189 drivers completed the pertinent interview questions. Driving less-than-truckload, daytime sleepiness, pressure to work faster, and having a poor composite score for safety perceptions were all associated with increased likelihood of work-related injury. Positive safety perception score was protective for odds of work-related injury, and increased claim filing when injured. Positive psychological safety climate is associated with decreased likelihood of work-related injury and increased likelihood that a driver injured on the job files a workers' compensation claim.

Using the Launcher for Executing High Throughput Workloads

For many scientific disciplines, the transition to using advanced cyberinfrastructure comes not out of a desire to use the most advanced or most powerful resources available, but because their current operational model is no longer sufficient to meet their computational needs. Many researchers begin their computations on their desktop or local workstation, only to discover that the time required to simulate their problem, analyze their instrument data, or score the multitude of entities that they want to would require far more time than they have available. Launcher is a simple utility which enables the execution of high throughput computing workloads on managed HPC systems quickly and with as little effort as possible on the part of the user. Basic usage of the Launcher is straightforward, but Launcher provides several more advanced capabilities including use of Intel® Xeon Phi™ coprocessor cards and task binding support for multi-/many-core architectures. We step through the processes of setting up a basic Launcher job, including creating a job file, setting appropriate environment variables, and using scheduler integration. We also describe how to enable use of the Intel® Xeon Phi™ coprocessor cards, take advantage of Launcher's task binding system, and execute many parallel (OpenMP/MPI) applications at once.

Considerations on the construction of a Powder Bed Fusion platform for Additive Manufacturing

As the demand for moulds and other tools becomes increasingly specific and complex, an additive manufacturing approach to production is making its way to the industry through laser based consolidation of metal powder particles by a method known as powder bed fusion. This paper concerns a variety of design choices facilitating the development of an experimental powder bed fusion machine tool, capable of manufacturing metal parts with strength matching that of conventional manufactured parts and a complexity surpassing that of subtractive processes. To understand the different mechanisms acting within such an experimental machine tool, a fully open and customizable rig is constructed. Emphasizing modularity in the rig, allows alternation of lasers, scanner systems, optical elements, powder deposition, layer height, temperature, atmosphere, and powder type. Through a custom-made software platform, control of the process is achieved, which extends into a graphical user interface, easing adjustment of process parameters and the job file generation.

3D Printing Job Editor for Workflow Visualization Design and Implementation

This paper presents design and development of a viewing and editing tool, namely 3DPJ Editor, for Workflow visualization of 3D Print Job files. 3D Print Job (3DPJ) is an XML based format for 3D Printing job purposed to enable automation and integration of multiple vendor systems in a 3D Printing manufacture environment. The paper also shows preliminary 3DPJ format for further development of 3D Printing manufacture community with multiple vendors. The 3DPJ Format tries to separate content information and meta-data of 3D Print Jobs, in order to integrate different processes into one standard 3D Printing Workflow. The complete specification of 3DPJ should be further complex and comprehensive, and it should be gradually adopted by major 3D Printer vendors.

Common platform of Monte Carlo dose calculation on universal grid interface with Geant4 based particle therapy simulation framework

While Monte Carlo (MC) simulation is believed to be the most reliable method of dose calculation in particle therapy, the simulation time is critical in attaining sufficient statistical accuracy for clinical applications. Therefore, parallelization of simulations is essential. This paper describes a common platform of MC dose calculation in grid-distributed computing environments. The platform is flexible and effective for dose calculation in both clinical and research applications for particle therapy. The platform consists of the universal grid interface (UGI) and the Geant4-based particle therapy simulation framework (PTSIM). The UGI, written in Python, provides a command-line interface for job submission, file manipulation, and monitoring in multiple-grid middleware environments. The PTSIM is a single software application for modeling a treatment port with patient data obtained from CT images. The common platform was constructed in grid computing environments using the computing resources in five institutions. The platform utilized these resources through the NAREGI grid middleware under UGI to provide stable computing resources and a common environment for MC dose calculation in particle therapy.

A Parallel Task scheduling Algorithm Based on Fuzzy Clustering in Cloud Computing Environment

Parallel task scheduling is one of the core problems in the field of cloud computing research area, which mainly researches parallel scheduling problems in cloud computing environment by referring to the high performance computing required by massive oil seismic exploration data processing. Because of the natural reparability of Seismic data, it should maximize the use of computing resources to put the job file to the resource nodes, which can just meet the task computing requirements. This paper proposes scheduling optimization strategy of task and resource hybrid clustering based on fuzzy clustering, conducts the the clustering partition solution of concurrent job according to matching degree of task and resource nodes and narrows task scheduling scale and, narrows task scheduling scale and at the same time lays the foundation for dynamic acheduling tasks. After the division is completed, improved Bayesian classification algorithm is introduced to fast match tasks and computer according to real- time load and queue operations. In the end, verified by experiments, this scheme has higher efficiency.

Offline Programming for an Arc Welding Robot with Redundant DOF

To raise the programming efficiency of arc welding robots, the offline programming system was developed for a Motoman-UP20 robot with redundant degrees of freedom in VC++ integration environment. The system consists of kinematics analysis, motion simulation, welding trajectory plan, welding parameters plan and job file generating module. It can plan the motion path and posture of welding gun for saddle-shape seams, and display the workpiece on the interface synchronically. Job instructions can be made step by step, or generated automatically. Kinematics simulation module and communication module are integrated together, and job files can be exchanged between PC and robot controller via Ethernet to realize remote control.

Development and field testing of a data acquisition system to assess the quality of spraying in fruit orchards

A system for managing and monitoring agricultural operations at farm level, was developed and tested in an agrochemical application. The system is an integration of an electronics box mounted on the tractor, and a software that acquires and analyzes data from the application task. The electronics box holds a microcontroller, a Global Positioning System (GPS), complementary sensors, a keyboard, a memory SD (Secure Disk) storage, and a Liquid Cristal Display (LCD). The device is able to store in the SD memory, the data of the position, the instantaneous speed of the tractor, the applied rate, the wind speed, the wind direction, the temperature, and the relative humidity. In addition, the system can alert of unfavorable weather conditions for the application of agro-chemicals. The interface to the user is a software that allows generating a job file, which identifies the operator name, the tractor, the spraying equipment, the pesticide, the rate, and the sector of application. The software also provides output data in graphical form, generating maps of speed, applied volume, and rate. The map of the route is also drawn on Google Earth, for a better spatial visualization. The acquired data is used to verify if the weather conditions, apt for the application of pesticide, were fulfilled, along with checking the variability of the rate, occurrence of row skipping, and indices of performance of the operator. The system was tested in two vineyards of Chile with promissory results.

A Development of Lightweight Grid Interface

In order to help a rapid development of Grid/Cloud aware applications, we have developed API to abstract the distributed computing infrastructures based on SAGA (A Simple API for Grid Applications). SAGA, which is standardized in the OGF (Open Grid Forum), defines API specifications to access distributed computing infrastructures, such as Grid, Cloud and local computing resources. The Universal Grid API (UGAPI), which is a set of command line interfaces (CLI) and APIs, aims to offer simpler API to combine several SAGA interfaces with richer functionalities. These CLIs of the UGAPI offer typical functionalities required by end users for job management and file access to the different distributed computing infrastructures as well as local computing resources. We have also built a web interface for the particle therapy simulation and demonstrated the large scale calculation using the different infrastructures at the same time. In this paper, we would like to present how the web interface based on UGAPI and SAGA achieve more efficient utilization of computing resources over the different infrastructures with technical details and practical experiences.

Fault-Tolerant Mechanism of Both Job Execution and File Transfer for Integrated Nuclear Energy Simulation

The integration of several codes to simulate physical processes or components of a nuclear energy facility facilitates large-scale, detailed simulation. However, integrated simulations require several weeks or months of CPU time. We developed a fault-tolerant method for cooperative execution of codes, which avoids unscheduled outage of computers or networks. The method deals with abnormal job terminations on supercomputers and file transfer errors. If a computer causes an unexpected outage, the method attempts to submit the simulation task to an alternative computer. The method also detects transfer errors by comparing the size of files before and after transfer. The relationship between jobs and file transfers is connected by the fault-tolerant method, which allows us to decide the execution order of codes by definition of file flow. This enables the operation on integrated simulations where codes are executed sequentially or concurrently.

Dataflow detection and applications to workflow scheduling

AbstractIn high‐performance computing (HPC)textitworkloads (i.e. the set of computations to be completed), the same computational workflow of jobs (e.g. a Pipeline, a Fork&Join, or a Lattice graph) may be applied to different input files and parameters. Each of these workflow instances has the same workflow shape, but accesses (possibly) separate input, intermediate, and output files. Therefore, the selective isolation of each workflow instance can be important for maximizing scheduling flexibility and performance. However, in practice, realizing this benefit is not obvious due to a variety of problems and constraints. For example, the unmediated interaction of different workflow instances can lead to a problem of filename conflicts between concurrent workflow instances overwriting common files, which, for a control‐flow driven batch scheduler, may result in either unsafe computation of the multiple instances in the same sub‐directory or storage overheads when multiple directories are used. We propose a novel approach of selectively coupling and integrating job schedulers and file systems, known as a Workflow‐aware File System (WaFS), with two major benefits. First, separate namespaces can be constructed on a per‐instance basis to maximize the concurrency of workflow instances, despite filename conflicts, while minimizing storage overhead. Second, exploiting inferred dataflow information, trade‐offs can be made between makespan and storage overhead while maintaining correctness. Through a simulation‐based study, we have shown the potential benefits of WaFS to job concurrency and we have characterized the trade‐offs that can be made between storage overhead and performance. New scheduling policies, Versioned Namespace (VNS), Overwrite‐Safe Concurrency (OSC) and hybrids, are made possible by WaFS, with different advantages and disadvantages. Copyright © 2011 John Wiley & Sons, Ltd.

The ‘art which conceals’: a cottage industry and the invention of Cushing's Island

The ‘art which conceals’: a cottage industry and the invention of Cushing's Island

Experience with ATLAS MySQL PanDA database service

The PanDA distributed production and analysis system has been in production use for ATLAS data processing and analysis since late 2005 in the US, and globally throughout ATLAS since early 2008. Its core architecture is based on a set of stateless web services served by Apache and backed by a suite of MySQL databases that are the repository for all PanDA information: active and archival job queues, dataset and file catalogs, site configuration information, monitoring information, system control parameters, and so on. This database system is one of the most critical components of PanDA, and has successfully delivered the functional and scaling performance required by PanDA, currently operating at a scale of half a million jobs per week, with much growth still to come. In this paper we describe the design and implementation of the PanDA database system, its architecture of MySQL servers deployed at BNL and CERN, backup strategy and monitoring tools. The system has been developed, thoroughly tested, and brought to production to provide highly reliable, scalable, flexible and available database services for ATLAS Monte Carlo production, reconstruction and physics analysis.

Cognitive Costs of Exposure to Racial Prejudice

This study examined how encountering racial prejudice affects cognitive functioning. We assessed performance on the Stroop task after subjects reviewed job files that suggested an evaluator had made nonprejudiced, ambiguously prejudiced, or blatantly prejudiced hiring recommendations. The cognitive impact of exposure to ambiguous versus blatant cues to prejudice depended on subjects' racial group. Black subjects experienced the greatest impairment when they saw ambiguous evidence of prejudice, whereas White subjects experienced the greatest impairment when they saw blatant evidence of prejudice. Given the often ambiguous nature of contemporary expressions of prejudice, these results have important implications for the performance of ethnic minorities across many domains.

Grid user requirements—2004: a perspective from the trenches

Pervasive Grid adoption is predicated on the availability of widely deployed usable software and a user community willing to use it. Currently, widespread adoption of Grids, even within technically sophisticated communities, is limited, and determining and eliminating these barriers to adoption are essential in order for Grids to becoming widely capitalized. Through a series of face-to-face interviews conducted during the summer of 2004, we have identified issues relating to job submission, file transfer, usability, and systems management that must be resolved in order to improve the usability of Grid infrastructures. The background to these issues and some possible solutions are described in this paper.

Simulation of coastal groundwater remediation: the case of Nardò fractured aquifer in Southern Italy

A new theoretical approach for evaluating the sharp interface position in a fractured aquifer was applied to the Nardò aquifer (Southern Italy). The results, based on Dupuit and Ghyben–Herzberg approximations, clearly show both the extent of seawater intrusion and how the latter can be reduced by means of artificial recharge. The new methodology describes a simplified mathematical formulation based on the sharp freshwater–saline interface in a fractured aquifer, rather than solving complicated density dependent partial differential equations of flow and solute transport in porous media. Application of the method requires, in a preliminary stage a knowledge of the freshwater flow rates in the fractured media. This can be derived by means of specific computational codes, under steady conditions. In the second stage, the extent of seawater intrusion can be evaluated in vertical planes of a three-dimensional domain. The methodology was applied to the Nardò fractured rock aquifer in order to estimate the extent to which seawater had intruded into it. The procedure was easily implemented in a job file of EXCEL Microsoft Office and performed well. Results indicated a good correlation between the coastal spring zones of the model with Landsat Thematic Mapper sensor photos and field investigation.

The Gateway computational Web portal

AbstractIn this paper we describe the basic services and architecture of Gateway, a commodity‐based Web portal that provides secure remote access to unclassified Department of Defense computational resources. The portal consists of a dynamically generated, browser‐based user interface supplemented by client applications and a distributed middle tier, WebFlow. WebFlow provides a coarse‐grained approach to accessing both stand‐alone and Grid‐enabled back‐end computing resources. We describe in detail the implementation of basic portal features such as job submission, file transfer, and job monitoring and discuss how the portal addresses security requirements of the deployment centers. Finally, we outline future plans, including integration of Gateway with Department of Defense testbed Grids. Copyright © 2002 John Wiley & Sons, Ltd.