Batch Loads Research Articles

Data Integrity Problems in High-Volume High-Velocity Data Ingestion

In the era of bigdata, and never ending data push from IoT devices, the IT infrastructure are built to be scalable to handle the huge batch loads or continuous streaming live data. However, the big question is how can be establish the data integrity. How can we make sure no data is lost from Origin till the destination passing through numerous touch points enroute ? How can we ensure the quality with continuous inflow ? Should the inflow be suspended to perform the DQ checks? Or should it be a totally independent parallel activity. Let’s explore. Key words: Quality Data Management, Data Pipelines, AutoScalling, Large Scale Streaming Data, Performance, IoT, Data Cleansing

Managing Electronic Resource Collections and Batch Loads at The University of Akron

The University of Akron University Libraries has developed a workflow and set of documentation to streamline the batch loading of MARC records for electronic resources. This paper outlines the challenges posed by retrieving and loading from various sources, applying different customizations to different sets of records, and maintaining statistics. Developing workflows and maintaining documentation were essential to ensure that loads were run efficiently and consistently, and that new problems could be adequately addressed as they arose.

Effect of loading rate and source of energy on the drying parameters of the basil during drying

The basil leaves were dried different sources of energy at different loading rates. Using hybrid solar drying compared to the conventional source of energy such as fossil and propane. Drying parameters were studied. Also, product quality was assessed under study treatments. The results indicated that the higher accumulated weight loss of basil leaves (75.56%) were obtained at 25 kg m−2 loading rate and solar drying system. The highest rate of the decrease in moisture content of basil leaves was happened at the 45 kg m−2 loading rates. Meanwhile, the lowest rate of the decrease in moisture content of basil leaves was found at 15 kg m−2 loading rates. The highest drying rate of basil leaves (219.54 gwater kg−1 h−1) was obtained at the loading rate of 15 kg m−2. The highest values of total chlorophyll and color of basil leaves 745.9 and 36.35 were found for solar dryer. The lowest values of total chlorophyll and color of basil leaves 703.5 and 31.66 were found for diesel dryer. The drying efficiency ranged from 33.98 to 40.33% for all batch loads. The highest essential oil yield obtained for solar dryer, the lowest essential oil yield occurred for diesel dryer. The highest value of volatile compounds with found for solar dryer. The total costs for basil drying were 19.73, 26.70 and 23.93 LE h−1 for solar, diesel and propane dryers, respectively. Also, the total costs of basil drying were 8.77, 13.15 and 12.27 LE kg−1 dried for solar, diesel and propane dryers, respectively.

Experimental study on the operating characteristics of a display refrigerator phasing out R134a to R1234yf

• The recommended refrigerant charge is the same for the three refrigerants. • R513A reduces the total electric energy input per hour of operation in 3.9% for 32°C. • Isobaric assumption in the evaporator under-predicts the cooling duty up to 18.7%. • The experimental EER does not give a clear guide to the refrigerant charge. In this study, an experimental determination of the refrigerant charge and the operating conditions in a vertical display refrigerator using R134a, R513A, and R1234yf is presented. The three refrigerants' energy inputs under ambient temperatures of 24, 32, and 40°C are compared. The refrigerator is instrumented with a mass flow meter, thermocouples, and pressure transducers. The evaluations are carried out inside a room with controlled temperature and air recirculation. For each analysis, the refrigerator is operated for a period long enough until differences among operation on/off cycles are negligible. Batch loads of 15 g are used for determining an adequate refrigerant charge. The results show a recommended charge of 175g for the three refrigerants and the range of temperatures. The electric energy consumption increase on average 20 kJ per hour of operation for every degree the ambient temperature increases. Compared with R134a, the R513A results in lower energy input in 3.8, 3.9, and 0.3% for 24 and 32 and 40°C, respectively. The experimental determination of EER values does not give accurate guidance for the adequate refrigerant charge. The assumption of isobaric heat exchange results in a maximum deviation of the actual cooling duty of 13, 18.7, and 16.6% for R134a, R1234yf, and R513A, respectively.

Study on optimization of mechanical peeling for sweet potato

The aim of this research work was to optimize the machine parameters of a commercially available tuber peeler for peeling of sweet potato to get maximum yield with minimum loss. The process was proposed for different parameters such as peeling efficiency, material loss and peeling effectiveness at different speeds of rotating disc (300, 400 and 500 rev/min or 5.4, 7.2 and 9 m/s), peeling durations (20, 40 and 60 s) and batch loads of 1 and 2 kg. The study revealed that the peeling parameters were greatly influenced by the speed of rotating disc, peeling duration and batch loads. The optimal conditions for peeling sweet potato were a peeling duration of 40 s and speed of rotating disc of 500 rev/min 2 kg batch loads. The corresponding peeling efficiency, peeling effectiveness and material loss were 83.8±2.0%, 74.2±1.3% and 11.45±0.71%, respectively. Further, the study showed that a batch load of 2 kg was suitable for commercial processing of sweet potato than 1 kg because of the better performance indices of peeling.

Integrating a tidal flow wetland with sweet sorghum for the treatment of swine wastewater and biomass production

Swine wastewater treatment and reuse has become a large challenge due to the growth of confined farms in China. Current treatment approaches either fail to control and quantify pollution in soil and water, such as in land applications, or lack productivity, such as in constructed wetlands. To explore the possibility of simultaneous treatment and reuse of wastewater to yield biomass and energy, we integrated sweet sorghum [Sorghum bicolor (L.) Moench] in pilot scale tidal flow wetlands to examine the effects of retention/interval frequency, batch loading rate, and influent concentration on nutrients removal, biomass production and energy yield. The results showed that a total of 80L/m2 per load and 2days of retention with 1day of draining was the maxim load to achieve an optimal biomass production of 10.50kg/m2 and a NH4+-N removal of 95.43±4.54%. Various retention/interval patterns and batch loads at the same hydraulic loading rate showed a spectrum of removal effects and biomass yields. Sweet sorghum grew well around an influent NH4+-N concentration of 110mg/L. A heavy batch load of 120L/m2, even with a low hydraulic loading rate, decreased biomass production and the removal rate. Higher heating value was not affected by different wastewater application scenarios. Adding wetland cells to the series was not suggested because they enhanced total nitrogen and NH4+-N removal, but not phosphorus and COD removal, and produced a lower total biomass with twice land requirement. A rapid growth period of approximately 35days with top removal at the boot stage was proposed to achieve increased removal rate and higher biomass yield. The uptake of nitrogen by sweet sorghum greatly increased under a luxurious nitrogen supply. Change of nitrogen content and phosphorus content in soil was not predicted by loading rate.

Self-balancing robust scheduling with flexible batch loads for energy intensive corporate microgrid

With the development of microgrid technology, for an energy intensive corporate such as an iron and steel plant energy consumptions and costs can be saved significantly by achieving the balance between self-generation and consumption. In this paper, we present a self-balancing and robust scheduling model with flexible batch loads for an energy intensive corporate. The model is a multi-level optimization model with the objective to minimize the unbalance cost in the worst case. Load following properties are given to determine whether the uncertain loads can be followed or not, and the self-balancing capability of an energy intensive corporate is analyzed. The problem is equivalently converted from the multi-level model to a single-level optimization model with a set of constraints. In this way, the iteration between the outer and inner level can be avoided. Case study based on an energy intensive corporate microgrid is tested and the results show that the unbalance cost can be significantly reduced by using the robust self-balancing model. In addition, compared the approach method with iterative solving method, computational efficiency can be improved and local optimum can be avoided.

DEVELOPMENT AND EVALUATION OF AN ONION PEELING MACHINE

An onion peeling machine was designed, manufactured, developed and evaluated to suit the small and medium processing units. The onion peeling machine consists of seven parts, main frame, peeling drum, inlet and outlet openings, collection basin, water and air supplying systems, and power transmission. The machine was evaluated using different onion bulb sizes (small, medium & large). A mixed sample of different sizes was also tested. The evaluation process was conducted under three different drum rotational speeds (30, 40 and 50 rpm), three different peeling residence times (1, 2 and 3mins) and three different batch loads (18, 24 and 30kg). The optimum peeling efficiency of 74.9, 65.24, 80.08 and 85.45% were obtained at 24kg batch load (0.36 ton/h.), 2min peeling residence time and 40 rpm for small, medium, mixed and large sizes respectively.Water pump and air compressor were added to the peeler to improve the peeling efficiency, and it was tested under the previous conditions. The corresponding values of peeling efficiency for the machine with pump water at water pressure of 400kPa were 76.73, 83.06, 99.20 and 87.49 %, respectively. While they were 76.33, 72.87, 87.530 and 88.37%, respectively for air pumping at pressure of 500kPa. The estimated costs of onions peeling machine were 28.47, 29.56 and33.75 L.E/ton for the machine only, machine with water pump and machine with air compressor respectively. These values of estimated costs using the developed machine are very competitive with the cost of manual peeling process which approached about 75 L.E/ton.

Batch Loading Collections into DSpace: Using Perl Scripts for Automation and Quality Control

This paper describes batch loading workflows developed for the Knowledge Bank, The Ohio State University’s institutional repository. In the five years since the inception of the repository approximately 80 percent of the items added to the Knowledge Bank, a DSpace repository, have been batch loaded. Most of the batch loads utilized Perl scripts to automate the process of importing metadata and content files. Custom Perl scripts were used to migrate data from spreadsheets or comma-separated values files into the DSpace archive directory format, to build collections and tables of contents, and to provide data quality control. Two projects are described to illustrate the process and workflows.

Enhancing performance in anaerobic high-solids stratified bed digesters by straw bed implementation

Anaerobic high-solids single-stage stratified bed digesters have been found to be simple and flexible design candidates for small-scale reactors located in medium- to low-technology environments. In the present study, wheat straw was used as the starter material for the stratified bed. Upon green mass feeding, the anaerobically stabilised straw bed functioned both as a biofilm support and as a particulate filter. It enabled a direct onset of 7 kg VS m −3 batch loads, added twice a week, and permitted a low but consistent bed permeability during feeding at an average superficial flow velocity of 1 m d −1 to be achieved. Fed-batch tests with sugar beet tops in pilot- and laboratory-scale setups at an average loading rate of 2 kg VS m −3 d −1 resulted in average biogas production rates of 1.2–1.4 m 3 m −3 d −1 and methane yields of 0.31–0.36 m 3 kg −1 VS added. At the end of the laboratory-scale feeding trial, the 200 day old straw bed had compacted to 50% of its initial volume, without any negative effects on performance being detectable.

Volatile fatty acid production during anaerobic mesophilic digestion of solid potato waste

AbstractThe production of volatile fatty acids by anaerobic digestion of solid potato waste was investigated using a batch solid waste reactor with a working capacity of 2 dm−3 at 37°C. Solid potato waste was packed into the digester and the organic content of the waste was released by microbial activity by circulating water over the bed, using batch loads of 500 g or 1000 g potato waste. The sequence of appearance of the volatile fatty acids was (acetic, propionic); (n‐butyric); (n‐valeric, iso‐valeric, caproic); (iso‐butyric). After 300 h digestion of potato waste on a small scale, the fermentation products were chiefly (mg g−1 total VFAs): acetic acid (420), butyric acid (310), propionic acid (140) and caproic acid (90), with insignificant amounts of iso‐butyric acid, n‐valeric and iso‐valeric acids. When the load of potato solids was increased, the volatile fatty acid content was similar, but butyric acid constituted 110 mg g−1 and lactic acid 400 mg g−1 of the total volatile fatty acids. The maximum soluble chemical oxygen demand (COD) achieved under the experimental conditions used was 27 and 37 g COD dm−3 at low and high loadings of potato solids, respectively. The total volatile fatty acids reached 19 g dm−3 of leachate at both loads of potato solid waste. Gas production was negligible, indicating that methanogenic activity was effectively inhibited. Copyright © 2004 Society of Chemical Industry

Performance of subsurface flow wetlands with batch‐load and continuous‐flow conditions

Use of constructed wetlands designed for wastewater treatment is becoming common throughout the world. Oxidation of carbon (C) and nitrogen (N) may be increased by transport of oxygen (O2) into the rhizosphere of aquatic plants and periodic draining of the wetland. Outdoor microcosms of subsurface flow wetlands (SFs) were operated receiving continuous flow or batch loads of primary and secondary wastewater. Six‐square meter microcosms planted with Scirpus pungens, received primary or secondary wastewater in batch load or continuous flow. Plants in SFs had significant effects on C and N oxidation, whereas, periodic draining of SFs had no significant effect. Greater than 90% carbonaceous biochemical oxygen demand (CBOD) was removed within 18 hours in SFs with and without plants, after 6 and 12 hours plants had caused significant decreases in CBOD in the batch‐load SFs. The first‐order model for CBOD removal was not appropriate after 24 hours; removal rate coefficients were similar for batch‐load and continuous‐flow SFs with hydraulic retention times of 12 and 24 hours. Methanogenesis is the major respiratory pathway for CBOD removal. Oxygen transport in SFs estimated from C oxidation was 28.6 and 2.4 g/m2·d estimated from N oxidation.

Benchmarked comparison of terminal support systems for IBM 360 computers

A set of terminal scripts and benchmarks were derived for comparing the performance of time sharing and batch computer operating systems. Some of the problems encountered in designing valid benchmarks for comparing computer operating systems under both terminal and batch loads are discussed.The results of comparing TSS/360, CP/67 and MTS time sharing systems for the IBM 360/67 over a wide range of load conditions are presented. The results of comparing TSS, MTS and OS/MVT under batch loads are also presented. The tests were conducted with Simplex and Dual processor configurations with 256K bytes to 768K bytes of main memory.The conclusions were quite surprizing in that CP/67 running on a minimal system performed competitively with TSS/360 on a much larger dual processor system. With equal configurations CP/67 out performed TSS/360 by a wide margin. Furthermore, MTS providing both batch and terminal support produced performance that was 5 percent to 25 percent better than the split configuration with CP/67 providing the terminal support and OS/MVT providing the batch processing support.Serious performance degradation of the time sharing computer systems from overloading was experienced and a simple solution is suggested to prevent such degradation. The degradation was so severe as to render the performance less than that of a sequential job processor system.