Abstract

Numerous IoT devices in IoT systems collect data concurrently, which brings great challenges to IoT time series databases to store and manage these data. NVM device has high read–write speed compared with HDD and Flash-based SSD, and it is a possible way to solve the storage bottleneck. However, there are some limitations that should be solved such as the overhead of the I/O software stack for NVM devices and the lack of optimization for IoT time series databases in a Linux environment. By analyzing the characteristics of IoT time series databases and NVM devices, we optimized the device driver of NVM in Linux and provide a new structure of a NVM device driver for IoT time series databases. A multi-queue management strategy and a lightweight load balance mechanism based on frequency were designed to improve the concurrency and efficiency of NVM device drivers. The prototype of an IoT-oriented NVM device driver named TS-PMEM was implemented based on an open-source NVM device driver. Six prototypes were used for evaluation with YCSB-TS, a test tool for time series databases. Results showed that TS-PMEM can improve write throughput of the time series databases by 18.6%, query throughput by 10.6%, and reduce the write latency by 8.3% and query latency by 6.4%.

Highlights

  • Introduction for IoT Time Series DatabaseThere are many IoT devices in IoT systems, and they currently collect a large amount of time series data

  • There are a large number of different types of IoT devices in IoT systems, and their write frequencies to the IoT time series database are different

  • When the number of IoT time series data sources increased from 1 to 6, their random throughput decreased by only 4.4%, 17.6%, and 11.6%, respectively. These results indicate that TS-PMEM has a better ability to adapt to concurrent queries in IoT time series database and higher query throughput than PMEM

Read more

Summary

NVM Simulator and Driver

That can accurately simulate the I/O speed of a Flash-based SSD based on the SATA interface and high bandwidth protocols. Compared with the existing Flash-based SSD simulators, it can be integrated into the publicly-available computer system simulators and evaluate the performance with a variety of storage technologies and microstructures. CPS-SIM provides a flexible environment for Flash-based SSD firmware It can drive multiple flash memory chips and arrange data transmission through multiple buses. Compared with the existing NVM device simulators, NVMain 2.0 has many new features such as the fine-grained management model and the MLC support. It has a convincing simulation for the read–write speed of NVM, and could support sub-array-level parallelism and fine-grained refresh. There is no corresponding optimization strategy for IoT time series databases

NVM Database
Time Series Database
NVM Device Driver Structure for IoT Time Series Databases
Multi-Queue
Lightweight Load Balance Mechanism Based on Frequency
Prototype and Test
Write Throughput
Average
Query Throughput
10. Average
Conclusions and and Future
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call