(SCI) Fast Algorithm of Truncated BWT for Data Compression of Sensors
[ 2018-07-14 10:21:50 ]
关键词：sensors data compression， truncated Burrows-Wheeler Transform， big&
Qin Jiancheng, Lu Yiqin, Zhong Yu. Fast Algorithm of Truncated Burrows-Wheeler Transform Coding for Data Compression of Sensors[J]. Journal of Sensors, 2018, Article ID 6908760: 17 pages. (SCI:000431225800001)
Original Article: https://doi.org/10.1155/2018/6908760
Software Download (New URL): http://www.28x28.com:81/doc/cz_bwt.html
Abstract:
Lots of sensors in IoT (Internet of Things) may generate massive data, which will challenge the limited sensor storage and network bandwidth. So the study of big data compression is very useful in the field of sensors. In practice, BWT (Burrows-Wheeler Transform) can gain good compression results for some kinds of data, but the traditional BWT algorithms are neither concise nor fast enough for the hardware of sensors, which will limit the BWT block size in a very small and incompetent scale. To solve this problem, this paper presents a fast algorithm of truncated BWT named “CZ-BWT algorithm”, and implements it in the shareware named “ComZip”. CZ-BWT supports the BWT block up to 2 GB (or larger) and uses the bucket sort. It is very fast with the time complexity O(N) and fits the big data compression. The experiment results indicate that ComZip with CZ-BWT filter is obviously faster than bzip2, and it can obtain better compression ratio than bzip2 and p7zip in some conditions. In addition, CZ-BWT is more concise than current BWT with SA (Suffix Array) sorts and fits the hardware BWT implementation of sensors.
|
|
[2014-10-16]
人次