《计算机应用研究》|Application Research of Computers

一种基于模板的数据预取和缓存算法

Data pre-fetching and caching algorithm based on templates

免费全文下载 (已被下载 次)  
获取PDF全文
作者 高萌,王霓虹,李丹,白杰云
机构 1.东北林业大学 信息与计算机工程学院,哈尔滨 150040;2.哈尔滨工业大学 计算机科学与技术学院,哈尔滨 150040
统计 摘要被查看 次,已被下载
文章编号 1001-3695(2014)11-3240-03
DOI 10.3969/j.issn.1001-3695.2014.11.009
摘要 针对专题型应用中普遍存在的大数据查询的频繁性和模式固定性特点,提出一种基于模板的数据预取和缓存算法,用于加快数据查询响应速度并减轻服务器端负载压力。通过构建数据查询模板,在触发器被激发时调用模板以构建预取数据,提出基于模板的数据预取方法和基于触发器的预取算法;考虑缓存空间中一些大数据的存在对查询响应速度的优化性,建立缓存对象模型并提出改进的Hybrid算法。以东方红湿地环境监测平台为例进行算法实验与分析,实验结果表明,在不同的缓存百分比下,较之典型的缓存算法,改进的Hybrid算法在访问延迟率上均有改进,且在大数据量查询时表现出了优越的应用效果。
关键词 专题型应用;数据预取;数据缓存;频繁查询;大数据查询
基金项目 国家公益性行业专项基金资助项目(201104037)
国家“十二五”农村领域科技计划基金资助项目(2012AA102003-2)
本文URL http://www.arocmag.com/article/01-2014-11-009.html
英文标题 Data pre-fetching and caching algorithm based on templates
作者英文名 GAO Meng, WANG Ni-hong, LI Dan, BAI Jie-yun
机构英文名 1. College of Information & Computer Engineering, Northeast Forestry University, Harbin 150040, China; 2. School of Computer Science & Technology, Harbin Institute of Technology, Harbin 150040, China
英文摘要 Aiming at the frequent and fixed data querying characteristics generally existed in special kinds of applications, this paper proposed a data pre-fetching and caching algorithm based on templates, which was used to improve the query efficiency and lighten the loading pressure of servers. It built the data query templates which would be invoked to get the pre-fetching data when a trigger was activated, and put forward a data pre-fetching method based on templates and a pre-fetching algorithm based on triggers. In consideration of the existence of some big data in cache space had optimization effect on query speed, it designed a cache object model and put forward an improved Hybrid algorithm. It testd and analyzed the algorithm performance based on Dongfanghong wetland environment monitoring platform. The experiment results show that the access latency rate of the proposed algorithm is all lower than classical algorithms under different cache percent, and the algorithm shows an excellent application performance as the increase of query data amount.
英文关键词 special kinds of applications; data pre-fetching; data caching; frequent query; big data query
参考文献 查看稿件参考文献
  [1] 沈霖, 陈能. 基于WebGIS的PM2. 5及空气质量信息的发布与共享[J] . 测绘通报, 2012(S1):772-774.
[2] 庞娜, 程德福. 基于ZigBee无线传感器网络的温室监测系统设计[J] . 吉林大学学报:信息科学版, 2010, 28(1):55-60. [3] 吴亦锋, 刘彪, 许巧玲. 大型公共建筑能耗监控系统研究[J] . 福州大学学报:自然科学版, 2011, 39(1):82-89.
[4] 朱鸿宇, 刘瑰, 唐福华, 等. 数据库查询优化中的智能预取技术[J] . 计算机应用研究, 2007, 24(5):35-40.
[5] 谢瑞莲, 耿国华, 周明全, 等. 高访问量信息平台响应性能优化研究与实现[J] . 计算机应用研究, 2009, 26(7):2610-2612.
[6] BAHN H. Web cache management based on the expected cost of Web objects[J] . Information and Software Technology, 2005, 47(9):609-621.
[7] SAJEEV G P, SEBASTIAN M P. Building semi-intelligent Web cache systems with lightweight machine learning techniques[J] . Computers & Electrical Engineering, 2013, 39(4):1174-1191.
[8] 牛伟, 成娟, 翟正军, 等. 基于对象角色的高精度缓存替换算法[J] . 计算机应用研究, 2011, 28(11):4089-4091.
[9] 杨春贵, 吴产乐, 彭鸿雁. 一种有效的Web代理缓存替换算法[J] . 计算机工程, 2007, 33(3):43-44, 47.
[10] XU Bo, CHANG Jian, HUANG Shi-meng. Efficiency of cache mechanism for network processors[J] . Tsinghua Science & Technology, 2009, 14(5):575-585.
[11] 曹英斌. Web数据缓存与预取一体化的研究与应用[D] . 沈阳:东北大学, 2011.
[12] SHAO Yi-chuan, YAO Xing-jia. Research of real-time data warehouse storage strategy based on multi-level caches[J] . Physics Procedia, 2012, 25(4):2315-2321.
[13] 朱鸿宇, 刘瑰, 唐福华, 等. 一种自适应的数据预取与缓冲算法[J] . 计算机工程与应用, 2006, 42(24):13-15.
[14] ASADUZZAMAN A, SURYANARAYANA V R, SIBAI F N. On levell cache locking for high-performance low-power real-time multicore systems[J] . Computers & Electrical Engineering, 2013, 39(4):1333-1345.
[15] BELYS K, ERIK H D. Generating cache hints for improved program efficiency[J] . Journal of Systems Architecture, 2005, 51(4):223-250.
[16] 王霓虹, 高萌. 东方红湿地环境监测平台关键技术研究[J] . 自动化技术与应用, 2013, 32(7):137-140.
收稿日期 2013/10/30
修回日期 2013/12/4
页码 3240-3242,3246
中图分类号 TP391.3;TP301.6
文献标志码 A