Welcome to Journal of Beijing Institute of Technology
Advance Search
Volume 28Issue 3
.
Turn off MathJax
Article Contents
Article Navigation> JOURNAL OF BEIJING INSTITUTE OF TECHNOLOGY> 2019> 28(3): 437-446
Donghong Han, Yi Fang, Daqing Yi, Yifei Zhang, Xiang Tang, Guoren Wang. Load Shedding Strategy Based on Combined Feed-Forward Plus Feedback Control over Data Streams[J]. JOURNAL OF BEIJING INSTITUTE OF TECHNOLOGY, 2019, 28(3): 437-446. doi: 10.15918/j.jbit1004-0579.18035
Citation: Donghong Han, Yi Fang, Daqing Yi, Yifei Zhang, Xiang Tang, Guoren Wang. Load Shedding Strategy Based on Combined Feed-Forward Plus Feedback Control over Data Streams[J].JOURNAL OF BEIJING INSTITUTE OF TECHNOLOGY, 2019, 28(3): 437-446.doi:10.15918/j.jbit1004-0579.18035
shu

Load Shedding Strategy Based on Combined Feed-Forward Plus Feedback Control over Data Streams

doi:10.15918/j.jbit1004-0579.18035
  • 1.

    School of Computer Science and Engineering, Northeastern University, Shenyang 100819, Liaoning, China

  • 2.

    School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, USA

  • Received Date:2018-02-05
    Abstract
  • In data stream management systems (DSMSs), how to maintain the quality of queries is a difficult problem because both the processing cost and data arrival rates are highly unpredictable. When the system is overloaded, quality degrades significantly and thus load shedding becomes necessary. Unlike processing overloading in the general way which is only by a feedback control (FB) loop to obtain a good and stable performance over data streams, a feedback plus feed-forward control (FFC) strategy is introduced in DSMSs, which have a good quality of service (QoS) in the aspects of miss ratio and processing delay. In this paper, a quality adaptation framework is proposed, in which the control-theory-based techniques are leveraged to adjust the application behavior with the considerations of the current system status. Compared to previous solutions, the FFC strategy achieves a good quality with a waste of fewer resources.
    • FullText(HTML)
  • loading
    • References (25)
  • [1]
    Schwiebert L, Gupta S K S, Weinmann J. Research challenges in wireless networks of biomedical sensors[C]//Proceedings of the 7th Annual International Conference on Mobile Computing and Networking, 2001:151-165.
    [2]
    Collotta M, Bello L L, Pau G. A novel approach for dynamic traffic lights management based on wireless sensor networks and multiple fuzzy logic controllers[J]. Expert Systems with Applications, 2015, 42(13):5403-5415.
    [3]
    Arasu A, Cherniack M, Galvez E, et al. Linear road:a stream data management benchmark[C]//Proceedings of the Thirtieth International Conference on Very Large Data Bases VLDB Endowment, 2004:480-491.
    [4]
    Whitney A, Shasha D. Lots o'Ticks:real-time high performance time series queries on billions of trades and quotes[C]//Proceedings of the 2001 ACM SIGMOD International Conference on Management of Data, 2001:617.
    [5]
    Novak P K, Grcar M, Sluban B, et al. Analysis of financial news with NewsStream[R]. Tech. Rep. IJS-DP-11965,2015. arXiv:1508. 00027.
    [6]
    Salt L, Kusy B, Jurdak R. Adaptive threshold triggering of GPS for long-term tracking in WSN[C]//Soft Computing and Pattern Recognition. IEEE, 2016.
    [7]
    Chandrasekaran S, Cooper O, Deshpande A, et al. TelegraphCQ:continuous dataflow processing[C]//Proceedings of the ACM SIGMOD International Conference on Management of Data, San Diego, California, USA, DBLP, 2003:668-668.
    [8]
    Abadi D J, Carney D, Cetintemel U, et al. Aurora:a new model and architecture for data stream management[J]. The VLDB Journal, 2003,12(2):120-139.
    [9]
    Abadi D J, Ahmad Y, Balazinska M, et al. The design of the borealis stream processing engine[C]//Proceedings of the 2005 CIDR, 2005:277-289.
    [10]
    Arasu A, Babcock B, Babu S, et al. STREAM:The Stanford stream data manager[J]. IEEE Data Engin Bull, 2003,26:19-26.
    [11]
    Chen J, Dewitt D J, Tian F, et al. NiagaraCQ:a scalable continuous query system for Internet databases[C]//Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data, 2000:379-390.
    [12]
    Tatbul N, Cetintemel U, Zdonik S, et al. Load shedding in a data stream manager[C]//Proceedings of the 29th International Conference on Very Large Data Bases DBLP, 2003:309-320.
    [13]
    Jea K F, Li C W, Hsu C W, et al. A load shedding scheme for frequent pattern mining in transactional data streams[C]//Proceedings of the Eighth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD), IEEE, 2011:1294-1299.
    [14]
    Desai D, Joshi A. A deviant load shedding system for data stream mining[J]. Procedia Computer Science,2015,45:118-126.
    [15]
    Jea K F, Li C W, Hsu C W, et al. A load-controllable mining system for frequent-pattern discovery in dynamic data streams[C]//Proceedings of the International Conference on Machine Learning and Cybernetics, IEEE, 2010:2466-2471.
    [16]
    Jea K F, Li C W, Hsu C W, et al. A load shedding scheme for frequent pattern mining in transactional data streams[C]//Eighth International Conference on Fuzzy Systems and Knowledge Discovery, IEEE, 2011:1294-1299.
    [17]
    Belghaouti F, Bouzeghoub A, Aoul Z K, et al. Graph-oriented load-shedding for semantic Data Stream processing[C]//International Workshop on Computational Intelligence for Multimedia Understanding, IEEE, 2015:1-5.
    [18]
    Belghaouti F, Bouzeghoub A, Kazi-Aoul Z, et al. POL:a pattern oriented load-shedding for semantic data stream processing[C]//Proceedings of the 2016 International Conference on Web Information Systems Engineering, 2016:157-171.
    [19]
    Belghaouti F, Bouzeghoub A, Aoul Z K, et al. A query based graph-oriented load-shedding for RDF stream processing[C]//International Workshop on Computational Intelligence for Multimedia Understanding, IEEE, 2016.
    [20]
    Basaran C, Kang K D, Suzer M H. Adaptive load shedding via fuzzy control in data stream management systems[C]//IEEE International Conference on Service-Oriented Computing and Applications, IEEE Computer Society, 2012:1-8.
    [21]
    Ning G, Wang H, Shu L, et al. Towards load shedding and scheduling schemes for data streams that maintain quality and timing requirements of query results[J]. Soft Computing, 2016, 20(5):1961-1976.
    [22]
    Magdy A, Mokbel M F, Elnikety S, et al. Venus:Scalable Real-Time Spatial Queries on Microblogs with Adaptive Load Shedding[J]. IEEE Transactions on Knowledge & Data Engineering, 2016, 28(2):356-370.
    [23]
    Song C, Ge T, Chen C, et al. Soft quorums:a high availability solution for service oriented stream systems[C]//Proceedings of the 2017 International Conference on Database Systems for Advanced Applications, 2017:253-268.
    [24]
    Zhou R, Wang G, Han D, et al. Buffer-preposed QoS adaptation framework and load shedding techniques over streams[C]//Web Information Systems-WISE 2006, International Conference on Web Information Systems Engineering, Wuhan, China, October 23-26, 2006, Proceedings, DBLP, 2006:234-246.
    [25]
    Lee J H, Dong S K, Sang M L, et al. DDoS attacks detection using GA based optimized traffic matrix[C]//Fifth International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing, IEEE, 2011:216-220.
    • Relative Articles
  • Supplements (0)
  • Cited By
  • 加载中

Catalog

    通讯作者:陈斌, bchen63@163.com
    • 1.

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索
    Get Citation
    PDF
    XML

    Article Metrics

    Article views (511) PDF downloads(324) Cited by()
    Proportional views
    Related

    Address:5 Zhongguancun South Street, Haidian District, Beijing

    Tel:86-10-68914374

    Email:blgywb@bit.edu.cn

    Copy Right © Journal of Beijing Institute of Technology

    Supported by:Beijing Renhe Information Technology Co. Ltd

    /

      Return
      Return
        Baidu
        map