Dynamic scheduling for speculative execution to improve MapReduce performance in heterogeneous environment

Hyungjae Jung, Hidenori Nakazato

    研究成果: Conference contribution

    7 被引用数 (Scopus)

    抄録

    MapReduce framework allows users to quickly develop big-data applications and process big-data effectively. However, unexpected malfunction may be found in cloud environment because a distributed system consists of several hardware, and this malfunction often causes delay of overall processing. MapReduce framework provides Speculative Execution (SE). SE reduces delay in a homogeneous environment by assigning delayed tasks to additional nodes. As cloud computing prevails, cloud computing environment is moving from homogeneous to heterogeneous. Original SE is not perfect and sometimes produces inefficient result in a heterogeneous environment. This paper proposes Dynamic Scheduling for Speculative Execution (DSSE) which enhances performance in a heterogeneous environment by improving existing SE. DSSE prevents wasted SE since it calculates processing capability of each node more objectively and precisely. DSSE has reduced entire processing time approximately 10% compared to original SE. Success rate of SE was 100%.

    本文言語English
    ホスト出版物のタイトルProceedings 2014 IEEE 34th International Conference on Distributed Computing Systems Workshops, ICDCSW 2014
    出版社Institute of Electrical and Electronics Engineers Inc.
    ページ119-124
    ページ数6
    30-June-2014
    ISBN(電子版)9781479941810
    DOI
    出版ステータスPublished - 2014 8月 29
    イベント2014 IEEE 34th International Conference on Distributed Computing Systems Workshops, ICDCSW 2014 - Madrid, Spain
    継続期間: 2014 6月 302014 7月 3

    Other

    Other2014 IEEE 34th International Conference on Distributed Computing Systems Workshops, ICDCSW 2014
    国/地域Spain
    CityMadrid
    Period14/6/3014/7/3

    ASJC Scopus subject areas

    • コンピュータ ネットワークおよび通信
    • ハードウェアとアーキテクチャ
    • ソフトウェア

    フィンガープリント

    「Dynamic scheduling for speculative execution to improve MapReduce performance in heterogeneous environment」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

    引用スタイル