| 英文标题 | Transmission load optimization strategy based on instance reallocation in Heron |
| 作者英文名 | Liu Yu, Yu Jiong, Pu Yonglin, Li Ziyang, Zhang Yitian |
| 机构英文名 | 1.School of Software,Xinjiang University,Urumqi 830091,China;2.College of Information Science & Engineering,Xinjiang University,Urumqi 830046,China |
| 英文摘要 | As a new platform in big data stream computing, Apache Heron ignores the difference in communication modes between task instances and the unbalance of processing load among nodes, which leads to the decline system performance. To address the problem, this paper designed the model of node resource limitation, the model of communication overhead optimization and the model of data stream relationships among instances, as the foundation to propose the TLIR-Heron. The strategy was composed of the node resource limitation algorithm and the instance reallocation algorithm. By judging the criteria for instance reallocation and executing instance reallocation algorithm, this strategy transformed the inter-node data streams into intra-node data streams and minimized the communication overhead of the system. The experimental results show that under the three sets of benchmarks, TLIR-Heron reduces the communication overhead between nodes and the response latency of the system compared with the default scheduling strategy, and improves the balance of resource utilization of computing nodes. |
| 英文关键词 | big data; stream computing; Apache Heron; resource limitation; communication overhead |