Citation

Tang J, Tang X, Yuan J. IEEE Trans. Multimedia 2017; PP(99): e8060548.

Copyright

(Copyright © 2017, Institute of Electrical and Electronics Engineers)

DOI

10.1109/TMM.2017.2760627

PMID

unavailable

Abstract

Social media users are generating data on an unprecedented scale. Distributed storage systems are often used to cope with explosive data growth. Data partitioning and replication are two inter-related data placement issues affecting the inter-server traffic caused by user-initiated read and write operations in distributed storage systems. This paper investigates how to minimize the inter-server traffic among a cluster of social media servers through joint data partitioning and replication optimization. We formally define the problem and study its hardness. We then propose a Traffic-Optimized Partitioning and Replication (TOPR) method to continuously adapt data placement according to various dynamics. Evaluations with real Twitter and LiveJournal social graphs show that TOPR not only reduces the inter-server traffic significantly but also saves much storage cost of replication compared to state-of-the-art methods. We also benchmark TOPR against the offline optimum by a binary linear program.

Keywords: Twitter-Traffic-Status

Language: en

Keywords

Social media; Twitter; Data models; data replication; Distributed databases; distributed storage; Facebook; graph partitioning; Partitioning algorithms; Servers