赵嘉凌;蔡文伟;白伟华;

• 1:肇庆学院

摘要(Abstract)：

文中从大数据应用环境下以数据处理、云存储和容错处理等方面与网络进行协同工作的需求为基础,分析了大数据应用下底层数据和网络多方面的问题,为大数据框架中底层数据的传输和网络优化提供了研究基础。

关键词(KeyWords)： 大数据;应用感知;云计算;软件定义网络;云存储

Abstract:

Keywords:

基金项目(Foundation):

作者(Author): 赵嘉凌;蔡文伟;白伟华;

Email:

DOI: 10.16667/j.issn.2095-1302.2017.07.006

参考文献(References)：

• [1]Nature News:Bigdata:Wikiomics[EB/OL].http://www.nature.com/news/2008/080903/full/455022a.html
• [2]SP Nist.A NIST definition of cloud computing[J].Communications of the Acm,2015,53(6):50.
• [3]N.Mc Keown.Keynote talk:Software-defined networking[C].In Proc.of IEEE INFOCOM’09,Apr.2009.
• [4]Hadoop[EB/OL].http://hadoop.apache.org/
• [5]Isard M,Budiu M,Yu Y,et al.Dryad:distributed data-parallel programs from sequential building blocks[J].ACM Sigops Operating Systems Review,2007,41(3):59-72.
• [6]Dittrich J,Quiané-Ruiz J A,Jindal A,et al.Hadoop++:Making a yellow elephant run like a cheetah(without it even noticing)[J].Proceedings of the VLDB Endowment,2010,3(1-2):515-529.
• [7]Eltabakh M Y,Tian Y,?zcan F,et al.Co Hadoop:Flexible data placement and its exploitation in hadoop[J].Proceedings of the VLDB Endowment,2012,4(9):575-585.
• [8]Bu Y,Howe B,Balazinska M,et al.Ha Loop:Efficient iterative data processing on large clusters[J].Proceedings of the VLDB Endowment,2010,3(1-2):285-296.
• [9]Abouzeid A,Bajda-Pawlikowski K,Abadi D,et al.Hadoop DB:an architectural hybrid of Map Reduce and DBMS technologies for analytical workloads[J].Proceedings of the VLDB Endowment,2009,2(1):922-933.
• [10]Wang L,Tao J,Ranjan R,et al.G-Hadoop:Map Reduce across distributed data centers for data-intensive computing[J].Future Generation Computer Systems,2013,29(3):739-750.
• [11]Marozzo F,Talia D,Trunfio P.P2P-Map Reduce:Parallel data processing in dynamic Cloud environments[Z].Journal of Computer and System Sciences,2011.
• [12]Zaharia M,Chowdhury M,Franklin M J,et al.Spark:cluster computing with working sets[C].Proceedings of the 2nd USENIX conference on Hot topics in cloud computing.USENIX Association,2010:10.
• [13]Borkar V,Carey M,Grover R,et al.Hyracks:A f lexible and extensible foundation for data-intensive computing[C].Data Engineering(ICDE),2011 IEEE 27th International Conference on.IEEE,2011:1151-1162.
• [14]Apache Hadoop framework[EB/OL].http://hadoop.apache.org.2010-06-20/2010-11-07.
• [15]Hadoop On Demand Documentation[EB/OL].http://hadoop.apache.org/core/docs/r0.172/hod.html.2010-06-20/2010-11-07.
• [16]J.Dean.Experiences with Map Reduce,an Abstraction for Large-Scale Computation[C].In Proc of PACT’06.
• [17]J.Dean.Designs.Lessons and Advice from Building Large Distributed Systems[C].The 3rd ACM SIGOPS International Workshop on Large Scale Distributed Systems and Middleware(LADIS),Big Sky,MT,October 2009.
• [18]S.Y.Ko,I.Hoque,B.Cho,I.Gupta.On Availability of Intermediate Data in Cloud Computations[C].the USENIX Workshop on Hot Topics in Operating Systems(Hot OS),2009.
• [19]G.Wang,A.R.Butt,P.Pandey,K.Gupta.A Simulation Approach to Evaluating Design Decisions in Map Reduce Setups[C].In Proc of MASCOTS’2009.
• [20]Zheng Q.Improving Map Reduce fault tolerance in the cloud[Z].In:Taufer M,Rünger G,Du ZH,eds.Proc.of the Workshops and Ph D Forum(IPDPS 2010).Atlanta:IEEE Presss,2010.

文章评论(Comment)：