大数据分析全英文 (22).pdf

《大数据分析全英文 (22).pdf》由会员分享，可在线阅读，更多相关《大数据分析全英文 (22).pdf（6页珍藏版）》请在淘文阁 - 分享文档赚钱的网站上搜索。

1、2S1:Data storing systemData collection and modelingDistributed file systemDistributed Database/data warehouseUnified Data Access Interface3S1-Data Storing architectureData Acquisition/Extraction/Transforming/ModelingDistributed File Systems(HDFS/GFS/Colossus)NoSQL Database(HBase/BigTable/MongoDB/Neo

2、4j)Unified Data Access InterfaceL1L2L3L44S1-L4:ODBC-DAL-UDAI(Unified Data Access Interface)1 ODBC;JDBCAll database operations are completed by the corresponding ODBC driver.2 DAL-Data Access Layer1.CRUD(Create Retrieve Update And Delete)of the database.2.Transaction management,3.Concurrent schedulin

3、g,4.Buffer management,5.Heterogeneous database conversion 6.Inheritance in a distributed computing environmentDAO,implementation based on ORM(Object/relation Mapping),service data object,service middleware3 Unified Data Access Interfacecross-platform heterogeneous databases for different data type,d

4、iversified and various standards technology of the big data application Platform:UNIX,Linux or Windows;data type:forms,mails,XML documents,EJB components,Web services,images,audio/video files or For other unstructured data;The design of the data access layer DAL needs to be compatible with various s

5、tandard technologies and productsFor distributed computingFor cross-platform heterogeneous databasesevolved to evolved to 5S1-L4:Unified data access interfaceDefinition:Unified data access interface is Based on a unified data interface to support Cross-platformheterogeneous data in a distributed env

6、ironmentFunctions:1.Unified data display,storage and management2.Separation of access interface and implementation code,the change of the underlying database connection does not affect the unified data access interface3.Shielding the differences of data sources and the details of database operations

7、,making the application layer focus on data applications4.Provide a unified access interface and a unified query language6Application layerApplicationApplicationApplicationUnified data access interfaceUnified data access layerData service EngineService modelData ResourcesManagerData transform Engine

8、Data model/MetadataHeterogeneous Data resourceWrapperWrapperWrapperWrapperWrapperWrapperWrapperThe architecture of unified data access layer7Data Storing system summaryData Acquisition/Extraction/Transforming/ModelingDistributed File Systems(HDFS/GFS/Colossus)NoSQL Database(HBase/BigTable/MongoDB/Neo4j)Unified Data Access InterfaceL1L2L3L4