Solution Overview
Data Lake Solution
The building of ‘enterprise unified data resource center’ based on advanced data model, standard batch data processing architecture and efficient data supply construction and high-performance storage computing. The center supports the development of various analytical applications as well as the computing of internal and external structural and non-institutional data storage. Sunline Data Background Solution also can comprehensively support various application scenarios such as risk control, marketing support and performance management based on big data, so as to drive business development by data.
Scheme architecture
Solution Advantages
Operation with high performance
Sunline Data Background Solution incrementally processes data during data acquisition. The zipper algorithm with incomplete fields is used to compress the historical data and the data model is designed in the weak normal form of the partial width table, so as to ensure the optimization of the computing performance of the data background storage
Model maturation
The data of the business source system is processed according to the data warehouse and data mart model of Sunline and stored in each data layer in a distinct way, so that the management and application of the data warehouse are standardized and orderly
Product modularization
With a variety of modular supporting tools, it meets the needs of customized data background products from different enterprises. With a variety of data application products, Sunline Data Background Solution meets the diversified needs of users based on data background application expansion
ETL development automation
The scheduling of ETL and data processing process can realize unified, standardized and process-based automatic development, which ensure the accuracy of scheduling and reduce the operation risk caused by manual intervention
Rich implementation experience
With rich consulting and implementation experience in the financial industry, it is able to customize the overall solution and plan a feasible implementation map
Solution Values
Unified data inlet and outlet
Enterprises can share data on internal and external, covering internal data and external data, structured data and unstructured data to meet the ‘one-stop’ data service requested by users at all levels
Uniform data caliber
According to the data demand of all kinds of users of the enterprise, the preliminary integration and processing of all kinds of data can be carried out to unify the processing caliber, to save application processing resources and to avoid the problem of repeated data checking caused by multiple data caliber
High usability of data
Standardizes the data processing of each system and solve the problem of data inconsistency between systems; Identifies and solve all kinds of data quality problems; integrate and classification store enterprise level data resources
Data and service standardization
With standard and normalized data models and high-quality data, the data warehouse platform can provide standardized data and service to support for other downstream application systems and efficiently support the construction and expansion of them
Smart monitoring visualization
Intelligent and visual monitoring interface provides multi-level and multi-perspective monitoring view and supports multi-scheduling server to view the global monitoring view; It will immediately raise the alarm in case of any abnormal situation and remind relevant operation, maintenance and development personnel; it will also provide complete processing log information to meet the needs of the definition of problem causes
Product Composition
Data warehouse (DW)
Data exchange platform
Schedule platform
Real-time data platform
Historical data platform
External data management platform
Historical data platform
Financial data mart
Risk data mart
Related program recommendation
