当前课程知识点:Big Data of Smart Grid > Chapter 7 Prospect of BDSG > Intelligent Disaster or Failure Recognition Means——Related Literature of Electric Power Vision Big Data > 5.2 Data collection and management
返回《Big Data of Smart Grid》慕课在线视频课程列表
返回《Big Data of Smart Grid》慕课在线视频列表
好吧
OK
欢迎回来
welcome back
本讲讨论5.2小节
This lecture will talk about the second section
数据收集和管理
data collection and management
There are 3 subsections in this part
本部分共有三个方面
There are 3 subsections in this part
第一小节是需求分析
the first is about the demand analysis
即
That is
哪些具体需求
what kind of needs
智能电网的数据采集和管理到底是来自于
will data collection and management satisfy for smart grid
数据是开展智能电网大数据应用的基础
Data is the basis for developing smart grid big data applications
随着智能电网大数据应用的深入开展
With the in-depth development of smart grid big data applications
需要存储和管理的数据规模
the scale of data that needs to be stored and managed
迅速增加
has rapidly increased
这些数据既包括
These data include not only data from
智能电网发电
the smart grid's power generation
输电
transmission
变电
substation
配电
distribution
用电和调度等各环节的数据
power consumption and dispatching
还包括智能电网外部辅助数据
but also the development of external auxiliary data of the smart grid
开展大数据应用所需要
required for big data applications
如气象、地理信息
such as weather,geographic information
交通
transportation
人口等数据
population and other data
这些数据来源多样
These data sources are diverse
数据量大
the amount of data is large
数据类型复杂
and the types of data are complex
如何清晰掌握数据情况
How to clearly grasp the data
管理原始数据
manage the original data
加工过程数据与成熟数据
processing data and mature data
以及如何实现数据共享
and how to achieve data sharing
是智能电网大数据管理的一个基础性问题
is a basic problem for smart grid big data management
为解决以上问题
In order to solve the above problems
需要将数据作为一种资产进行管理
data needs to be managed as an asset
一方面
On the one hand
建立一套数据资产管理规范
a set of data asset management specifications is established
用制度来规范数据资产管理
and systems are used to regulate data asset management
另一方面
On the other hand
需建设数据资产管理系统,
we need to build a data asset management system
用软件进行数据资产全生命周期管理
to manage the whole life cycle of data assets with software
第二小节为管理规范
The second subsection is about the Management specifications
数据资产管理规范
Data asset management specifications
包括数据描述规范
include data description specifications
和数据流程管理规范两部分
and data process management specifications
数据描述规范是建立
The data description specification is to establish specifications
数据分类、数据编码、元数据等规范
such as data classification, data encoding, and metadata
数据分类规范是将数据分为
the data classification specification is to divide the data into major categories
电网运行、用户服务、经营管理
such as power grid operations, user services, management
电力外部数据等大类按照业务领域
and external power data according to business areas
并对大类进行二级分类
and classify the major categories into two categories
基于数据分类
Based on the data classification
参照BOM编码规范
referring to BOM coding specification
设计智能电网大数据的编码规范
the coding specification of smart grid big data is designed
对所有数据设置唯一标识
and a unique identifier is set for all data
用于追溯数据属性信息
to be used for tracing data attribute information
元数据规范是基于对数据属性的描述
Metadata specification is based on the description of data attributes
通过分析电力
By analyzing the characteristics of power
及相关数据资源特征及共享服务机制
and related data resources and shared service mechanisms
构建数据资产元数据模型
a metadata model of data assets is constructed
建立数据的描述规范
and data description specifications are established
实现对结构化数据(数据库、报表、文件、接口、视图等)
to achieve structured data (databases, reports, files, interfaces, views, etc.)
和非结构化数据的统一管理和存储描述
and unified management and storage description of unstructured data
以元模型为驱动
Driven by the meta-model
形成数据管理
form an integrated management of data management
运维、应用的一体化管理。
operation and maintenance, and application.
数据流程管理规范是
The data flow management specification is
对数据加工过程、数据接入、数据共享等进行规范
to regulate processing process, data access, data sharing, etc
形成数据加工规范
forming the data processing specification
数据入库规范
data storage specification
数据出库规范
data export specification
数据安全管理规范等
data security management specification, etc
实现对原始数据
Realize the management of original data
过程数据、成熟数据和数据共享的管理
process data, mature data and data sharing
最后一小节是关于应用程序的
The last subsection is about the application
数据分类和编码规范
Data classification and coding specifications
是数据管理的基础
are the foundation of data management
智能电网大数据涉及数据来源多
Smart grid big data involves multiple data sources
类型复杂,涉及业务也相互交叉
complex types, and related services
需要确定分类标准
It also needs to determine classification criteria
按大类对数据进行划分
divide the data according to major categories
再对数据进行细分
and then subdivide the data
基于数据分类进行数据编码
perform data encoding based on the data classification
构建数据唯一标识。
and construct a unique data identification.
数据流程管理是数据管理的核心
While data process management is the core of data management.
从数字采集
Starting from the processes of data collection
数据加工
data processing
数据入库、数据共享
data warehousing、data sharing
等流程出发
etc.
确定相应人员职责
determining the responsibilities
及操作规程
and operating procedures of the corresponding personal
从规范和系统两方面确保数据质量和数据安全
and ensure data quality and data safety from both specifications and systems
随着智能电网大数据的发展
With the development of smart grid big data
数据资产管理系统作为数据共享的载体
the data asset management system as the carrier of data sharing
作为数据共享的载体将会为各种智能电网大数据应用提供数据服务
will provide data services for various smart grid big data applications
好
OK
这节课就到这里
that's all for this lecture
下节课我们将继续讲第5.3节
Next time we will move on to section 5.3
希望再次见到你们
Hope to see you again
祝您有个美好的一天
Have a nice day
-Course Introduction and Overview of Big Data
-Chapter 1
-2.1 Why Electirc Power + Big Data? 2.2 Applications
-Chapter 2
-3.1 Grid Operation and Development
-Chapter3
-Related literature on big data applications from the user perspective
-4.1 Data Acquisition+4.2 Data Storage
-4.6 Data Security and Privacy Protection
-Chapter4
-Load forecasting technology related literature
-5.1.1Platform Construction: Demand Analysis
-5.1.2Platform Construction: Design (1)
-5.1.2Platform Construction: Design (2)
-5.2 Data collection and management
-5.3.1 Data Aggregation and Fusion: Scheme and process
-5.3.2 Data Aggregation and Fusion: Application Practice
-5.4.1 Analysis and Mining: Scheme and process
-5.4.2 Analysis and Mining: Use-case analysis
-Chapter5
-6.1 Heavy overload prediction of station area
-6.2 Daily load forecasting of large users
-6.3 Fault correlation analysis of power grid control system equipment
-6.4 Reliability of relay protection equipment family-
-6.5Application of random matrix in big data analysis of smart grid
-Chapter6
-Literature on Power Vision Data Processing Technology
-Development trend and suggestions for BDIG
-Chapter7