GBase 8a Mpp Cluster集群产品性能优化篇之行列混存优化

由于GBase 8a MPP Cluster是列存储的集群架构，因此当列数较多，访问的数据记录又非常离散时，会造成大量的离散I/O，严重影响查询性能。 GBase 8a MPP Cluster提供行列混存功能，即通过存储冗余行的信息，提高I/O性能。

建表语句：

CREATE TABLE “ac43” (

“BAZ002” bigint(16) DEFAULT NULL,

“AAZ223” bigint(16) NOT NULL,

“AAZ061” bigint(16) DEFAULT NULL,

“BAE165” varchar(3) DEFAULT NULL,

“BAB221” varchar(20) NOT NULL,

“AAC001” bigint(16) NOT NULL,

“AAB001” bigint(16) DEFAULT NULL,

“AAE140” varchar(3) NOT NULL,

“AAE002” int(6) NOT NULL,

“AAE003” int(6) NOT NULL,

“AAA115” varchar(3) NOT NULL,

“BAE230” varchar(3) NOT NULL,

“BAE151” varchar(3) NOT NULL,

“AAC066” varchar(3) NOT NULL,

“AAC084” varchar(3) NOT NULL,

“BAE180” decimal(16,2) DEFAULT NULL,

“AAE180” decimal(16,2) DEFAULT NULL,

“AAE020” decimal(16,2) DEFAULT NULL,

“AAE021” decimal(16,2) DEFAULT NULL,

“AAE022” decimal(16,2) DEFAULT NULL,

“AAE023” decimal(16,2) DEFAULT NULL,

“AAA042” decimal(10,4) DEFAULT NULL,

“AAA043” decimal(10,4) DEFAULT NULL,

“AAA041” decimal(10,4) DEFAULT NULL,

“AAA045” decimal(10,4) DEFAULT NULL,

“BAE089” int(3) DEFAULT NULL,

“BAC184” varchar(20) DEFAULT NULL,

“BAB222” varchar(20) DEFAULT NULL,

“BAE181” varchar(3) DEFAULT NULL,

“BAE046” varchar(20) DEFAULT NULL,

“AAE011” varchar(50) DEFAULT NULL,

“AAE036” bigint(14) DEFAULT NULL,

“AAB034” varchar(16) DEFAULT NULL,

“AAA027” varchar(6) DEFAULT NULL,

GROUPED"AC43" (“BAZ002”,“AAZ223”,“AAZ061”,“BAE165”,“BAB221”,“AAC001”,“AAB001”,“AAE140”,“AAE002”,“AAE003”,“AAA115”,“BAE230”,“BAE151”,“AAC066”,“AAC084”,“BAE180”,“AAE180”,“AAE020”,“AAE021”,“AAE022”,“AAE023”,“AAA042”,“AAA043”,“AAA041”,“AAA045”,“BAE089”,“BAC184”,“BAB222”,“BAE181”,“BAE046”,“AAE011”,“AAE036”,“AAB034”,“AAA027”),

KEY “IDX_AC43_AAC001” (“AAC001”) KEY_BLOCK_SIZE=4096 USING HASH GLOBAL

) COMPRESS(5, 5) ENGINE=EXPRESS DISTRIBUTED BY(‘aac001’) DEFAULT CHARSET=utf8 TABLESPACE=‘sys_tablespace’

查询语句

以下为性能得到提高的sql查询语句

select

ac43x0_.AAZ223 as AAZ1_2446

,ac43x0_.BAZ002 as BAZ2_2446

,ac43x0_.AAZ061 as AAZ3_2446

,ac43x0_.BAE165 as BAE4_2446

,ac43x0_.BAB221 as BAB5_2446

,ac43x0_.AAC001 as AAC6_2446

,ac43x0_.AAB001 as AAB7_2446

,ac43x0_.AAE140 as AAE8_2446

,ac43x0_.AAE002 as AAE9_2446

,ac43x0_.AAE003 as AAE10_2446

,ac43x0_.AAA115 as AAA11_2446

,ac43x0_.BAE230 as BAE12_2446

,ac43x0_.BAE151 as BAE13_2446

,ac43x0_.AAC066 as AAC14_2446

,ac43x0_.AAC084 as AAC15_2446

,ac43x0_.BAE180 as BAE16_2446

,ac43x0_.AAE180 as AAE17_2446

,ac43x0_.AAE020 as AAE18_2446

,ac43x0_.AAE021 as AAE19_2446

,ac43x0_.AAE022 as AAE20_2446

,ac43x0_.AAE023 as AAE21_2446

,ac43x0_.AAA042 as AAA22_2446

,ac43x0_.AAA043 as AAA23_2446

,ac43x0_.AAA041 as AAA24_2446

,ac43x0_.AAA045 as AAA25_2446

,ac43x0_.BAE089 as BAE26_2446

,ac43x0_.BAC184 as BAC27_2446

,ac43x0_.BAB222 as BAB28_2446

,ac43x0_.BAE181 as BAE29_2446

,ac43x0_.BAE046 as BAE30_2446

,ac43x0_.AAE011 as AAE31_2446

,ac43x0_.AAE036 as AAE32_2446

,ac43x0_.AAB034 as AAB33_2446

,ac43x0_.AAA027 as AAA34_2446

from

AC43 ac43x0_ where 1=1 and instr(‘120’

ac43x0_.AAE140)>0 and (ac43x0_.AAC001 in (4000000001960854))

项目中很多需要这种全字段SELECT的情况，尤其多字段宽表，明细表，在这种情况可以考虑使用行列混存进行优化。

GBase 8a Mpp Cluster集群产品性能优化篇之行列混存优化相关推荐

【GBase 8a MPP数据库集群】使用 MAX_BAD_RECORDS 加载数据文件
说明: MAX_BAD_RECORDS:在每次加载的任务中,设定错误数据行数的上限.当本次加载任务产生的错误数据行数大于 max_bad_records 设定的值时,加载任务回滚,加载工具报错退出.不 ...
【GBase 8a MPP数据库集群】函数DECODE
语法 DECODE(value,value1,result1, value2,result2, value3,result3,- , result) 函数说明类似于 CASE value WHEN ...
【GBase 8a MPP数据库集群】日期算术运算
语法语法格式如下: 日期 +(-) bit_expr 同以下语法等价: 日期 +(-) interval expr type 日期加减运算跟普通的加减运算逻辑一样,只是后面加的数字.字符或表达式的 ...
【GBase 8a MPP数据库集群】CAST 和 CONVERT 函数
函数说明 CAST(expr AS type), CONVERT(expr,type), CONVERT(expr USING transcoding_name)CAST()和 CONVERT()函数 ...
【GBase 8a MPP数据库集群】计算字符串长度 BIT_LENGTH(str)
函数说明返回字符串 str 的比特长度,以比特进行计算. 示例示例 1 str 的值为" text",返回其对应的比特长度. gbase> SELECT BIT_LENG ...
【GBase 8a MPP数据库集群】使用 AUTOFILL 关键字补齐缺失数据
说明: AUTOFILL:用于设定是否启用缺失列自动补齐功能,启用该参数后,对缺失分割符的字段数据按照 default 值或者 NULL 值进行加载,默认不自动补齐. 建表语句: create tab ...
【GBase 8a MPP数据库集群】使用 TABLE_FIELDS 指定加载 longblob 数据
longblob 类型数据加载方法分为两种,一种是数据形式的加载,一种是文件形式的加载.加载该类型数据时,需要在 table_fields 参数中对 longblob 列指定type_text. ty ...
GBase 8a MPP Cluster 维护-日志篇
日志介绍 1.1 关于日志日志描述 GBase 8a MPP Cluster 集群不同的日志保存路径不同,主要日志分类见下表详细日志查看参见附录日志参考. 表 :日志分类说明日志类型日志描述 ...
DEV05 GBase 8a MPP Cluster 数据库性能优化
GBase 8a MPP Cluster 数据库性能优化一.数据库为何要优化 (一)从 DBA 角度谈数据库为何要优化 (二)数据库产品的选型: (三)从 DE(开发工程师)角度谈数据库为何要优化 ...
GBase 8a MPP Cluster 产品简介
1 GBase 8a MPP Cluster 产品简介产品简介南大通用大规模分布式并行数据库集群系统,简称:GBase 8a MPP Cluster, 它是在 GBase 8a 列存储数据库基础上 ...

GBase 8a Mpp Cluster集群产品性能优化篇之行列混存优化

GBase 8a Mpp Cluster集群产品性能优化篇之行列混存优化相关推荐

最新文章

热门文章