Hive Sql

数据库

hive常见问题

科学计数法问题的解决:cast(cast(poiid as double) as bigint)

逗号=inner join=join,不写条件就是笛卡尔积

left join=left outer join

right join=right outer join

full join=full outer join包含左右表的所有行

hive lateral view 与 explode详解

hive字符串用法

https://zhuanlan.zhihu.com/p/82601425

hive中split(),explode()和lateral row

字符串类型的:

select productid, split(depart,':')[0], split(depart,':')[1],district 
from xxx demo
lateral view explode(split(departcityprices,',')) demo as depart
lateral view explode(split(districtids,',')) demo as district
where businesstype in (6, 7);

array<struct>类型的

行列转换(explode array)

json字符串

正则表达式

regexp

https://www.cnblogs.com/yfb918/p/10644262.html

hive变量

hivevar

set hivevar:poitype=(2,3,66);,用法:poitype in ${poitype}

set hivevar:initial_date=2020-04-28;,用法:where d='${initial_date}'

set hivevar:score_base=2.5;,用法:'${score_base_cnt}'

hiveconf

set vers=(select MAX(version) from dw_youdb.ta_sync_poi WHERE version IS NOT NULL);

用法:where version=${hiveconf:vers}

hive归一化

mysql常用命令

mysql -u root -p

mysql索引

应尽量避免在 where 子句中使用 or 来连接条件,否则将导致引擎放弃使用索引而进行全表扫描,如: select id from t where num=10 or num=20 可以这样查询: select id from t where num=10 union all select id from t where num=20

like keyword% 索引有效,其它的like语句索引无效。如果是前缀like,可以考虑reverse。

in会走索引

MySQL百万级数据查询优化

多个单列索引和联合索引的区别详解

sql like与索引(后模糊匹配才能让索引有效)

mysql常见问题

mysql卸载:https://zhuanlan.zhihu.com/p/68190605

安装:https://zhuanlan.zhihu.com/p/37152572

3306端口被占用:https://blog.csdn.net/qq_28325423/article/details/80549018

my.ini文件在路径C:\ProgramData\MySQL\MySQL Server 8.0下。修改datadir路径,将原路径下的文件拷贝到新路径,注意my.ini文件的编码方式是ANSI,自动保存会更改编码方式,导致mysql无法启动。

MYSQL导出数据:https://blog.csdn.net/fdipzone/article/details/78634992

远程访问:https://blog.csdn.net/sgrrmswtvt/article/details/82344183

python3 mysql错误 pymysql.err.OperationalError: (2013, 'Lost connection to MySQL server during query'):https://blog.csdn.net/whatday/article/details/104098336

MySQL 各种超时参数的含义:https://www.cnblogs.com/xiaoboluo768/p/6222862.html

MySQL索引:https://blog.csdn.net/u014745069/article/details/80466917

Last updated

Was this helpful?