🐳 A most popular sql audit platform for mysql

Yearning SQL 审核平台

LICENSE  

MYSQL web 端 SQL 审核平台。

US_EN

US_EN guide

Depend on 依赖项

Gemini front-end

Yee web framwork

Website 官网

www.yearning.io

Community 社区

Gitter

Yearning2.0(Go) 使用交流 Q 群: 747364310

Feature 功能

  • SQL 查询
    • 查询工单
    • 导出
    • 自动补全,智能提示
    • 查询语句审计
  • SQL 审核
    • 流程化工单
    • SQL 语句检测与执行
    • SQL 回滚
    • 历史审核记录
    • 自定义审核层级
  • 推送
    • E-mail 工单推送
    • 钉钉 webhook 机器人工单推送
  • 用户权限及管理
    • 角色划分
    • 基于用户的细粒度权限
    • 注册
  • 其他
    • todoList
    • LDAP 登录
    • 动态审核规则配置
  • AutoTask 自动执行

Install 安装及使用日志

使用及安装文档 解决 95%的疑问,不做十万个为什么!

Develop 二次开发

二次开发注意事项

About 联系方式

E-mail: [email protected]

Recommend 推荐

Spug - 开源轻量自动化运维平台

Snapshot 效果展示

  • Login

login

  • Dashboard

  • 审核

  • SQL 语法高亮及自动补全

  • 查询

  • 细粒度的权限分配

  • 我的工单

License

  • AGPL v3

任何二次开发及二次开源项目请严格遵守相应开源许可

2020 © Henry Yee

Owner
Henry Yee
Creator of Yearning. APIs full-stack distributed systems SQL/NOSQL Python Golang JS etc.
Henry Yee
Comments
  • Yearning v1.3.0 正式发布

    Yearning v1.3.0 正式发布

    功能更新如下:

    1.修改了报错提示

    2.新增细粒化权限组,废除之前的个人权限划分

    3.连接名webook合并至配置页面webhook

    4.删除查询时限,新增管理员结束用户查询权限

    4.查询页面支持自动补全库名及表名

    5.新增版本号接口 (登陆后/#/version)

    6.修复权限审核页面,数据库管理页面低版本chrome或其他浏览器401报错的问题

    7.修复查询审核时查询工单提交没有消息推送的问题

  • v1.3.5 osc进度条仍然无法展示的问题

    v1.3.5 osc进度条仍然无法展示的问题

    使用了最新registry.cn-hangzhou.aliyuncs.com/cookie/yearning:v1.3.5镜像,osc进度条仍然无法展示。SHA1值下拉框,没有任何东西可以选择。直接在inception上运行命令inception get osc_percent '*6447AAE92414DE641D69450EA0FEA9F8829D54C2'\G 是有数据返回的。

  • 支持 OIDC SSO 自动注册与登录

    支持 OIDC SSO 自动注册与登录

    提供 OIDC SSO 登录 前端代码: https://github.com/cookieY/gemini-next/pull/1

    以 Keycloak 为例,配置如下

    [Oidc]
    Enable = true # 开启
    ClientId = "yearning"  
    ClientSecret = "fefehelj23jlj22f3jfjdfd"
    Scope = "openid profile"
    AuthUrl = "https://keycloak.xxx.ca/auth/realms/master/protocol/openid-connect/auth"
    TokenUrl = "https://keycloak.xxx.ca/auth/realms/master/protocol/openid-connect/token"
    UserUrl = "https://keycloak.xxx.ca/auth/realms/master/protocol/openid-connect/userinfo"
    RedirectUrL = "http://127.0.0.1:8000/oidc/_token-login"
    UserNameKey = "preferred_username"
    RealNameKey = "name"
    EmailKey = "email"
    

    需要在前端添加 OIDC 登录按钮,根据 oidc/state 的返回值判断是否展示按钮,按钮的超链接为 http://127.0.0.1:8000/oidc/_token-login

  • 不通权限组审核人之间跨环境审核异常

    不通权限组审核人之间跨环境审核异常

    Version 版本: V2.1.9

    Describe 问题描述 审核人有:U1、U2 数据库环境有:D1、D2 权限组有:G1,G2 G1下的数据库为D1环境的,审核人为U1 G2下的数据库为D2环境的,审核人为U2

    用户U3是使用者、同属于G1、G2组,在提交查询是申请D1的查询权限,但是可以选择审批人为U2,U2审批通过后U3即可访问D1的数据

    Expected 预期 审批权限由各自的审批管理员操作

  • 使用3.0版本导出查询数据时部分字段值显示****脱敏字段

    使用3.0版本导出查询数据时部分字段值显示****脱敏字段

    查询语句

    select
      tmps.id as item_id,
      'goods' as item_type,
      ifnull(tmc1.id, 'category001') as category,
      IF(tmps.name = '', tmp.name, tmps.name) as title,
      if(
        tmp.audit_status = 2
        and tmp.status = 1
        and tmps.is_sale = 1,
        1,
        0
      ) as is_valid,
      tmps.create_time as publish_time,
      tmps.product_id as spu_id,
      ifnull(tmp.brand_id, 'brand_001') as brand_id,
      ifnull(tmb.britain_name, 'default_brand_name') as brand_name,
      tmp.shop_id as shop_id,
      ifnull(ts.name, 'default_shop_name') as shop_name,
      tmps.product_id as product_id,
      ifnull(
        group_concat(
          distinct tmpss.specs_value_name
          order by
            tmpss.specs_value_name
        ),
        'no_spec'
      ) as specs,
      tmps.price as price,
      #        ifnull(tmps.discount_price, tmps.price) as discount_price,
      ifnull(tmps.harmay_price, tmps.price) as harmay_price
    from
      harmay.t_market_product_sku tmps
      left join harmay.t_market_product tmp on tmp.id = tmps.product_id and tmp.is_delete = 0
      left join harmay.t_market_category tmc3 on tmc3.id = tmp.category_third_id
      left join harmay.t_market_category tmc2 on tmc2.id = tmc3.parent_id
      left join harmay.t_market_category tmc1 on tmc1.id = tmc2.parent_id
      left join harmay.t_market_brand tmb on tmb.id = tmp.brand_id
      left join harmay.t_shop ts on ts.id = tmp.shop_id
      left join harmay.t_market_product_sku_specs tmpss on tmpss.product_sku_id = tmps.id
    where
      tmps.is_delete = 0 
      and tmps.id in ('4350969720971740395', 'a1c18e3763474aa6b488337df86656c7', '42b0e25728f54700b46087a0310b41a3', '4350969720971740835', '3806edd7f0424e508335d3c30faf1a98', '505be81f8e0645f2a85a243ef3938fee', '936359bcc3944efe8e4d98425e3bc9a6', '4350969720971741401', '6a2ec0a388674be0b0be70f9fe7349e2', '4350969720971741076', 'd058f48d363340579347f9ab1b899673', '4350969720971738532', '99a0dd276bed4ce98d26b507ece41c58', '4350969720971738145', '5584d44518bc46c99774407436cec3ae', '4350969720971738376', '7c383f625a3f469ab706a00d6a8cd6d0', '4c44a9b9d36947788e7abb2f016787db', '4350969720971740959', '14ed1f4d3ef24bebb1d4cd26455f8ec7', '27321406d657425896f0288e1b43d3f8', '29542d84cdef4b409d3afc41f70308cb', 'a73ad72ba06a49828825af6772315cb2', '4bb9db0f97d1409a948375d534489139', '4350969720971736858', '4350969720971736218', '4350969720971734345', '4350969720972287684', '4350969720971741719', '4350969720971741251', '3b9f0d27c02d46b0bbaeb9a7866c81df', '4350969720971741626', '4350969720971727268', '4ca6a5cde6664384b2e4c49f41a79df5', 'fe70a130a8394e06b5f6fe843bf4d879', '4350969720971741609', 'df94c79a8c7b4d4695c8e4e27eb032d8', '4350969720971738715', 'a9fb811ac6f74d0d90c72377724dc7b0', '385ec5798adb41b38357abfdf166f6aa', 'c3a35f646d8f451f8cf1a8f1138c15e2', '4350969720971741166', 'e4bfcccdcb474789bf9964862daf0222', '951576ad7bd74725823ceffef4abe66a', 'a55fc680bef143df8eef39d4208b8210', '4350969720971741722', '1520cc435f6a4256b6508a1bf7e039fc', '4350969720971740462', '9e2a2692eb704eed906c39645982e164', 'f295eb5dc24c4a75b63ed13e8c382607', 'a15b387252fe47c4ba2ccaf0d9e0425a', '4350969720971738809', '5d961b67b15e4e4894d438b940fb9105', '77644e6daaf94cd7817ff6d3b509c19f', '4350969720971739955', 'b83178b4bb1b4f6d96d19e2eaab4d6d2', '4350969720971741898', 'd504a56537354a45b00ccf245048fe09', '4350969720971738653', '4350969720971738984', '4350969720971737952', '8d0a3b73adff439c86fd6033e43ac855', '4350969720971741623', 'dcd87448f07241489892f416b73e3b91', '4350969720971740384', '8df9b91a8240457ca0fd288abe574642', '70b3cad1df344918861109970673caf7', '4350969720971740654', '4350969720971741083', '4350969720971741910', '4350969720971738564', '4350969720971736209', '4350969720971739813', 'a6e6dfcea6f54588b0035879fa2a896e', '146ebd7dc3b74c67a68f3bbb1198ec0f', 'ad1ef21d1d054c7aab292971483213a1', 'd66d3803fac84b8dbf3eb17c2c262a13', '4350969720971739253', '4350969720971740920', '4350969720971742162', '7cd00ebefee34d509e92fb0d84014fbc', '4350969720971727399', '7a6fdd5aedff49589f07978f59494ea9', 'ab8c750a96144b5ead512def02d2059c', 'a3383325e707451dbd33292ab41baf6b', 'c48021595a664daeb2e27238ef611d72', '1766136be10649c1b89486a8974bc151', '4350969720971729910', '4350969720971740434', 'e4cd285e1cbc4bfe903939fbba8e0d37', 'b452a3875af0478cb5959b42bd02711e', '4510fdd9adad424c966ade859dd4aa4a', '7e96363ab4c543f78391b693832b5f50', 'a61670d1693140c6bcfef968018c66c5', '730eaf0d7fcb48daa314873325b61aee', 'e4b48d9200c54aa5a0aa44aa4a6e7e66', '4350969720971741637', '4f45a4561ebb4c308009ad55ed2795aa', '4350969720971738293', '549d4341a4f0478da78e1f4a087d2d8b', '4350969720971740390', '2d88beeaa5e14289a286cd5812e3437b', '4350969720971734504', 'e08b79ded2e245f98b7ed007fa5bd669', '947a0c1ecff04d85b4714e143fdef4f3', '4350969720971741097', '4350969720971738818', '4350969720971725678', '4350969720971728198', '4350969720971740374', '4350969720971741228', '4350969720971742159', '4350969720971740858', '90ee870512d54c64a93454e3a9d8b35e', '4350969720971742035', '4350969720971733295', '48b15b7967024d4fb404420c97796344', 'f2efaa5baace45a8923493565ac8ec68', 'a658a39adbc444c8b49a02c34b735476', 'ede2c3aa946e414fa51e10ed6ca78795', '4350969720971739773', '4350969720971735143', '4350969720971741848', 'b637863407f84f41a5b742e7bde9b31d', '4350969720971733149', '4c4f2e21cc234dddbb9802c469190739', '4350969720971739054', '378965e7f5ce4c3ea466a4deb17c826a', '4350969720971738954', '27a068eec7a44f7781529aefed58b151', '0fc98524f9f949fc89ae67d7d9ce2c28', 'ede56cbc96d943fc96af0acd67a4fd54', '32b92c3d0ebc4eaf8be3a300305b9a41', '4350969720971726841', '4350969720971732179', '4350969720971741883', '4350969720971741053', '4350969720971741754', '510f143a64134909a4ecbb221df492eb', 'e50c5273fe804e6a887fd9970c55084f', '4350969720971741617', '4350969720971740557', '4350969720971726195', '0e33bb23fce94d5dbbc1a02d5b9bf615', 'e7de7c9d536c4af9988b25a2cc0ae4c5', '4350969720971741707', 'b95a4220d8ba4d51ba32cef0c0be38e9', '4350969720971739103', '4350969720971736442', 'add9bdfa226a41ad883726f38272cb6f', '8db9a34fe4b14e60a06ad2c0b940a581', '5a57356d08b74fb189762ecc10da9790', '706b9e8ba7324c1e879a7a322c7bb936', '4350969720971739688', '4350969720971739040', '3996c1df00d841eeb7bebac4ff6976e7', '271076b9111f49f79ceebb82eaaaad89', '6b8840eafe68457dbc2017830552eac0', '29aa7c87ae694fb1bed590f3cfa9ad0e', '4350969720971740468', '4350969720971741534', '4350969720971735790', '356edee8016f4a76b533ce504eda9fe7', '4350969720971741597', 'a09826dc5d224432a505220ae2235d3f', '470638d676a94c4095298c12da1d9324', '054100a52447462280396a37a94df009', '4350969720971742046', '4350969720971741573', '4350969720971742105', '4350969720971741104', '5f709e1cc6c24f3c801a63d62b6efa53', '4350969720971742069', '4350969720971738928', '4350969720971739836', '4350969720971733034', '3217b362ec314218b27d27415a847ad2', '27a1f7580430482783c807efb1de6f4c', 'e2a56d44f7f148128c91d5b929e52a63', 'ba722447d47d4a3290df8848ae7ebbc2', '4350969720971737233', '076ec5c4427145878f3f1da0241adf9b', '95e033d296be4547b183a58237a88d3f', '4350969720971726724', '4350969720971726210', '4350969720971738806', '4350969720971740989', '4350969720971739601', '4350969720971741702', '065127dc3d4c4faa82c155158bcd2f95', '4350969720971741972', 'b3e6494697fe46fda2cf38d51f399c63', '4350969720971740546', '4350969720971738445', 'befec544a7314ea39a9ed80869f5e7a7', '8a9f55b8b1bc4188895d0d0333ad84db', '4350969720971735542', '4350969720971732577', '4350969720971728082', '4350969720971741042', 'fe588bbd1c49457693604496d3cc7421', '4350969720971741921', 'ccc33cf2b67e4ea7b2eaef86bada2d8d', '4350969720971733213', 'e9535daa58664ddb9d6c694d542e6515', '4350969720971729831', 'bebd81cae1e54ad79580ec5313aefea6', '4350969720971742153', '4350969720971740785', '2fa20297c7114c6baf2734ca5d8ff686', 'ee821a731d804ecea21347d27dfbc06a', '10ce6045bfb843de99550dd0189c7622', '9513dd9ebf8848e4a5ad216c8a5dd314', '4350969720971729169', '4350969720971728035', '6b61b6f54ef5447b84126cd7f2bc9072', '16f90b9a90814f54aa312f3bcfdcfdb4', '4350969720971741751', '4350969720971740681', '4350969720971739225', 'aabf1b0f68994e098fd8c252aac857af', '4350969720971740368', '4350969720971738197', '09cdc79b33714e71a31fe698b1f13663', '871d8019b8674b7c8a392bd1c2446101', '4350969720971741700', '4350969720971729884', '21668657ea2a41bcb9cca22f3174f08c', '8cec07b9224a443989f26d2d700ae4fb', '7c0f577296e44d4da09eed337130d79d', 'a5044f32f4c44e61809b1336fac9d648', '4350969720971738633', '1f24b82e02ed427b856f2ffc67f0a60c', '4350969720971740928', '4350969720971736246', '4350969720971741103', '5365a3affbd247f69dc5004e533c912c', '298c1b5661ca42ad8c4781e5565716d3', '932034cc29874fb1884e819314df5d72', '3f95a3c96f704015a2682c48edea5bba', '0410583499144ceab5f91a32ac588b8b', '4350969720971727115', '7c9c83d2047648d6a92fc4937cd6dd62', '1c1cbed5c5384536b7e1726da778f95f', '33795cda1b8f486490d202c48ff6d0c9', '18611a7197c643868d711b4a292d0c7b', '4350969720971741833', '4350969720971728160', '4350969720971727326', '1b8eb65561da43cbb408d8699613fc9d', '4350969720971740850', '4350969720971742151', '72a9f898074a4589a3408adb2cd9f077', '4350969720971729040', '682f4760b3d64c5ebcfe114b55b61fb9', '713a4c08e4764c11ba389f124ccd817f', '753ad1caa0d54071991eb92d97402ebb', '4350969720971741714', '896a770bccbe48979235477956a9ebf6', 'd355a992af754fe6ba8543061e512aa9', 'f5669cb13fe541b198232e2ab1e1b1cd', '4350969720971738557', 'dc2ba1c456a3491e837e295e319e7f78', '91e9333462334326bbfc67ca7ffb80dc', 'ccb7067db04945c5a7459ef3f04ddd8a', '534d07833d4f44a1871c79214b854b31', 'e0a9df58fffd4ed8842d27e5ee16f83f', 'cdfd4cadf59e450e8e2837c7811cbc45', '464a59b80134481f9fcaa4ab5477ae74', '4350969720971741808', '2af8e024c3a745e28cc5f11465dc03f7', '4350969720971740413', '438c2351a76045b095cdf9d752110384', '901e74783e9e43d48ae5d0d318786b15', '4350969720971740299', 'db44f771a4264d6b88f28786f33b630b', '4350969720971741039', '360b89e18e1e42089bc87f872ca25759', '01b0eed1cec74da3897b8ca74351faec', 'a986799f01354109af6771f251f1b26c', 'c223cb2161624c20831820f4cef45636', '4350969720971738899', '4350969720971736353', 'd339e57c2a044f7eb0f8a352d6caf157', 'd4085bdd36fc4aea987e5a06b22ebcf0', '4350969720971740085', '7ab1909992aa49d88d6f5a5dcb3e33dc', '4350969720971740855', '1952b432cc6b42fc94c54c23cc376b24', 'd388fca1da024b4a8daf174f7d36f887', '50b4d0d3206c4bc9876af731f8efdaf5', 'dfde2248269b41ebb2f3d321e59bc305', '4350969720971739222', 'a2586641354c4d17b71d7c7106ecaabe', 'fa6df4bb29fb4e2abcae0b49c54d7468', '724fb78286be49a6847f1dac2b1d2eab', 'e92f212568424815a8da51e3485864d6', '4350969720971739101', '4350969720971735441', '61d97779638b4c9b9a94bc1e277f0cc2', '4350969720971741141', '3c27694f766d45df8d9e9edd1960642f', '76c7e1d4b17949d6a6601945d607646c', '2dd3fb4020d443e49cbf6dd10cbef2b0', '4350969720971741536', '4350969720971736174', '4350969720971740246', '4350969720971738869', '4350969720971726578', '4350969720971739219', '4350969720971736190', '5f26e513105a430f8616d922c3760e04', '4350969720971741259', '4350969720971741045', '4350969720971740269', '74ad7db907fa4e3db4dd542988677ec1', 'c0e5817bc2ad4261a3741c65a609decb', '4350969720971732107', '4350969720971738989', 'bca14eaaf61a4939a7731b65426376c4', '4350969720971732398', '4350969720971741256', 'f0decf7560094cdba30530d8e5377633', '7eea1d0724a146589dfb4ff5ee372d51', '4350969720971736408', '44e120c461664e8b95690fa87b322109', '4a8f821b795243499a55a3ad03d9a13f', '4350969720971738381', '4350969720971740861', '4350969720971742160', '24c51e35c5bc4de9bdaba122940e28ba', '4350969720971736523', 'd8eb7ef4cf8e4bcfb2234e4bff73bf9e', '4350969720971740526', '4350969720971736864', '0974dd06577f45a38a01cfb0aca12aba', '0f4f094a5855437b88c13545413e6795', '4350969720971737214', '4350969720971738755', 'a13354b492d247ae922bfdcfeb48b79f', '4350969720971738566', '4350969720971741912', 'd849a78147c54569b112ff1336c4946d', '21947161d5bf458baa5f3ae751b33863', '4350969720971741539', '6fffdc57dbc94f42a998649f48a57a6c', '4350969720972287667', '473c1c0c42294f9fb8296cbb0e9ec08b', '4350969720971739589', '4350969720971741301', '4350969720971742070', '2950f052e16b4a0cb21b70e012f47f76', '4350969720971741635', 'dcff92130cbf4fc0a855204dc9353fa5', '4350969720971741132', '4350969720971740392', '280b41614ae64a328bca343051dc94d2', '4350969720971741242', 'c95f2fe03a5f40308b9efdc1c1eba174', '417143458bca4af68a59375ddaef1b8d', '82c3e190669149178337b1623075f0a6', '4350969720971738371', '12a259d3f374471b8156a5b59b066fad', 'bb1d6540f5ec474da8f7bd7c80e17e05', 'fdca2d6252a74d0f894c302d8febbf8f', '4350969720971738992', '7099e5e7f7c24c6f916f0330a7565dfa', '4350969720971741731', '4350969720971741036', '33c04f8f455d4cc3a317c85c41737cda', '5f83150374f04f02b0c14fd61e2082e7', '4350969720971739771', 'e4e0a50bc919450bba6c6e0150d82a4d', '89915c5aaf614696aa3c50e892ab08a9', 'b70e7d28455741f3a66a31ffe6e91296', '4350969720971740376', '4350969720971729185', '4350969720971740006', 'd72f46a0e10849a7aeded386bfbb1139', '4350969720971740433', '0681e51465b44530b49684e3e02a4112', '4350969720971728460', '4350969720971733045', '4350969720971741194', 'f78566967b06425b8866331453eda8cd', '4350969720971740600', '4350969720971738858', '4350969720971729164', '4350969720971740837', '4350969720971740397', 'bdca5e37a5a2435f94c52ac0667be485', '4350969720971741403', 'f039cc5e16114a6e8f0f8744b082247f', '4350969720971740704', '4350969720971741528', '4350969720971734347', '378a6ee9bfd14d4a901685ea36b87c71', 'a69232618d724648995f4558c8ef511f', '88487941a96c4fb7ae077c52cb021750', 'f1e9c4ab829d4309846fe1b35c1e3711', '4350969720971741840', '4350969720971739774', '4350969720971742201', '6f0e6d3625db44e1a44ea36bd1ece0b7', '332308aa3b3b4355a844bdabb8ad0f6a', '4350969720971733292', '01b700d571b04bd88e6dfdf23f748292', '4350969720971739547', 'b20dc55c7f1c48269249883a9ac9a548', '2c801c8e1c7948f69ac3b4f130d5d3a1', '4350969720971740050', '4350969720971741813', '9095297fa2e44e078ecc57515db252f0', 'caa885f1ea8b4f94bec29e4af3b0b192', '4350969720971741310', '91175b06800d44c7becb46a2f892e31a', '4350969720971725274', 'cf664eaa8bf8463a95da64bef4689d20', '4350969720971738613', '4350969720971738563', '40c9645a1ecc4299b8cec564f1254a3e', '4350969720971741084', 'a5cc8ea928eb4152b8c8c3140965eadb', '1592914c253b43ce826202a1b1ee3a55', 'be693e27a4c74871b0256786a43a7d13', '8d91e8f32a8043bcae4acbf9e7a413e2', '4350969720971741357', '4350969720971740873', 'f4a9fc158fa84549a055077a6a142375', 'd26f01824da345b58e14692cf2936077', '4350969720971726711', '4350969720971740930', '376017a8809243bb90ec99286f994e20', '4350969720971737229', 'f5758258bd6941e2a4b957e35f9c70b9', 'f289e4aa077f4325b84350bec9b72e1c', 'b2103f3cd99f4c55aa52d52ce541a0fb', '9a4e66b553a24913a687602115b6f52e', 'a0af1dafa7cb4f039c19640557850fd9', '4350969720971740707', 'd659a4ec1bf54c70915529749254950f', '73f5169e7d094f9c8b8c2dd84357d7de', '787cd15c684744e9a8bc3c24889fce8b', '4350969720971741968', '4350969720971740834', '10a5891c2f98487eab4f104d9c71b2dd', '4350969720971739347', '4350969720971740394', '4350969720971726881', '4350969720971741077', '4350969720971740977', '4350969720971741307', 'c46eedff40d6401d84d78c714ad2b516', '4350969720971738643', '4350969720971731197', '4350969720971740958', '1eebf203ebbf4dccb1cc8743d6f99873', 'fff824d544764a598a1ceda81ef463f4', '4350969720971741660', 'ab4fcd04d2714112b8d6189bb0df6f6c', '859a96ef7b504d558325050ca3751cb1', '4350969720971741167', 'c8925b67696d4d5ca6f8c81c2409056d', 'a787ab285d724d908f465a71f1ce2b8e', '4350969720971738560', 'a8ed7458db5049b181a6b56f93fa621f', '48b436db04c5455a99d610d390d0fe15', '4350969720971730227', '8db9bd304e3342afb076ca1cb29b146e', 'af5cf174177044f88db35195b25f5d9c', 'd04e5f4eed9b4f2e80e70098c102765b', 'a6b5c825146c43abbf5a5fd92db3eb33', '87795684e2e544888e3433cd0c993c6c', '701bcde552884e2c98b495f6ef91b91f', '4350969720971732182', 'f6018314376e45e6844199ff8564f369', '749d6599becc4272a62b34dcffa6f38d', 'cbb6f748fada4f979a253629288293a1', '4350969720971737622', '4350969720971741785', '4350969720971726297', '28607876433b47c8a38e297f2684ba6c', 'df8f5a3e350143f08aa305c7b3149656', '5c2991455e42496bb23464ca64d66914', '8c34124a022b481e89edd55c04a2aee3', '4350969720971738565', '4350969720971736208', '4350969720971739625', 'df8b259d906f47d59ce367aa8ca22609', 'c1e1b2a784074b5787f127b24cace75d', '4350969720971738382', '4350969720971740921', '4350969720971728559', '4350969720971742020', '4350969720971733920', '90b5f1d8f59d4ad19c9d32498ceb207e', 'f9f9b628e1be446888496dafd803008a', '4350969720971735521', '78f5a6cf495f480681a7515093a6c06e', 'a247d5624b8945ab9816f1c3863b71b3', '7b03306ceb5943df8b819109470ac81b', '4350969720971741899', '9740fc7bdc9248d3a92a474d041b4032', '4350969720971738225', 'f6c2821ba3e143cba725b4f237d0bfb6', '29aed894b9e24039aaf3da30d492d7ea', '65bda307381547d3ab8a75e689080185', 'cc0519c9c135492ca649c91d933c1f12', '4350969720971740966', '585c3a793e1a4378931a108c2431795c', 'bba39308d33343228ad555e283aa29cd', '4350969720971739215', '4350969720971739939', '4350969720971732760', '4350969720971741761', '4350969720971731622', '4350969720971736617', '4350969720971740079', '9e9f3f4eb2d54ea394b521cd49c695d2', '4350969720971740385', '4350969720971741125', 'e56fe674eb7b4596aa7e394d496bff8c', '152ebd9af874482a8c3f8cae6041def0', '5106913043824967bfe5ea19fddaa70f', '4350969720971741989', 'ef138632697d45c896a51c3a13166b7b', '4350969720971742158', '4350969720971740859', '4350969720971740375', '7ab2a88667bb4a34b5c43a9efcbbfe0d', '4350969720971741035', '4350969720971733294', '0c2d1d8113984a5da5164b00e74eb412', '4350969720971739829', '4350969720971739772', '8994e6391ef64f69be6a8a924f9f7943', '4350969720971742207', '511565f5c01c4b4cb5890cb703f57d53', '5823392e054e4d509f135ce10b3917a5', '1a3e132a8251402b980be42e10ac3de7', '4350969720971727413', '4350969720971728222', '4350969720971739529', '4350969720971731695', 'aa1de418bd3e4e89855ef45f5a6d9729', 'bb664d5e8d724b5bb769d0f3a5eeb7bc', '4350969720971738141', '4699a01150e8427c8a19ed843dcf3f8a', 'fce9553117b74840ae63d335b3d23949', '3b85e3feb16842118292c5ed4f313acd', '4350969720971741636', 'c4f72a3ba54144c5b2876e6c1ba7e216', '89f0ee13ea4f4c88ab8bf27e3160bf0d', '84264d162fe24c75b5075727c47edc84', '4350969720971726268', '4350969720971726194', '4350969720971741962', '4350969720971738516', 'e96112df70924eb09d75d05eb387a1d6', '4350969720971740415', '64544331457040a4b0da8e8d57724b70', '4350969720971725676', 'be7db3f603f6434fa31c7750ea4b1932', '4350969720971741849', 'c8e1aceaa40148409387985365da5fb3', 'c1be98636d3d472da9fe3154fc67e047', '4350969720971740856', '4350969720971742157', '4350969720971741226', 'd0a4b9918d4d48dbad6b4263d6c62c41', '4350969720971739965', '94cbe99dff58456b91b1e2a4646ec9e4', '4350969720971726840', '4350969720971742178', '020677a807ff44b691c44b2b681ff5bf', '4350969720971737973', '6a867bc7c4bd4a56841dd95b27208cec', '8d34ee16bcfa4b20b4d36affd570ed3e', '231822c9bfa24d5a958409a6955aad04', '5a876635c0774dd1b4f4d148f82b9d95', '4350969720971742104', '4350969720971740969', '951ccfa273ca426fa3faa7de0fa86b2f', '821dca03ceb24e0ba2b193ed5ee491d2', '3880aa7472954180843efc78cde6afbb', 'c479718e31ea47159c0a1fa234053d3a', '4350969720971732977', 'a5f5ac93677b428aa39edf7b0d7a6250', '4350969720971736443', '74db256a771a44e787bfc37671f535af', 'e3c5aeed33de46fdad04d7e5d948f67e', '4350969720971732534', '4350969720971741992', '4350969720971741535', '4350969720971741142', '4350969720971733093', '217fa5cdf88242aa9de1d3684705597b', '4350969720971740675', '4350969720971733030', '9a1943924c4548cfb9e0d11dc7dbb3a4', 'ad990ae98eac40a9aa31ea0834a14fb9', 'a36f34cd359e4852b52e357f41b7e120', '2a33c60092b84e10918a9014efa3b12a', '1a9ef3cfb9674fc88987bc07002f51ea', 'd7662d5fbeb441f6b17544fd4be09599', 'd3930126e3634a00b1ab299414cc9448', '9ceb6f60f62c4cc8806cdf60d204f8d4', '4350969720971741893', '48ceb94816564a53809a8691f0a69328', 'a16bf92418d040edb927a28761bb0713', '91e3c44ef05c4809ae042d471722f0d6', 'c0850cda0b72475d839fc66b6bbc186a', '4350969720971733035', '63fd6ca92ba94535ac8f971e5da57d13', '4350969720971738773', '1f11ae769df64a81b4f849986e3d6529', '3475515f2f6c44b1ae5f21e7ebf294fb', '4350969720971735794', 'b0a4106dbb8647f8af0c7cf8a8de222c', 'fa2c4b1251694d5e99dedf6085202766', '7d1737fe535e4207932856366d555fba', '4350969720971741004', '4aaf889ffaae4c1a845a612fdd2217be', '2a7ea871fe484517bcf51733577a71b6', '88b1996c5a63441d843b4ed8bd38f7d9', '4350969720971732966', '33a7851bc2be4076bd86b1df0dc56a7b', '4350969720971736952', 'daadc053cb9c44a5a753dc3473be6c9d', 'e8cdc8d0c8904c108b98f5c53899ae56', 'e74633ac82704961a264af9471ea8dde', 'b8880e7c076846db99ae369b67a9a18a', '4350969720971739778', '4350969720971739823', 'd2fb92e3aded48eb978e324953d5ceee', '756de43dae154e6e9027c626aa2f82d9', '4350969720971740784', '7b6a4c893b9841c7a6230d43de80d849', '84ce529f49db4bdaba70d1d410d25cab', 'a633a1f6e2154200b34e1b39184e3c76', '2522d77f61af4b41874d03fb774f18ad', '55e26fb7e90a4dae82584dc8d7a17f81', '64a874b87f1e47e3beb23cafe94b4973', 'f3304f29c7564b83abc10dd963239baf', 'c7ba6fa682af42f48a44103efadc54ed', 'dba73f4b3b2b46d7ae37e8dadae1f994', '4350969720971740545', '0ec2ffe7c9ca4161af3814c795c3b026', '1529ed1148b84ab09ce01656cc7db99e', 'bb30d9fe3205460a85401b0a55c7e8bc', '3db47e1a7cdc48459bfd8d957f506160', '3fc8edbc0d2243fa8b733da82edbcae4', '43f94593bc764e5ba35aed1b6469a075', '7fd78fa2ccfe4c7cb5735a9202339a36', '4350969720971726083', '33e4443ee59b4c69b9bbddce25112189', '4350969720971735796', '4350969720971740929', 'ea1da16c153d462bba16f1138e2e6a2a', 'e537b64f39a04fe08b60a2ccfb8c3584', '92aad42239d64019a48e66ecb96a57e5', '497cbd8864ea4dd88fde5b84a92f0d8a', '4350969720971741885', '95d750ef87be40a590318d52d44da7f4', '86e4764d1d6e4d91a547dee83cb7e11b', '4350969720971738781', '34b036b9a311450684f8675ad2e9c670', 'fad2b118c9eb4a42ab3333aa80e81b13', '4350969720971728036', 'ec5d3c43fb00472a81971f284eaf7ddd', '4350969720971741965', '4350969720971740412', '352b88b8d83a46539627a1b8e08d2711', '3f6aae10df8a4f20bd37ad16a34d42c7', '8b2b7512747742b39844b7e3077e4de0', 'bb31ed03019f424b8b72e86d6020273a', '4350969720971740551', '2c2e3bf62e674aeda8cfaebdabdcf5db', '0ed821595e504492b15c194d9f84247a', '4350969720971740081', '7d6d8e5e72dd4b86928003faaf738cf9', '4350969720971740786', '4350969720971734349', '32906a7b96e241c3a0aaeea2e4dbbbf8', '4350969720971738952', '4350969720971740851', '907e98f990954bb78d5488298a89d8bb', 'cd4bb23dbbd743cf85b6cdcf79995ba2', '98e88a8b15ce4c698b704dcac119d7a5', '4350969720971738556', '2861a4df2c3b456fa99df843247c66b1', '872a4ad3ca434a23bca345ec215f2f2f', 'c5e17558bd4449098ed6a0913083e946', 'bacce37b42114382a8d346c603ba017a', 'f251eacef519433a96d1cedb6bc195a7', '4350969720971726196', '0946e65398ec42339bf8710458cd607f', '8fb4096fae0b42cb9fc74533bacd0bc3', '4350969720971728444', '4350969720971727105', 'b452ad2722df427fb974a278e21faede', '4350969720971739223', '5cfc8083f14d47e9811a2fcb6ef5639b', '65fa1d6098e34fa3a45b19756e16d0c6', '4350969720971741698', '4350969720971737221', '45f3e0e68cbd461ba4cb1175c8034387', '4350969720971740298', '4350969720971738553', 'f260bec23ac04c07ac862f2f8b102979', '4350969720971738978', '5870efac6d9f4b8ba7bc15cfdfec14f6', '1e7d313392a54204998d8372ee0059e5', 'ad29f1f2c7d749b785b012ba9c5fa3a5', 'f47e4798c69041c8b0c15579dac1fdf7', '9660277efbaf4f0b951b88c5dfec27b1', '4350969720971736352', '4350969720971738898', '4350969720971740378', '260afcc10cbb4ecb8959761bc5f9e465', '1843a0ba96c34ab8bfaeffa563e13808', 'ec619fdb1e9142218c6c7c4c6ade91bc', '4350969720971740388', '4350969720971741258', '4350969720971741128', '4350969720971738790', '4350969720971737971', '4350969720971741894', '4350969720971741334', '00d2a04f5fe241f58b186c4329b1bfdf', '4350969720971742106', '4817c0260272483283000345da65740e', '10743a58e22e40b4883a2a04204d862c', 'f9fa0027d0734542ac0b7201e316d5eb', 'dddb052ee8e24ab2baa983d16d4bebdf', '4350969720971741537', '4350969720971741990', '4350969720971741230', '3c199c5d8ab840239a31ecab1cbc8b0f', 'ab2d1d6f8c154800af143b1edf607983', '4350969720971739043', '4350969720971741140', 'bc246de2b24c407196c19f9daac7eddf', '647a6522f6b54c6a8a9c7be2297d55a0', '3a18628600394174899f9d06c5e9a228', 'f76424267e6849ab9f9a1fcab773a893', '4350969720971739627', 'cebe907cfaef4f358f4942901b34d563', '8978938aa12f47199b648027ea37ec65', '4350969720971741353', '4350969720971742022', 'c431c2bdd647452da3cb326191e752fe', '4350969720971742211', '4350969720971729634', '4350969720971740860', '4350969720971742161', '4350969720971735984', '5f94a3e2737b43579fe4dd5720445c26', '4350969720971732786', '4350969720971740527', '4350969720971741538', '6561baa9a89e410194f90b75caf6651e', 'ca904b3639c34943b566ac82d789ee48', '4350969720971738567', '5888f29463434858a07f4cd68efd86a3', '781161bcbac744d0945d25732c720872', '4350969720971739217', '4350969720971740248', '4350969720971741064', '4350969720972287672', '4350969720971740387', '64e6e79795884192bd97dab79d8dd17c', '208f785471d74e38b4e9851f36bd13c8', 'b116544507744460bc8e20a91471e28b', '283349d5310d47cf8f179addea2aae53', 'f283ac2428764e769455143f454d7659', '4350969720971742185', '4f985b1f696941e0ac756a47b8c456d5', '64790c1838054d82933f499dd9539975', '4350969720971729314', 'f46f5353160c49a2b0ef5d77b58ba75f', '4350969720971741037', '4350969720971726982', '4f3a621de52a4b6b8d04daf4d5a7fc4d', '4350969720971739244', '4350969720971740377', '4350969720971738728', 'a6bf71c5b7eb4da7b3d7b42cba30f137', '2f22de1cd6f04f4d9d423371e13485a9', '4350969720972287666', '4350969720971740393', 'eecfff6a3585414e950cab1b9269b8f4', '4350969720971738370', '4350969720971739843', '4350969720971741697', '4350969720971741902', '4350969720971741841', '910e2ae49af945b7bd5f9fd2cd680cab', '6c3f7dd2c3a244aa847409c98d4fcf5e', '4350969720971738745', '4350969720972287687', '835b0bced9af49858834d64eb14c85d3', 'fbb9c6f344a849f0bbd61a3a6281f104', 'd8df0a196e1549708f68a58906a1606f', 'cd78aee8c35248bb98d27827c03b8da6', '51b13c63bf5b45eaa4659d6c395badca', '4350969720971740669', '4350969720971726157', '4350969720971740045', '4350969720971740819', '87de90a24fb144a28b2eb017a78a1c4d', '4350969720971728039', 'ef5a16878ac04b86aecfaaeaf26361a7', '98cc1adf5a7f4c8e85af8d92fe6e0914', '4350969720971736860', 'b40f92e0dbe44944912cb1e4a375dd2b', '4350969720971731662', 'c6a9ee8eb07b4491839ac3f56b752f21', 'eaea43a211f84d1eaa05ffe74d0f20af', '4350969720971731215', '4350969720971740926', '4350969720971741356', '299ac1b2017b4f0eb4d416505a41b49a', '8612342f915249ac9f248896e103cb8d', '4350969720971741721', 'c28279edc4de45bb89d46e1a55529fcb', '4350969720971737314', '6d93693333774bc6a7c2c37c1f386143', '4350969720971732813', 'ccb4dc7e90aa43bc90f73e2ba63cac2a', '86240706a6ce4c02b4ac0315f665abda', '4350969720971741252', '4350969720971740382', '832c058dc9e34e6f815df00ae1c49711', '5967b4f2f9554a5baec87cf1b2236f7c', '4350969720971740961', 'c4cefc776db04d2eaae8fbfe23a8f36a', '4350969720971738862', '4350969720971734955', '5a5e7e3f237e4bbe862489dc199c7e21', '079aefcc099a4971a20380bd7db439e0', 'eabe8e79a64c4216ad5b459cccc60339', '55a9702d7e974ce795b098f5e7fcb76d', '55de0f00d969472f88defef100546122', '88e8e8f26dc944ca911f74f43672e8d5', '4e2c4aeab8ff4991803a49fb09769ea0', '6a3151e83ad640f9b9bcbfc59f90ad76', '9070c14484594ae19503dcaac57dc7e1', '65a52ea81ffe475abe4ecd84fd3f3dee', '66b56cc6d3fb4a25990f5b4eb3164dde', '04bbfcdedea74767ab9f10cf44bf19bc', 'ebcd279f17b340a796cb9080ed4f9175', 'ea32b906c68e4903857ec86f2e05fa5a', '1c3162cc8d27436e94204393547f5abc', '6fe19880d5444aa1a25a4fd2087f99a7', 'ee1135562187463089f2b6088c3ad250', 'a970f118f1574386afa563ac92f6a626', 'ce718a0e52d74eed8e29acea13c389d1', '5bb81774bdc34f9786c057f9982e3097', '597025b597424364ba912309ce959ed4', '8fbc1e4acbe14cbfbd22cb936f29e98a', 'bbfb865f0ef449bc942462700a2ed1ea', '4c1f55ada4d44045a35830a6adfcd31a')
    group by
      tmps.id;
    

    数据源未设置脱敏字段,查询结果如下 image

  • 依照文档进行Yearning初始化时,并没有读取conf.toml文件

    依照文档进行Yearning初始化时,并没有读取conf.toml文件

    Describe the bug 描述Bug

    版本:Yearning-2.2.2-4kstars.linux-amd64.zip

    依照文档修改配置文件后,进行下一步启动,并没有加载到配置文件

    [root@yearning Yearning-go]# ./Yearning -m dial tcp 127.0.0.1:3306: connect: connection refused [root@yearning Yearning-go]# ls conf.toml dist # README Yearning

    To Reproduce 如何复现

    Expected behavior 期望的结果

    Screenshots 截图 image

    Desktop (please complete the following information): 环境

    • OS: [e.g. iOS]
    • Browser [e.g. chrome, safari]
    • Version [e.g. 22]

    Additional context 其他 Add any other context about the problem here.

  • 脱敏字段大小写没匹配上不生效

    脱敏字段大小写没匹配上不生效

    1、脱敏字段:phone

    2、查询语句 select phone from xxxx where id=xxxx //脱敏生效 select Phone from xxxx where id=xxxx //脱敏不生效 select PHONE from xxxx where id=xxxx //脱敏不生效

  • Yearning v1.2.0 正式发布

    Yearning v1.2.0 正式发布

    1.查询支持字段脱敏

    2.支持多级审核

    3.工单定时执行

    4.新增设置页面,减少启动配置项

    5.修复待办事项点击完成后显示的异常问题

    6.修复横向导航标签 首页标签会变更坐标的异常问题

    7.新增一键关闭所有横向导航标签按钮

    8.修复一键生成字典下拉框样式异常的问题

    9.优化翻页

    10.添加执行失败显示

    11.取消跨域限制

    12.允许自定义机房

    13.修复查询bigint字段精度丢失的问题

    14.修复查询blob字段报错的问题

    15.修改前端数据保存方式

    16.修改查询时左侧表名过长的样式问题

    17.优化查询及执行工单时错误提示语句

    18.新增查询审核开关

    19.修复ddl及索引提交空sql后审核检测时错误提示不清晰的问题

    20.修复由于mysql 连接超时时间设置过短而导致查询时限失效的问题

    21.修复sql过多导致的样式问题

    22.新增执行结果自动刷新,不再需要手动刷新

    23.修复ldap用户更改密码后登陆异常的问题

    24.修复了其他影响用户体验的bug

  • 提交数据量太多,导致卡死

    提交数据量太多,导致卡死

    Describe 描述 提交了9个工单,每个工单大概有2w条记录,一共有10多w数据,现在页面卡死,点详情出现网页崩溃的情况,目前无法使用了

    Expected behavior 期望的结果 能否通过更给数据库表,把相关审核订单关闭,目前页面很卡

    Desktop (please complete the following information): 环境

    • Browser chrome
    • Version v3.0.8
  • docker-compose up -d 报错

    docker-compose up -d 报错

    Describe 描述 执行docker-compose up -d 后,yearning容器不断重启,报错如下: goroutine 1 [running]: github.com/gookit/gcli/v2/interact.AnswerIsYes({0x0, 0x0, 0xc0007abbc0}) /Users/henryyee/go/pkg/mod/github.com/gookit/gcli/[email protected]/interact/read.go:76 +0x16c github.com/gookit/gcli/v2/interact.Confirm({0x13bf7d8, 0x116f400}, {0x0, 0x0, 0x0}) /Users/henryyee/go/pkg/mod/github.com/gookit/gcli/[email protected]/interact/interact.go:25 +0x79 Yearning-go/src/service.Migrate() /Users/henryyee/Yearning-go/src/service/migrate.go:59 +0xfd Yearning-go/cmd.glob..func2(0x305f2a0, {0xc00003a050, 0x0, 0x0}) /Users/henryyee/Yearning-go/cmd/cmd.go:29 +0x2c github.com/gookit/gcli/v2.(*Command).execute(0x305f1e0, {0xc00003a050, 0x0, 0x0}) /Users/henryyee/go/pkg/mod/github.com/gookit/gcli/[email protected]/cmd.go:243 +0x104 github.com/gookit/gcli/v2.(*App).doRun(0xc00017cf20, {0x7ffdbda7ff10, 0x7}, {0xc00003a050, 0x0, 0x0}) /Users/henryyee/go/pkg/mod/github.com/gookit/gcli/[email protected]/app_run.go:173 +0x434 github.com/gookit/gcli/v2.(*App).Run(0xc00017cf20) /Users/henryyee/go/pkg/mod/github.com/gookit/gcli/[email protected]/app_run.go:126 +0x2f8 Yearning-go/cmd.Command() /Users/henryyee/Yearning-go/cmd/cmd.go:90 +0x188 main.main() /Users/henryyee/Yearning-go/main.go:21 +0x17 是否已将数据库字符集设置为UTF8/UTF8MB4? [yes|no]:

    To Reproduce 如何复现 version: '3'

    services: yearning: image: chaiyd/yearning:v3.0.1 environment: MYSQL_USER: yearning MYSQL_PASSWORD: ukC2ZkcG_ZTeb MYSQL_ADDR: mysql MYSQL_DB: yearning ports: - 8000:8000 #首次使用请先初始化 command: /bin/bash -c "./Yearning install" volumes: - ./conf.toml:/opt/conf.toml depends_on: - mysql restart: always

    mysql:
        image: mysql:5.7
        environment:
            MYSQL_ROOT_PASSWORD: ukC2ZkcG_ZTeb
            MYSQL_DATABASE: yearning
            MYSQL_USER: yearning
            MYSQL_PASSWORD: ukC2ZkcG_ZTeb
        command:
            - --character-set-server=utf8mb4
            - --collation-server=utf8mb4_unicode_ci
        volumes:
           - ./data/mysql:/var/lib/mysql
    
  • 最小权限时,只有一个数据库的只读权限时,无法获取数据库名

    最小权限时,只有一个数据库的只读权限时,无法获取数据库名

    2019-01-15 14:05:58,853 [MainThread:140047206169480]                       [django.request:118] [ERROR]- Internal Server Error: /api/v1/query_worklf
    Traceback (most recent call last):
      File "/usr/lib/python3.6/site-packages/django/core/handlers/exception.py", line 35, in inner
        response = get_response(request)
      File "/usr/lib/python3.6/site-packages/django/core/handlers/base.py", line 128, in _get_response
        response = self.process_exception_by_middleware(e, request)
      File "/usr/lib/python3.6/site-packages/django/core/handlers/base.py", line 126, in _get_response
        response = wrapped_callback(request, *callback_args, **callback_kwargs)
      File "/usr/lib/python3.6/site-packages/django/views/decorators/csrf.py", line 54, in wrapped_view
        return view_func(*args, **kwargs)
      File "/usr/lib/python3.6/site-packages/django/views/generic/base.py", line 69, in view
        return self.dispatch(request, *args, **kwargs)
      File "/usr/lib/python3.6/site-packages/rest_framework/views.py", line 494, in dispatch
        response = self.handle_exception(exc)
      File "/usr/lib/python3.6/site-packages/rest_framework/views.py", line 454, in handle_exception
        self.raise_uncaught_exception(exc)
      File "/usr/lib/python3.6/site-packages/rest_framework/views.py", line 491, in dispatch
        response = handler(request, *args, **kwargs)
      File "/mnt/src/core/api/serachsql.py", line 283, in put
        db=i['Database']) as f:
    KeyError: 'Database'
    
  • 开启查询审核后,无法审核工单

    开启查询审核后,无法审核工单

    Describe 描述 sql查询审核开启后,查询申请数据源,提交工单后,审核人员看不到提交的审核。

    Screenshots 截图 查询需要提交工单 image

    用户提交14次查询工单 image

    开启查询审核后,admin不显示查工单无法审核,用户无法查询 image

    Desktop (please complete the following information): 环境

    • OS: centos7.9
    • Browser chrome
    • Version 3.1.1
  • 工单审核并执行,但数据库中实际没执行,前端页面一直处于执行中状态

    工单审核并执行,但数据库中实际没执行,前端页面一直处于执行中状态

    Describe 描述 如题,偶现前端页面显示执行中,但数据库实际未执行的情况

    To Reproduce 如何复现 给表添加索引,预计执行5min。页面审核并执行后,在数据库中show processlist,不存在加索引的sql执行

    Expected behavior 期望的结果

    Screenshots 截图

    Desktop (please complete the following information): 环境

    • OS: centos7
    • Browser chrome
    • Version v3.1.0

    Additional context 其他 Add any other context about the problem here. 未设置定时运行

  • 新增lib.GenOSCParams()函数,适配OSC的调用参数

    新增lib.GenOSCParams()函数,适配OSC的调用参数

    当前MySQL数据库实例可能会有自建IDC的实例和阿里云RDS,而Yearning默认的策略只能同时只是一种数据库类型;如果OSC估计配置的是pt-osc,则不管是阿里云RDS还是自建IDC数据库实例,均可正常工作,不需要额外调整。为了扩展Yearning,使其同时支持以上两种数据库类型,采用在配置界面支持自建IDC数据库实例类型,在Yearning层面做扩展,如果是阿里云RDS,则追加对应参数:

    自建IDC的gh-ost参数:gh-ost options 阿里云RDS的gh-ost参数:gh-ost options + "-aliyun-rds -assume-master-host=$ADDR"

  • 自建IDC与云厂商RDS大表DDL兼容性问题

    自建IDC与云厂商RDS大表DDL兼容性问题

    在执行OSC时,且配置gh-ost作为OSC的执行工具时,如果数据库是自建IDC与RDS混合使用时,通过规则配置页面配置的参数无法适配自建IDC与云厂商RDS。针对云厂商的RDS,在原本适用于自建IDC参数的基础上,还需要增加以下参数:

    1. Aliyun:-aliyun-rds
    2. GCP: -gcp
    3. Azure: -azure

    实现思路如下:

    if pt-osc{
    	fmt.Println("正常执行,pt-osc不区分数据库实例类型")
    }else{
    	if aliyun{
    		fmt.Println("新增-aliyun-rds参数")
    	}else if gcp{
    		fmt.Println("新增-gcp”参数")
    	}else if azure{
    		fmt.Println("新增“-azure”参数")
    	}else{
    		fmt.Println("暂不支持的云RDS")
    	}
    }
    
Dumpling is a fast, easy-to-use tool written by Go for dumping data from the database(MySQL, TiDB...) to local/cloud(S3, GCP...) in multifarious formats(SQL, CSV...).

?? Dumpling Dumpling is a tool and a Go library for creating SQL dump from a MySQL-compatible database. It is intended to replace mysqldump and mydump

Nov 9, 2022
WAL-G is an archival restoration tool for PostgreSQL, MySQL/MariaDB, and MS SQL Server (beta for MongoDB and Redis).

WAL-G is an archival restoration tool for PostgreSQL, MySQL/MariaDB, and MS SQL Server (beta for MongoDB and Redis).

Jan 1, 2023
Devcloud-go provides a sql-driver for mysql which named devspore driver and a redis client which named devspore client,

Devcloud-go Devcloud-go provides a sql-driver for mysql which named devspore driver and a redis client which named devspore client, you can use them w

Jun 9, 2022
Mogo: a lightweight browser-based logs analytics and logs search platform for some datasource(ClickHouse, MySQL, etc.)
Mogo: a lightweight browser-based logs analytics and logs search platform for some datasource(ClickHouse, MySQL, etc.)

mogo Mogo is a lightweight browser-based logs analytics and logs search platform

Dec 30, 2022
write APIs using direct SQL queries with no hassle, let's rethink about SQL

SQLer SQL-er is a tiny portable server enables you to write APIs using SQL query to be executed when anyone hits it, also it enables you to define val

Jan 7, 2023
Parses a file and associate SQL queries to a map. Useful for separating SQL from code logic

goyesql This package is based on nleof/goyesql but is not compatible with it any more. This package introduces support for arbitrary tag types and cha

Oct 20, 2021
Go-sql-reader - Go utility to read the externalised sql with predefined tags

go-sql-reader go utility to read the externalised sql with predefined tags Usage

Jan 25, 2022
a powerful mysql toolset with Go
a powerful mysql toolset with Go

go-mysql A pure go library to handle MySQL network protocol and replication. Call for Committer/Maintainer Sorry that I have no enough time to maintai

Dec 28, 2022
Sync MySQL data into elasticsearch
Sync MySQL data into elasticsearch

go-mysql-elasticsearch is a service syncing your MySQL data into Elasticsearch automatically. It uses mysqldump to fetch the origin data at first, the

Dec 30, 2022
A high-performance MySQL proxy

kingshard 中文主页 Overview kingshard is a high-performance proxy for MySQL powered by Go. Just like other mysql proxies, you can use it to split the read

Dec 30, 2022
Golang MySql binary log replication listener

Go MySql binary log replication listener Pure Go Implementation of MySQL replication protocol. This allow you to receive event like insert, update, de

Oct 25, 2022
MySQL replication topology management and HA
MySQL replication topology management and HA

orchestrator [Documentation] orchestrator is a MySQL high availability and replication management tool, runs as a service and provides command line ac

Jan 4, 2023
Vitess is a database clustering system for horizontal scaling of MySQL.

Vitess Vitess is a database clustering system for horizontal scaling of MySQL through generalized sharding. By encapsulating shard-routing logic, Vite

Jan 3, 2023
db-recovery is a tool for recovering MySQL data.

db-recovery is a tool for recovering MySQL data. It is used in scenarios where the database has no backup or binlog. It can parse data files and redo/undo logs to recover data.

Nov 17, 2022
一个使 mysql,pgsql 数据库表自动生成 go struct 的工具

db2go 一个使 mysql、pgsql 数据库表自动生成 go struct 的工具 快速使用 将项目放入到GOPATH/src目录下

Nov 25, 2022
Vitess is a database clustering system for horizontal scaling of MySQL.

Vitess Vitess is a database clustering system for horizontal scaling of MySQL through generalized sharding. By encapsulating shard-routing logic, Vite

Jan 4, 2023
GitHub's Online Schema Migrations for MySQL
GitHub's Online Schema Migrations for MySQL

gh-ost GitHub's online schema migration for MySQL gh-ost is a triggerless online schema migration solution for MySQL. It is testable and provides paus

Jan 4, 2023
Gaea is a mysql proxy, it's developed by xiaomi b2c-dev team.
Gaea is a mysql proxy, it's developed by xiaomi b2c-dev team.

简介 Gaea是小米中国区电商研发部研发的基于mysql协议的数据库中间件,目前在小米商城大陆和海外得到广泛使用,包括订单、社区、活动等多个业务。Gaea支持分库分表、sql路由、读写分离等基本特性,更多详细功能可以参照下面的功能列表。其中分库分表方案兼容了mycat和kingshard两个项目的路

Dec 30, 2022