当前位置：首页 > article >正文

在shardingsphere执行存储过程

article 2024/11/30 7:04:14

环境：

springboot：2.5.2

数据库：Kingbase金仓V8R6

依赖：

        <dependency>
            <groupId>org.apache.shardingsphere</groupId>
            <artifactId>sharding-jdbc-spring-boot-starter</artifactId>
        </dependency>

        <dependency>
            <groupId>com.kingbase8</groupId>
            <artifactId>kingbase8</artifactId>
            <version>8.6.0</version>
        </dependency>

思路一：获取Connection执行存储过程

折腾了多种方式（EntityManager、DataSource、JdbcTemplate等），发现在shardingsphere环境下，始终不支持存储过程。

原因未知，没有深究出来。

可能是shardingsphere本身就不支持存储过程分片；

也就可能跟shardingsphere版本有问题；

还有可能是跟jdbc驱动包有关系(由于shardingsphere不适配金仓，jdbc驱动依然用的是org.postgresql.Driver)；

... ...

shardingjdbc数据源配置

spring:
    shardingsphere:
        datasource:
            app100:
                driver-class-name: org.postgresql.Driver
                jdbc-url: jdbc:postgresql://IP:端口/数据库?serverTimezone=Asia/Shanghai&useSSL=false
                password: 
                type: com.zaxxer.hikari.HikariDataSource
                username: 
                connection-timeout: 30000
                minimum-idle: 10
                maximum-pool-size: 1000
                idle-timeout: 30000
                pool-name: hikari-100
                max-lifetime: 60000
                connection-test-query: SELECT 1
                leak-detection-threshold: 50000
            app101:
                driver-class-name: org.postgresql.Driver
                jdbc-url: jdbc:postgresql://IP:端口/数据库?serverTimezone=Asia/Shanghai&useSSL=false
                password: 
                type: com.zaxxer.hikari.HikariDataSource
                username: 
                connection-timeout: 30000
                minimum-idle: 10
                maximum-pool-size: 1000
                idle-timeout: 30000
                pool-name: hikari-101
                max-lifetime: 60000
                connection-test-query: SELECT 1
                leak-detection-threshold: 50000
            app102:
                driver-class-name: org.postgresql.Driver
                jdbc-url: jdbc:postgresql://IP:端口/数据库?serverTimezone=Asia/Shanghai&useSSL=false
                password: 
                type: com.zaxxer.hikari.HikariDataSource
                username: 
                connection-timeout: 30000
                minimum-idle: 10
                maximum-pool-size: 1000
                idle-timeout: 30000
                pool-name: hikari-102
                max-lifetime: 60000
                connection-test-query: SELECT 1
                leak-detection-threshold: 50000

换种思路：动态数据源

配置

spring:
    datasource:
        multiPrimary:
            pool-name: 100
            type: com.zaxxer.hikari.HikariDataSource
            connection-timeout: 30000
            minimum-idle: 50
            maximum-pool-size: 1000
            idle-timeout: 30000
            max-lifetime: 60000
            connection-test-query: SELECT 1
            username: 
            password: 
            jdbc-url: jdbc:kingbase8://IP:端口/数据库
            driver-class-name: com.kingbase8.Driver
        multiSecondarys:
            - secondary-101:
              pool-name: 101
              type: com.zaxxer.hikari.HikariDataSource
              connection-timeout: 30000
              minimum-idle: 50
              maximum-pool-size: 1000
              idle-timeout: 30000
              max-lifetime: 60000
              connection-test-query: SELECT 1
              username: 
              password: 
              jdbc-url: jdbc:kingbase8://IP:端口/数据库
              driver-class-name: com.kingbase8.Driver
            - secondary-102:
              pool-name: 102
              type: com.zaxxer.hikari.HikariDataSource
              connection-timeout: 30000
              minimum-idle: 50
              maximum-pool-size: 1000
              idle-timeout: 30000
              max-lifetime: 60000
              connection-test-query: SELECT 1
              username: 
              password: 
              jdbc-url: jdbc:kingbase8://IP:端口/数据库
              driver-class-name: com.kingbase8.Driver

相关配置类源码

public class MultDataSourceUtil {
    private static final ThreadLocal<String> DATASOURCE_KEY = new ThreadLocal<>();

    public static void setDataSourceRoutingKey(String key) {
        DATASOURCE_KEY.set(key);
    }

    public static String getDataSourceRoutingKey() {
        return DATASOURCE_KEY.get();
    }

    public static void clearDataSourceRoutingKey() {
        DATASOURCE_KEY.remove();
    }
}

import com.zaxxer.hikari.HikariDataSource;
import lombok.extern.slf4j.Slf4j;
import org.springframework.boot.context.properties.ConfigurationProperties;
import org.springframework.context.annotation.Bean;
import org.springframework.context.annotation.Configuration;
import org.springframework.context.annotation.Primary;

import java.util.HashMap;
import java.util.Map;

@Slf4j
@ConfigurationProperties("spring.datasource")
@Configuration
public class DataSourceConfig {
    private HikariDataSource multiPrimary;
    private Map<String, HikariDataSource> multiSecondarys = new HashMap<>();

    @Bean
    @Primary
    public DynamicDataSource falsDynamicDataSource() {
        Map<Object, Object> targetDataSources = new HashMap<>();
        multiSecondarys.forEach((key, secondary) -> {
            targetDataSources.put(secondary.getPoolName(), secondary);
        });
        targetDataSources.put(multiPrimary.getPoolName(), multiPrimary);
        DynamicDataSource dynamicDataSource = new DynamicDataSource(multiPrimary, targetDataSources);
        dynamicDataSource.afterPropertiesSet();
        return dynamicDataSource;
    }


    public HikariDataSource getMultiPrimary() {
        return multiPrimary;
    }


    public void setMultiPrimary(HikariDataSource multiPrimary) {
        this.multiPrimary = multiPrimary;
    }

    public Map<String, HikariDataSource> getMultiSecondarys() {
        return multiSecondarys;
    }

    public void setMultiSecondarys(Map<String, HikariDataSource> multiSecondarys) {
        this.multiSecondarys = multiSecondarys;
    }
}

import org.springframework.jdbc.datasource.lookup.AbstractRoutingDataSource;

import javax.sql.DataSource;
import java.util.Map;


public class DynamicDataSource extends AbstractRoutingDataSource {
    public DynamicDataSource() {
        super();
    }

    public DynamicDataSource(DataSource defaultTargetDataSource, Map<Object, Object> targetDataSources) {
        super.setDefaultTargetDataSource(defaultTargetDataSource);
        super.setTargetDataSources(targetDataSources);
        super.afterPropertiesSet();
    }


    @Override
    protected Object determineCurrentLookupKey() {
        return MultDataSourceUtil.getDataSourceRoutingKey();
    }
}

业务类代码

import com.alibaba.fastjson.JSONObject;
import com.zaxxer.hikari.HikariDataSource;
import lombok.extern.slf4j.Slf4j;
import org.apache.commons.lang3.StringUtils;
import org.springframework.stereotype.Service;
import javax.annotation.Resource;
import javax.persistence.EntityManager;
import javax.persistence.PersistenceContext;
import javax.persistence.Query;
import javax.sql.DataSource;
import java.sql.*;
import java.util.Date;
import java.time.Instant;
import java.time.LocalDateTime;
import java.time.ZoneId;
import java.time.format.DateTimeFormatter;
import java.util.*;


@Slf4j
@Service
public class 业务ServiceImpl implements 业务Service {
    @Resource
    private DataSource dataSource;

    @PersistenceContext
    private EntityManager em;

    @Override
    public Map<String, String> zjjhpld(String paramStr) {

        Map<String, String> result = new HashMap<>();
        String msg = "";

        try {
            String orgId = "00320000000000000000";


            // region
            Query query = em.createNativeQuery(" SELECT 字段 FROM 表 where 字段=:orgId AND tenantId=:tenantId ");
            query.setParameter("orgId", orgId);
            query.setParameter("tenantId", tenantId);
            String treeinfoPath = (String) query.getSingleResult();
            System.out.println(treeinfoPath);
            // endregion



            Map<Object, DataSource> dataSourceMap = ((DynamicDataSource) dataSource).getResolvedDataSources();

            for (Map.Entry<Object, DataSource> entry : dataSourceMap.entrySet()) {
                String k = (String) entry.getKey();
                if ("100".equals(k)) {
                    continue;
                }
                DataSource v = entry.getValue();
                HikariDataSource hikariDataSource = (HikariDataSource) v;
                Connection conn = hikariDataSource.getConnection();

                CallableStatement callableStatement = conn.prepareCall("{ call 存储过程(?, ?) }");
                callableStatement.setString(1, orgId);
                callableStatement.registerOutParameter(2, Types.REF_CURSOR);

                callableStatement.execute();

                ResultSet resultSet = (ResultSet) callableStatement.getObject(2);

                while (resultSet.next()) {
                    System.out.println();
                }

                conn.close();
            }

        } catch (Exception e) {
            log.error("出现异常：", e);
        }
        return result;
    }
}

注意：

存储过程可以正常执行了，但是有个问题，第一个查询sql不走shardingjdbc的分库了。

发现获取的数据源已经变成了动态数据源，而不是shardingjdbc的数据源，这样不符合我们的需求。

再换个思路，去掉动态，只留下组装好的数据源

配置类代码：

import com.zaxxer.hikari.HikariDataSource;
import lombok.extern.slf4j.Slf4j;
import org.springframework.boot.context.properties.ConfigurationProperties;
import org.springframework.context.annotation.Configuration;
import java.util.HashMap;
import java.util.Map;

@Slf4j
@ConfigurationProperties("spring.datasource")
@Configuration
public class DataSourceConfig {
    private HikariDataSource multiPrimary;
    private Map<String, HikariDataSource> multiSecondarys = new HashMap<>();

    public HikariDataSource getMultiPrimary() {
        return multiPrimary;
    }


    public void setMultiPrimary(HikariDataSource multiPrimary) {
        this.multiPrimary = multiPrimary;
    }

    public Map<String, HikariDataSource> getMultiSecondarys() {
        return multiSecondarys;
    }

    public void setMultiSecondarys(Map<String, HikariDataSource> multiSecondarys) {
        this.multiSecondarys = multiSecondarys;
    }
}

业务代码：

import com.alibaba.fastjson.JSONObject;
import com.zaxxer.hikari.HikariDataSource;
import lombok.extern.slf4j.Slf4j;
import org.apache.commons.lang3.StringUtils;
import org.springframework.beans.factory.support.DefaultListableBeanFactory;
import org.springframework.stereotype.Service;

import javax.annotation.Resource;
import javax.persistence.EntityManager;
import javax.persistence.PersistenceContext;
import javax.persistence.Query;
import javax.sql.DataSource;
import java.sql.*;
import java.util.Date;
import java.time.Instant;
import java.time.LocalDateTime;
import java.time.ZoneId;
import java.time.format.DateTimeFormatter;
import java.util.*;


@Slf4j
@Service
public class 业务ServiceImpl implements 业务Service {
    @Resource
    private DefaultListableBeanFactory beanFactory;
    @Resource
    private DataSourceConfig dataSourceConfig;

    @Resource
    private DataSource dataSource;

    @PersistenceContext
    private EntityManager em;

    @Override
    public Map<String, String> 业务(String paramStr) {

        Map<String, String> result = new HashMap<>();
        String msg = "";

        try {
            String orgId = "";
            String jhqj = "";


            HikariDataSource multiPrimary = dataSourceConfig.getMultiPrimary();
            Map<String, HikariDataSource> multiSecondarys = dataSourceConfig.getMultiSecondarys();


            /*HikariDataSource dataSource = new HikariDataSource();
            dataSource.setDriverClassName("com.mysql.jdbc.Driver");
            dataSource.setJdbcUrl("jdbc:mysql://localhost:3306/db3?characterEncoding=utf8");
            dataSource.setUsername("root");
            dataSource.setPassword("123456");
            dataSource.getConnection();
            System.out.println("db3 创建完成！");
            beanFactory.registerSingleton("db3", dataSource);*/





            // region
            Query query = em.createNativeQuery(" SELECT 字段 FROM 表 where 条件=:orgId AND tenantId=:tenantId ");
            query.setParameter("orgId", orgId);
            query.setParameter("tenantId", tenantId);
            String val = (String) query.getSingleResult();
            // endregion


            for (Map.Entry<String, HikariDataSource> entry : multiSecondarys.entrySet()) {
                String k = entry.getKey();
                if ("100".equals(k)) {
                    continue;
                }
                DataSource v = entry.getValue();
                HikariDataSource hikariDataSource = (HikariDataSource) v;
                Connection conn = hikariDataSource.getConnection();

                CallableStatement callableStatement = conn.prepareCall("{ call 存储过程(?, ?) }");
                callableStatement.setString(1, orgId);
                callableStatement.registerOutParameter(2, Types.REF_CURSOR);

                callableStatement.execute();

                ResultSet resultSet = (ResultSet) callableStatement.getObject(2);

                while (resultSet.next()) {
                    System.out.println();
                }

                conn.close();
            }
        } catch (Exception e) {
            log.error("出现异常：", e);
        }

        return result;
    }
}

第一个查询依然走shardingjdbc，存储过程可以可以正常执行。

但是执行起来特别慢，暂时无解。

其他分享

动态数据源：集成JPA + MP，具体参考《动态数据源》

JPA配置类

import org.springframework.boot.autoconfigure.domain.EntityScan;
import org.springframework.boot.autoconfigure.orm.jpa.JpaProperties;
import org.springframework.boot.context.properties.EnableConfigurationProperties;
import org.springframework.boot.orm.jpa.EntityManagerFactoryBuilder;
import org.springframework.context.annotation.Bean;
import org.springframework.context.annotation.Configuration;
import org.springframework.context.annotation.Primary;
import org.springframework.data.jpa.repository.config.EnableJpaRepositories;
import org.springframework.orm.jpa.JpaTransactionManager;
import org.springframework.orm.jpa.LocalContainerEntityManagerFactoryBean;
import org.springframework.orm.jpa.SharedEntityManagerCreator;
import org.springframework.transaction.PlatformTransactionManager;

import javax.annotation.Resource;
import javax.persistence.EntityManager;
import javax.persistence.EntityManagerFactory;
import java.util.Map;


@Configuration
@EnableConfigurationProperties(JpaProperties.class)
@EntityScan("com.**.entity")
@EnableJpaRepositories("com.**.repository")
public class JpaExtConfiguration {
    @Resource
    private JpaProperties jpaProperties;

    @Resource
    private DynamicDataSource dynamicDataSource;

    @Bean
    public LocalContainerEntityManagerFactoryBean entityManagerFactoryBean(EntityManagerFactoryBuilder builder) {
        Map<String, String> properties = jpaProperties.getProperties();
        properties.put("hibernate.physical_naming_strategy", "org.springframework.boot.orm.jpa.hibernate.SpringPhysicalNamingStrategy");

        return builder.dataSource(dynamicDataSource).properties(properties).packages("com.**.entity").build();
    }

    @Primary
    @Bean
    public EntityManagerFactory entityManagerFactory(LocalContainerEntityManagerFactoryBean entityManagerFactoryBean) {
        return entityManagerFactoryBean.getObject();
    }

    @Primary
    @Bean
    public PlatformTransactionManager transactionManager(EntityManagerFactory entityManagerFactory) {
        return new JpaTransactionManager(entityManagerFactory);
    }

    @Primary
    @Bean
    public EntityManager entityManager(EntityManagerFactory entityManagerFactory) {
        return SharedEntityManagerCreator.createSharedEntityManager(entityManagerFactory);
    }
}

MP配置类

import com.baomidou.mybatisplus.core.MybatisConfiguration;
import com.baomidou.mybatisplus.core.config.GlobalConfig;
import com.baomidou.mybatisplus.extension.spring.MybatisSqlSessionFactoryBean;
import lombok.extern.slf4j.Slf4j;
import org.apache.ibatis.session.SqlSessionFactory;
import org.mybatis.spring.annotation.MapperScan;
import org.springframework.beans.factory.annotation.Qualifier;
import org.springframework.boot.context.properties.ConfigurationProperties;
import org.springframework.context.annotation.Bean;
import org.springframework.context.annotation.Configuration;

import javax.sql.DataSource;


@MapperScan(sqlSessionFactoryRef = "dynamicDataSourceSqlSessionFactory")
@Configuration
@Slf4j
public class MpExtConfiguration {
    @Bean
    @ConfigurationProperties(prefix = "mybatis-plus.global-config")
    public GlobalConfig globalConfig() {
        return new GlobalConfig();
    }

    @Bean
    @ConfigurationProperties(prefix = "mybatis-plus.configuration")
    public MybatisConfiguration mybatisConfiguration() {
        return new MybatisConfiguration();
    }

    @Bean
    public SqlSessionFactory dynamicDataSourceSqlSessionFactory(@Qualifier("dynamicDataSource") DataSource dynamicDataSource, GlobalConfig globalConfig, MybatisConfiguration mybatisConfiguration) throws Exception {
        MybatisSqlSessionFactoryBean sqlSessionFactoryBean = new MybatisSqlSessionFactoryBean();
        sqlSessionFactoryBean.setDataSource(dynamicDataSource);
        sqlSessionFactoryBean.setGlobalConfig(globalConfig);
        sqlSessionFactoryBean.setConfiguration(mybatisConfiguration);
        return (SqlSessionFactory) sqlSessionFactoryBean.getObject();
    }
}

MP配置

mybatis-plus:
  global-config:
    enable-sql-runner: true
  configuration:
    log-impl: org.apache.ibatis.logging.stdout.StdOutImpl

查看全文

http://www.kler.cn/a/415286.html

处理流—BufferReader和BufferWrite

服务器创建容器时报错: no main manifest attribute

Css—实现3D导航栏

C++ 【异步日志模块和std::cout ＜＜一样使用习惯替代性好】使用示例，后续加上远程日志

什么是串联谐振

透视投影（Perspective projection）与等距圆柱投影（Equirectangular projection）

力扣每日一题单调数组对的数目（dp）

期权懂|期权中的期权到期日引力是什么意思？

TextFSM模板太复杂？ntc-templates让一切变得简单！

Android studio与JS交互

Android Studio 右侧Gradle窗口只有test的task问题解决

pytest+allure生成报告显示loading和404

浅谈C#库之DevExpress

Rust 组织管理

知识点回顾

python的文件操作练习

基于Java Springboot社区助老志愿者服务平台

如何在 GitHub 上下载并切换到仓库的历史版本

Java学习，反射

常用指标采集 exporter

前端网络安全分析

知识蒸馏中有哪些经验| 目标检测 |mobile-yolov5-pruning-distillation项目中剪枝知识分析

在内网工作时，如何使用 vscode remote ssh 去连接内网服务器？

开源项目：纯Python构建的中后台管理系统

解决 YOLOv5 加载模型时 ‘AttributeError Can‘t get attribute ‘SPPF‘‘ 错误的方法

【sqlcipher】pc端sqflite使用过程中遇到的问题

环境：

思路一：获取Connection执行存储过程

换种思路：动态数据源

再换个思路，去掉动态，只留下组装好的数据源

相关文章：