[pgpool-general: 8630] Re: FW: PGPOOL SSL setup Issues

Abhishek 1. Garg (Nokia) abhishek.1.garg at nokia.com
Tue Mar 7 13:27:48 JST 2023


  1.  You got an error here "Address already in use".

You need to remove the remaining socket file and restart Pgpool-II again.

How can this be done?



  1.  Version of pgpool and Postgresql

root at sr-vm-abh-2:~# pgpool -v

pgpool-II version 4.3.3 (tamahomeboshi)



PostgreSQL --> Version 12



  1.  Connection to PostgreSQL from PGPOOL server:

root at sr-vm-abh-2:~# psql -h 192.168.0.31 -p 5432 -U pgpool postgres

psql (12.14 (Ubuntu 12.14-1.pgdg22.04+1))

Type "help" for help.



postgres=>



                             root at sr-vm-abh-2:~# psql -h 192.168.0.38 -p 5432 -U pgpool postgres

psql (12.14 (Ubuntu 12.14-1.pgdg22.04+1))

Type "help" for help.



postgres=>



  1.  When SSL is enabled using trust

Database is SSL enabled as per below(hostssl all             all             0.0.0.0/0               trust) :

postgres at sr-vm-abh-4:~$ psql -h localhost

psql (12.14 (Ubuntu 12.14-1.pgdg22.04+1))

SSL connection (protocol: TLSv1.3, cipher: TLS_AES_256_GCM_SHA384, bits: 256, compression: off)

Type "help" for help.

postgres=#



                             PGPOOL is SSL enabled as per below(hostssl all             all             0.0.0.0/0               trust)  and Status checked as per below from one of the nodes:

                             root at sr-vm-abh-2:/var/log/pgpool_log# psql -h localhost -p 9999 -U pgpool postgres -c "show pool_nodes"

node_id |   hostname   | port | status | pg_status | lb_weight |  role   | pg_role | select_cnt | load_balance_node | replication_delay | replication_state | replication_sync_state | last_status_change

---------+--------------+------+--------+-----------+-----------+---------+---------+------------+-------------------+-------------------+-------------------+------------------------+---------------------

0       | 192.168.0.31 | 5432 | up     | up        | 0.500000  | primary | primary | 0          | true              | 0                 |                   |                        | 2023-03-06 15:01:57

1       | 192.168.0.38 | 5432 | up     | up        | 0.500000  | standby | standby | 0          | false             | 0                 | streaming         | async                  | 2023-03-06 15:01:57

(2 rows)





  1.  When SSL is enabled using md5

Database is SSL enabled as per below(hostssl    all             all             0.0.0.0/0            md5 clientcert=1) :

postgres at sr-vm-abh-4:~$ psql -h localhost

psql (12.14 (Ubuntu 12.14-1.pgdg22.04+1))

Type "help" for help.



postgres=#



                             PGPOOL is SSL enabled as per below(hostssl all             all             0.0.0.0/0               trust)  and Status checked as per below from one of the nodes:



                             Error Logs of PGPOOL:

                             2023-03-07 09:53:02.253: heart_beat_receiver pid 81219: LOG:  set SO_REUSEPORT option to the socket

2023-03-07 09:53:02.253: heart_beat_receiver pid 81219: LOG:  creating watchdog heartbeat receive socket.

2023-03-07 09:53:02.253: heart_beat_receiver pid 81219: DETAIL:  set SO_REUSEPORT

2023-03-07 09:53:02.296: main pid 81188: LOG:  find_primary_node: make_persistent_db_connection_noerror failed on node 0

2023-03-07 09:53:02.305: main pid 81188: LOG:  find_primary_node: make_persistent_db_connection_noerror failed on node 1









-----Original Message-----
From: Bo Peng <pengbo at sraoss.co.jp>
Sent: Monday, March 6, 2023 12:49 PM
To: Abhishek 1. Garg (Nokia) <abhishek.1.garg at nokia.com>
Cc: pgpool-general at pgpool.net; Srikant Sharma (Nokia) <srikant.sharma at nokia.com>
Subject: Re: FW: [pgpool-general: 8603] PGPOOL SSL setup Issues





CAUTION: This is an external email. Please be very careful when clicking links or opening attachments. See http://nok.it/ext for additional information.







Hello,



On Mon, 6 Mar 2023 05:14:52 +0000

"Abhishek 1. Garg (Nokia)" <abhishek.1.garg at nokia.com<mailto:abhishek.1.garg at nokia.com>> wrote:



> Steps taken:

>

>

>

>   1.  SSL switched off on both Postgresql servers

>   2.  SSL switched off on both PGPOOL servers

>   3.  pg_hba.conf contains -->  host    all             all             0.0.0.0/0               trust

>   4.  pool_hba.conf contains --> host    all         all         0.0.0.0/0             trust

>

>

>

> Output received from one of the PGPOOL servers(10.182.200.242):

>

>

>

> root at sr-vm-abh-2:/var/log/pgpool_log# psql -h localhost -p 9999 -U pgpool postgres -c "show pool_nodes"

>

> node_id |   hostname   | port | status | pg_status | lb_weight |  role   | pg_role | select_cnt | load_balance_node | replication_delay | replication_state | replication_sync_state | last_status_change

>

> ---------+--------------+------+--------+-----------+-----------+---------+---------+------------+-------------------+-------------------+-------------------+------------------------+---------------------

>

> 0       | 192.168.0.31 | 5432 | up     | up        | 0.500000  | primary | primary | 0          | false             | 0                 |                   |                        | 2023-03-06 09:55:58

>

> 1       | 192.168.0.38 | 5432 | up     | up        | 0.500000  | standby | standby | 0          | true              | 0                 | streaming         | async                  | 2023-03-06 09:55:58

>

> (2 rows)

>

>

>

>

>

> In other PGPOOL server I got error :

>

>

>

> 2023-03-06 10:03:13.616: watchdog pid 278560: LOG:  new IPC connection received

>

> 2023-03-06 10:03:13.616: watchdog pid 278560: LOG:  received the get data request from local pgpool-II on IPC interface

>

> 2023-03-06 10:03:13.616: watchdog pid 278560: LOG:  get data request from local pgpool-II node received on IPC interface is forwarded to leader watchdog node "10.182.200.242:9999 Linux sr-vm-abh-2"

>

> 2023-03-06 10:03:13.616: watchdog pid 278560: DETAIL:  waiting for the reply...

>

> 2023-03-06 10:03:13.617: main pid 278556: LOG:  leader watchdog node "10.182.200.242:9999 Linux sr-vm-abh-2" returned status for 2 backend nodes

>

> 2023-03-06 10:03:13.617: watchdog pid 278560: LOG:  new IPC connection received

>

> 2023-03-06 10:03:13.617: main pid 278556: LOG:  backend:0 is set to UP status

>

> 2023-03-06 10:03:13.617: main pid 278556: DETAIL:  backend:0 is UP on cluster leader "10.182.200.242:9999 Linux sr-vm-abh-2"

>

> 2023-03-06 10:03:13.617: main pid 278556: LOG:  backend:1 is set to UP status

>

> 2023-03-06 10:03:13.617: main pid 278556: DETAIL:  backend:1 is UP on cluster leader "10.182.200.242:9999 Linux sr-vm-abh-2"

>

> 2023-03-06 10:03:13.617: main pid 278556: LOG:  Pgpool-II parent process received SIGUSR1

>

> 2023-03-06 10:03:13.617: main pid 278556: LOG:  Setting up socket for 0.0.0.0:9999

>

> 2023-03-06 10:03:13.618: main pid 278556: FATAL:  failed to create INET domain socket

>

> 2023-03-06 10:03:13.618: main pid 278556: DETAIL:  bind on socket failed with error "Address already in use"



You got an error here "Address already in use".

You need to remove the remaining socket file and restart Pgpool-II again.



Which version of pgpool and PostgreSQL are you using?



As you mentioned in your last email, you had a SSL connection issue.

Could you show the error messages of PostgreSQL when you have SSL connection issue?

And could you try if you could connect to PostgreSQL using psql from the server where pgpool is running?



Regards,





> -----Original Message-----

> From: Bo Peng <pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp>>

> Sent: Wednesday, March 1, 2023 10:46 AM

> To: Abhishek 1. Garg (Nokia) <abhishek.1.garg at nokia.com<mailto:abhishek.1.garg at nokia.com>>

> Cc: pgpool-general at pgpool.net<mailto:pgpool-general at pgpool.net>; Srikant Sharma (Nokia) <srikant.sharma at nokia.com<mailto:srikant.sharma at nokia.com>>

> Subject: Re: FW: [pgpool-general: 8603] PGPOOL SSL setup Issues

>

>

>

>

>

> CAUTION: This is an external email. Please be very careful when clicking links or opening attachments. See http://nok.it/ext for additional information.

>

>

>

>

>

>

>

> Hello,

>

>

>

> It works, if you set:

>

>

>

>     hostssl all         all         0.0.0.0/0             trust

>

>

>

>

>

> It fails, if you set:

>

>

>

>     host all         all         0.0.0.0/0             trust

>

>

>

> Is it correct?

>

>

>

> In your log, it seems only node1 fails.

>

> If the setting of ssl connection is the cause, pgpool should have failed to connect both node0 and node1.

>

> Can you check the log of PostgreSQL node1 if any error occurs?

>

> When ssl is enabed, can you use psql to connect to PostgreSQL using "pgpool" user on the server where pgpool is runnung?

>

>

>

>     [pgpool server]$ psql -h 192.168.0.38 -p 5432 -U pgpool postgres

>

>

>

>

>

> If you turn off ssl, can pgpool connect to both PostgreSQL nodes, and both node0 and node1 are running?

>

> Could you run "show pool_nodes" command?

>

>

>

> On Wed, 1 Mar 2023 04:38:22 +0000

>

> "Abhishek 1. Garg (Nokia)" <abhishek.1.garg at nokia.com<mailto:abhishek.1.garg at nokia.com<mailto:abhishek.1.garg at nokia.com%3cmailto:abhishek.1.garg at nokia.com>>> wrote:

>

>

>

> > Yes,

>

> > It works if ssl turned off in pg_hba.conf and pool_hba.conf

>

> >

>

> > -----Original Message-----

>

> > From: Bo Peng <pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp%3cmailto:pengbo at sraoss.co.jp>>>

>

> > Sent: Wednesday, March 1, 2023 10:05 AM

>

> > To: Abhishek 1. Garg (Nokia) <abhishek.1.garg at nokia.com<mailto:abhishek.1.garg at nokia.com<mailto:abhishek.1.garg at nokia.com%3cmailto:abhishek.1.garg at nokia.com>>>

>

> > Cc: pgpool-general at pgpool.net<mailto:pgpool-general at pgpool.net<mailto:pgpool-general at pgpool.net%3cmailto:pgpool-general at pgpool.net>>; Srikant Sharma (Nokia)

>

> > <srikant.sharma at nokia.com<mailto:srikant.sharma at nokia.com<mailto:srikant.sharma at nokia.com%3cmailto:srikant.sharma at nokia.com>>>

>

> > Subject: Re: FW: [pgpool-general: 8603] PGPOOL SSL setup Issues

>

> >

>

> >

>

> > CAUTION: This is an external email. Please be very careful when clicking links or opening attachments. See http://nok.it/ext for additional information.

>

> >

>

> >

>

> >

>

> > hello,

>

> >

>

> > > As mentioned in earlier email, with ssl turned off, all the connectivity works fine.

>

> > >

>

> > > P.S. -     This setup works fine when pool_hba.conf is updated with below entries, result shown below

>

> > > hostssl all         all         0.0.0.0/0             trust

>

> >

>

> > Have you disable ssl on both side of PostgreSQL <-> Pgpool-II and Pgpool-II <-> client.

>

> >

>

> > You need to turn of ssl in pg_hba.conf and pool_hba.conf.

>

> >

>

> > On Wed, 1 Mar 2023 04:24:27 +0000

>

> > "Abhishek 1. Garg (Nokia)" <abhishek.1.garg at nokia.com<mailto:abhishek.1.garg at nokia.com<mailto:abhishek.1.garg at nokia.com%3cmailto:abhishek.1.garg at nokia.com>>> wrote:

>

> >

>

> > > Hello,

>

> > > As mentioned in earlier email, with ssl turned off, all the connectivity works fine.

>

> > >

>

> > > -----Original Message-----

>

> > > From: Bo Peng <pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp%3cmailto:pengbo at sraoss.co.jp>>>

>

> > > Sent: Wednesday, March 1, 2023 7:14 AM

>

> > > To: Abhishek 1. Garg (Nokia) <abhishek.1.garg at nokia.com<mailto:abhishek.1.garg at nokia.com<mailto:abhishek.1.garg at nokia.com%3cmailto:abhishek.1.garg at nokia.com>>>

>

> > > Cc: pgpool-general at pgpool.net<mailto:pgpool-general at pgpool.net<mailto:pgpool-general at pgpool.net%3cmailto:pgpool-general at pgpool.net>>; Srikant Sharma (Nokia)

>

> > > <srikant.sharma at nokia.com<mailto:srikant.sharma at nokia.com<mailto:srikant.sharma at nokia.com%3cmailto:srikant.sharma at nokia.com>>>

>

> > > Subject: Re: FW: [pgpool-general: 8603] PGPOOL SSL setup Issues

>

> > >

>

> > >

>

> > > CAUTION: This is an external email. Please be very careful when clicking links or opening attachments. See http://nok.it/ext for additional information.

>

> > >

>

> > >

>

> > >

>

> > > Hello,

>

> > >

>

> > > To figure out the cause if it is a SSL connection issue or network issue, could you check if the same error occurs if you turn off ssl connection in PostgreSQL.

>

> > >

>

> > > > Error:

>

> > > > 2023-02-15 13:51:38.201: main pid 46946: LOG:  find_primary_node:

>

> > > > make_persistent_db_connection_noerror failed on node 1

>

> > >

>

> > > Normally pgpool connects to all the backend nodes to find the primary node.

>

> > > But in your log, it failes only when connecting to node1.

>

> > >

>

> > > Any configuration difference between node0 and node1?

>

> > >

>

> > >

>

> > > On Wed, 22 Feb 2023 08:06:12 +0000

>

> > > "Abhishek 1. Garg (Nokia)" <abhishek.1.garg at nokia.com<mailto:abhishek.1.garg at nokia.com<mailto:abhishek.1.garg at nokia.com%3cmailto:abhishek.1.garg at nokia.com>>> wrote:

>

> > >

>

> > > > Unable to share certificates, so sending just .conf files.

>

> > > >

>

> > > > -----Original Message-----

>

> > > > From: Abhishek 1. Garg (Nokia)

>

> > > > Sent: Wednesday, February 22, 2023 1:34 PM

>

> > > > To: Bo Peng <pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp%3cmailto:pengbo at sraoss.co.jp>>>

>

> > > > Cc: pgpool-general at pgpool.net<mailto:pgpool-general at pgpool.net<mailto:pgpool-general at pgpool.net%3cmailto:pgpool-general at pgpool.net>>; Srikant Sharma (Nokia)

>

> > > > <srikant.sharma at nokia.com<mailto:srikant.sharma at nokia.com<mailto:srikant.sharma at nokia.com%3cmailto:srikant.sharma at nokia.com>>>

>

> > > > Subject: RE: [pgpool-general: 8603] PGPOOL SSL setup Issues

>

> > > >

>

> > > > Hello,

>

> > > >

>

> > > > Please refer attached files. Our Postgres DB is ssl enabled so attaching certificates as well.

>

> > > > And we want to achieve PGPOOL with SSL connectivity to Postgres with SSL, using same certificates as attached.

>

> > > >

>

> > > > Regards

>

> > > >

>

> > > > -----Original Message-----

>

> > > > From: Bo Peng <pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp%3cmailto:pengbo at sraoss.co.jp>>>

>

> > > > Sent: Wednesday, February 22, 2023 7:47 AM

>

> > > > To: Abhishek 1. Garg (Nokia) <abhishek.1.garg at nokia.com<mailto:abhishek.1.garg at nokia.com<mailto:abhishek.1.garg at nokia.com%3cmailto:abhishek.1.garg at nokia.com>>>

>

> > > > Cc: pgpool-general at pgpool.net<mailto:pgpool-general at pgpool.net<mailto:pgpool-general at pgpool.net%3cmailto:pgpool-general at pgpool.net>>; Srikant Sharma (Nokia)

>

> > > > <srikant.sharma at nokia.com<mailto:srikant.sharma at nokia.com<mailto:srikant.sharma at nokia.com%3cmailto:srikant.sharma at nokia.com>>>

>

> > > > Subject: Re: [pgpool-general: 8603] PGPOOL SSL setup Issues

>

> > > >

>

> > > > [You don't often get email from pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp%3cmailto:pengbo at sraoss.co.jp>>. Learn why

>

> > > > this is important at https://aka.ms/LearnAboutSenderIdentification

>

> > > > ]

>

> > > >

>

> > > > CAUTION: This is an external email. Please be very careful when clicking links or opening attachments. See http://nok.it/ext for additional information.

>

> > > >

>

> > > >

>

> > > >

>

> > > > Hello,

>

> > > >

>

> > > > Thank you for sharing the configurations.

>

> > > >

>

> > > > > > 2023-02-15 13:51:38.201: main pid 46946: LOG:  find_primary_node:

>

> > > > > > make_persistent_db_connection_noerror failed on node 1

>

> > > >

>

> > > > I think the pool_hba.conf doesn't cause the error above because it is the error between pgpool and postgresql.

>

> > > >

>

> > > > Cloud you share your postgresql.conf and pg_hba.conf?

>

> > > >

>

> > > > On Mon, 20 Feb 2023 04:19:53 +0000 "Abhishek 1. Garg (Nokia)"

>

> > > > <abhishek.1.garg at nokia.com<mailto:abhishek.1.garg at nokia.com<mailto:abhishek.1.garg at nokia.com%3cmailto:abhishek.1.garg at nokia.com>>> wrote:

>

> > > >

>

> > > > > Below are the details

>

> > > > >

>

> > > > >

>

> > > > >

>

> > > > > root at sr-vm-abh-1:/etc/pgpool2# cat pool_passwd

>

> > > > >

>

> > > > > pgpool:TEXTpgpool

>

> > > > >

>

> > > > > postgres:TEXTpostgres

>

> > > > >

>

> > > > > root at sr-vm-abh-1:/etc/pgpool2# pwd

>

> > > > >

>

> > > > > /etc/pgpool2

>

> > > > >

>

> > > > > root at sr-vm-abh-1:/etc/pgpool2#

>

> > > > >

>

> > > > >

>

> > > > >

>

> > > > > -----Original Message-----

>

> > > > > From: Bo Peng <pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp%3cmailto:pengbo at sraoss.co.jp>>>

>

> > > > > Sent: Friday, February 17, 2023 5:53 PM

>

> > > > > To: Abhishek 1. Garg (Nokia) <abhishek.1.garg at nokia.com<mailto:abhishek.1.garg at nokia.com<mailto:abhishek.1.garg at nokia.com%3cmailto:abhishek.1.garg at nokia.com>>>

>

> > > > > Cc: pgpool-general at pgpool.net<mailto:pgpool-general at pgpool.net<mailto:pgpool-general at pgpool.net%3cmailto:pgpool-general at pgpool.net>>; Srikant Sharma (Nokia)

>

> > > > > <srikant.sharma at nokia.com<mailto:srikant.sharma at nokia.com<mailto:srikant.sharma at nokia.com%3cmailto:srikant.sharma at nokia.com>>>

>

> > > > > Subject: Re: [pgpool-general: 8603] PGPOOL SSL setup Issues

>

> > > > >

>

> > > > >

>

> > > > >

>

> > > > > [You don't often get email from

>

> > > > > pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp%3cmailto:pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp%3cmailto:pengbo at sraoss.co.jp%3cmailto:pengbo at sraoss.co.jp%3cmailto:pengbo at sraoss.co.jp>>>. Learn why this

>

> > > > > is important at https://aka.ms/LearnAboutSenderIdentification ]

>

> > > > >

>

> > > > >

>

> > > > >

>

> > > > > Hi,

>

> > > > >

>

> > > > >

>

> > > > >

>

> > > > > > Error:

>

> > > > >

>

> > > > > > 2023-02-15 13:51:38.201: main pid 46946: LOG:  find_primary_node:

>

> > > > > > make_persistent_db_connection_noerror failed on node 1

>

> > > > >

>

> > > > >

>

> > > > >

>

> > > > > Pgpool-II uses the user specified in "sr_check_user" to fine the primary node.

>

> > > > >

>

> > > > > Because sr_check_password is empty, Pgpool-II will read the password from pool_passwd file.

>

> > > > >

>

> > > > > Please check if you have set the password correctly in pool_passwd file?

>

> > > > >

>

> > > > >

>

> > > > >

>

> > > > > -------------------------

>

> > > > >

>

> > > > > sr_check_user = 'pgpool'

>

> > > > >

>

> > > > > sr_check_password = ''

>

> > > > >

>

> > > > > -------------------------

>

> > > > >

>

> > > > >

>

> > > > >

>

> > > > > On Wed, 15 Feb 2023 09:12:52 +0000

>

> > > > >

>

> > > > > "Abhishek 1. Garg (Nokia)" <abhishek.1.garg at nokia.com<mailto:abhishek.1.garg at nokia.com<mailto:abhishek.1.garg at nokia.com%3cmailto:abhishek.1.garg at nokia.com<mailto:abhishek.1.garg at nokia.com%3cmailto:abhishek.1.garg at nokia.com%3cmailto:abhishek.1.garg at nokia.com%3cmailto:abhishek.1.garg at nokia.com>>>> wrote:

>

> > > > >

>

> > > > >

>

> > > > >

>

> > > > > > Hi Team,

>

> > > > >

>

> > > > > >

>

> > > > >

>

> > > > > > We are facing challenges in our Sandbox environment where we are trying to configure 2 PGPOOL nodes with 2 PostgreSQL servers(with Standby Replication).

>

> > > > >

>

> > > > > > Refer attached conf file and logs.

>

> > > > >

>

> > > > > >

>

> > > > >

>

> > > > > > Error:

>

> > > > >

>

> > > > > > 2023-02-15 13:51:38.201: main pid 46946: LOG:  find_primary_node:

>

> > > > > > make_persistent_db_connection_noerror failed on node 1

>

> > > > >

>

> > > > > >

>

> > > > >

>

> > > > > > Can you please suggest?

>

> > > > >

>

> > > > > >

>

> > > > >

>

> > > > > > P.S. -     This setup works fine when pool_hba.conf is updated with below entries, result shown below

>

> > > > >

>

> > > > > > hostssl all         all         0.0.0.0/0             trust

>

> > > > >

>

> > > > > >

>

> > > > >

>

> > > > > > [cid:image001.png at 01D9414B.C5876E00]

>

> > > > >

>

> > > > > >

>

> > > > >

>

> > > > > > Regards

>

> > > > >

>

> > > > > > Abhishek Garg

>

> > > > >

>

> > > > >

>

> > > > >

>

> > > > >

>

> > > > >

>

> > > > > --

>

> > > > >

>

> > > > > Bo Peng <pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp%3cmailto:pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp%3cmailto:pengbo at sraoss.co.jp%3cmailto:pengbo at sraoss.co.jp%3cmailto:pengbo at sraoss.co.jp>>>>

>

> > > > >

>

> > > > > SRA OSS LLC

>

> > > > >

>

> > > > > https://www.sraoss.co.jp/

>

> > > >

>

> > > >

>

> > > > --

>

> > > > Bo Peng <pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp%3cmailto:pengbo at sraoss.co.jp>>>

>

> > > > SRA OSS LLC

>

> > > > https://www.sraoss.co.jp/

>

> > >

>

> > >

>

> > > --

>

> > > Bo Peng <pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp%3cmailto:pengbo at sraoss.co.jp>>>

>

> > > SRA OSS LLC

>

> > > https://www.sraoss.co.jp/

>

> >

>

> >

>

> > --

>

> > Bo Peng <pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp%3cmailto:pengbo at sraoss.co.jp>>>

>

> > SRA OSS LLC

>

> > https://www.sraoss.co.jp/

>

>

>

>

>

> --

>

> Bo Peng <pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp%3cmailto:pengbo at sraoss.co.jp>>>

>

> SRA OSS LLC

>

> https://www.sraoss.co.jp/





--

Bo Peng <pengbo at sraoss.co.jp<mailto:pengbo at sraoss.co.jp>>

SRA OSS LLC

https://www.sraoss.co.jp/
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.pgpool.net/pipermail/pgpool-general/attachments/20230307/daa98fa1/attachment.htm>


More information about the pgpool-general mailing list