<div dir="ltr">here is the pgpool.conf<div><br></div><div><br></div><div>listen_addresses = '*'<br>port = 9999<br>pcp_listen_addresses = '*'<br>backend_hostname0 = '**.**.**.**'<br>backend_port0 = 5432<br>backend_weight0 = 1<br>backend_hostname1 = '**.**.**.**'<br>backend_port1 = 5432<br>backend_weight1 = 1<br>load_balance_mode = 'on'<br>master_slave_mode = 'on'<br>master_slave_sub_mode = 'stream'<br>sr_check_period = 10<br>sr_check_user = 'monitor'<br>sr_check_password = 'Monitor@321'<br>sr_check_database = 'monitor'<br>delay_threshold = 10240<br>allow_clear_text_frontend_auth = 'on'<br>pid_file_name = '/u01/app/admin/Postgresql/pgpool/pgpool.pid' # pgpool pid location<br>logging_collector = on<br>log_directory = '/u01/app/admin/Data//PG_LOGS' #pgpool log location<br>log_filename = 'pgpool.log'<br>num_init_children = 30<br>enable_pool_hba = on<br>pool_passwd = '/usr/local/etc/pool_passwd'<br>health_check_period = 30<br>health_check_timeout = 20<br>health_check_user = 'pgbigboss'<br>health_check_password = ''<br>health_check_database = 'postgres'<br>health_check_max_retries = 3<br>health_check_retry_delay = 1<br>connect_timeout = 10000<br>statement_level_load_balance = on<br>use_watchdog = on<br>delegate_ip = '**.**.**.**'<br>if_up_cmd = '/usr/bin/sudo /sbin/ip addr add $_IP_$/21 dev eth0 label eth0:1'<br>if_down_cmd = '/usr/bin/sudo /sbin/ip addr del $_IP_$/21 dev eth0'<br>arping_cmd = '/usr/bin/sudo /usr/sbin/arping -U $_IP_$ -w 1 -I eth0'<br><br><br>hostname0 = '**.**.**.**'<br>wd_port0 = 9000<br>pgpool_port0 = 9999<br><br>hostname1 = '**.**.**.**'<br>wd_port1 = 9000<br>pgpool_port1 = 9999<br><br>heartbeat_hostname0 = '**.**.**.**'<br>heartbeat_port0 = 9694<br>heartbeat_device0 = ''<br><br>heartbeat_hostname1 = '**.**.**.**'<br>heartbeat_port1 = 9694<br>heartbeat_device1 = ''<br><br>wd_heartbeat_keepalive = 2<br>wd_heartbeat_deadtime = 30<br>#trusted_servers = ''<br>trusted_server_command = 'ping -q -c3 3 %h'<br>backend_clustering_mode = 'streaming_replication'<br>enable_consensus_with_half_votes = on<br>failover_require_consensus = on<br>failover_when_quorum_exists = on<br>log_min_messages = 'DEBUG1'<br></div></div><br><div class="gmail_quote gmail_quote_container"><div dir="ltr" class="gmail_attr">On Mon, Dec 23, 2024 at 9:49 AM Mukesh Tanuku <<a href="mailto:mukesh.postgres@gmail.com">mukesh.postgres@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Thanks Tatsuo for giving a response to my ask.<div><br></div><div><b>doubt:</b> Is this because we set a Asynchronous streaming replication on postgresql nodes? </div><div><br></div><div><br></div></div><div><br></div><u>here is the log from pgpool.log</u><div><br></div><div>2024-12-23 04:16:47.896: heart_beat_sender pid 1227256: DEBUG: watchdog heartbeat: send heartbeat signal to <a href="http://10.35.8.21:9694" target="_blank">10.35.8.21:9694</a><br>2024-12-23 04:16:48.087: watchdog pid 1227250: DEBUG: STATE MACHINE INVOKED WITH EVENT = TIMEOUT Current State = LEADER<br>2024-12-23 04:16:49.896: heart_beat_sender pid 1227256: DEBUG: watchdog heartbeat: send heartbeat signal to <a href="http://10.35.8.21:9694" target="_blank">10.35.8.21:9694</a><br>2024-12-23 04:16:51.897: heart_beat_sender pid 1227256: DEBUG: watchdog heartbeat: send heartbeat signal to <a href="http://10.35.8.21:9694" target="_blank">10.35.8.21:9694</a><br>2024-12-23 04:16:53.093: watchdog pid 1227250: DEBUG: STATE MACHINE INVOKED WITH EVENT = COMMAND FINISHED Current State = LEADER<br>2024-12-23 04:16:53.093: watchdog pid 1227250: DEBUG: I am the cluster leader node command finished with status:[COMMAND TIMED OUT] which is success<br>2024-12-23 04:16:53.093: watchdog pid 1227250: DETAIL: The command was sent to 0 nodes and 0 nodes replied to it<br>2024-12-23 04:16:53.897: heart_beat_sender pid 1227256: DEBUG: watchdog heartbeat: send heartbeat signal to <a href="http://10.35.8.21:9694" target="_blank">10.35.8.21:9694</a><br>2024-12-23 04:16:55.898: heart_beat_sender pid 1227256: DEBUG: watchdog heartbeat: send heartbeat signal to <a href="http://10.35.8.21:9694" target="_blank">10.35.8.21:9694</a><br>2024-12-23 04:16:57.108: watchdog pid 1227250: DEBUG: new IPC connection received<br>2024-12-23 04:16:57.108: watchdog pid 1227250: DEBUG: sending watchdog packet to socket:7, type:[7], command ID:0, data Length:34<br>2024-12-23 04:16:57.108: sr_check_worker pid 1227293: DEBUG: watchdog status: 4<br>2024-12-23 04:16:57.108: sr_check_worker pid 1227293: DEBUG: pool_acquire_follow_primary_lock: lock was not held by anyone<br>2024-12-23 04:16:57.108: sr_check_worker pid 1227293: DEBUG: pool_acquire_follow_primary_lock: succeeded in acquiring lock<br>2024-12-23 04:16:57.109: sr_check_worker pid 1227293: DEBUG: SSL is requested but SSL support is not available<br>2024-12-23 04:16:57.112: sr_check_worker pid 1227293: DEBUG: authenticate kind = 0<br>2024-12-23 04:16:57.113: sr_check_worker pid 1227293: DEBUG: authenticate backend: key data received<br>2024-12-23 04:16:57.113: sr_check_worker pid 1227293: DEBUG: authenticate backend: transaction state: I<br>2024-12-23 04:16:57.114: sr_check_worker pid 1227293: DEBUG: SSL is requested but SSL support is not available<br>2024-12-23 04:16:57.120: sr_check_worker pid 1227293: DEBUG: authenticate kind = 0<br>2024-12-23 04:16:57.120: sr_check_worker pid 1227293: DEBUG: authenticate backend: key data received<br>2024-12-23 04:16:57.120: sr_check_worker pid 1227293: DEBUG: authenticate backend: transaction state: I<br>2024-12-23 04:16:57.120: sr_check_worker pid 1227293: DEBUG: do_query: extended:0 query:"SELECT pg_catalog.pg_current_wal_lsn()"<br>2024-12-23 04:16:57.120: sr_check_worker pid 1227293: CONTEXT: while checking replication time lag<br>2024-12-23 04:16:57.121: sr_check_worker pid 1227293: DEBUG: do_query: extended:0 query:"SELECT pg_catalog.pg_last_wal_replay_lsn()"<br>2024-12-23 04:16:57.121: sr_check_worker pid 1227293: CONTEXT: while checking replication time lag<br>2024-12-23 04:16:57.124: sr_check_worker pid 1227293: DEBUG: do_query: extended:0 query:"SELECT application_name, state, sync_state,(EXTRACT(EPOCH FROM replay_lag)*1000000)::BIGINT<br> FROM pg_catalog.pg_stat_replication"<br>2024-12-23 04:16:57.124: sr_check_worker pid 1227293: CONTEXT: while checking replication time lag<br>2024-12-23 04:16:57.127: sr_check_worker pid 1227293: DEBUG: do_query: extended:0 query:"SELECT pg_catalog.pg_is_in_recovery()"<br>2024-12-23 04:16:57.127: sr_check_worker pid 1227293: DEBUG: do_query: extended:0 query:"SELECT pg_catalog.pg_is_in_recovery()"<br>2024-12-23 04:16:57.128: sr_check_worker pid 1227293: DEBUG: verify_backend_node_status: multiple standbys: 1<br>2024-12-23 04:16:57.128: sr_check_worker pid 1227293: DEBUG: verify_backend_node_status: detach_false_primary is off and no additional checking is performed<br>2024-12-23 04:16:57.128: sr_check_worker pid 1227293: DEBUG: node status[0]: 1<br>2024-12-23 04:16:57.128: sr_check_worker pid 1227293: DEBUG: node status[1]: 2<br>2024-12-23 04:16:57.129: sr_check_worker pid 1227293: DEBUG: pool_release_follow_primary_lock called<br>2024-12-23 04:16:57.898: heart_beat_sender pid 1227256: DEBUG: watchdog heartbeat: send heartbeat signal to <a href="http://10.35.8.21:9694" target="_blank">10.35.8.21:9694</a><br>2024-12-23 04:16:58.109: watchdog pid 1227250: DEBUG: STATE MACHINE INVOKED WITH EVENT = TIMEOUT Current State = LEADER<br>2024-12-23 04:16:58.586: child pid 1227259: DEBUG: I am 1227259 accept fd 7<br>2024-12-23 04:16:59.899: heart_beat_sender pid 1227256: DEBUG: watchdog heartbeat: send heartbeat signal to <a href="http://10.35.8.21:9694" target="_blank">10.35.8.21:9694</a><br>2024-12-23 04:17:00.310: [unknown] pid 1227285: DEBUG: I am 1227285 accept fd 7<br>2024-12-23 04:17:00.310: [unknown] pid 1227285: DEBUG: reading startup packet<br>2024-12-23 04:17:00.310: [unknown] pid 1227285: DETAIL: Protocol Major: 1234 Minor: 5679 database: user: <br>2024-12-23 04:17:00.310: [unknown] pid 1227285: DEBUG: selecting backend connection<br>2024-12-23 04:17:00.310: [unknown] pid 1227285: DETAIL: SSLRequest from client<br>2024-12-23 04:17:00.310: [unknown] pid 1227285: DEBUG: SSL is requested but SSL support is not available<br>2024-12-23 04:17:00.312: [unknown] pid 1227285: DEBUG: reading startup packet<br>2024-12-23 04:17:00.312: [unknown] pid 1227285: DETAIL: Protocol Major: 3 Minor: 0 database: postgres user: pgbigboss<br>2024-12-23 04:17:00.312: [unknown] pid 1227285: DEBUG: creating new connection to backend<br>2024-12-23 04:17:00.312: [unknown] pid 1227285: DETAIL: connecting 0 backend<br>2024-12-23 04:17:00.312: [unknown] pid 1227285: DEBUG: creating new connection to backend<br>2024-12-23 04:17:00.312: [unknown] pid 1227285: DETAIL: connecting 1 backend<br>2024-12-23 04:17:00.315: [unknown] pid 1227285: DEBUG: SSL is requested but SSL support is not available<br>2024-12-23 04:17:00.315: [unknown] pid 1227285: DEBUG: SSL is requested but SSL support is not available<br>2024-12-23 04:17:00.321: [unknown] pid 1227285: DEBUG: authentication backend<br>2024-12-23 04:17:00.321: [unknown] pid 1227285: DETAIL: auth kind:0<br>2024-12-23 04:17:00.321: [unknown] pid 1227285: DEBUG: process parameter status<br>2024-12-23 04:17:00.321: [unknown] pid 1227285: DETAIL: backend:0 name:"application_name" value:""<br>2024-12-23 04:17:00.321: [unknown] pid 1227285: DEBUG: process parameter status<br>2024-12-23 04:17:00.321: [unknown] pid 1227285: DETAIL: backend:1 name:"application_name" value:""<br>2024-12-23 04:17:00.321: [unknown] pid 1227285: DEBUG: process parameter status<br>2024-12-23 04:17:00.321: [unknown] pid 1227285: DETAIL: backend:0 name:"client_encoding" value:"UTF8"<br>2024-12-23 04:17:00.321: [unknown] pid 1227285: DEBUG: process parameter status<br>2024-12-23 04:17:00.321: [unknown] pid 1227285: DETAIL: backend:1 name:"client_encoding" value:"UTF8"<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: process parameter status<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: backend:0 name:"DateStyle" value:"ISO, MDY"<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: process parameter status<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: backend:1 name:"DateStyle" value:"ISO, MDY"<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: process parameter status<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: backend:0 name:"default_transaction_read_only" value:"off"<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: process parameter status<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: backend:1 name:"default_transaction_read_only" value:"off"<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: reading message length<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: message length (22) in slot 1 does not match with slot 0(23)<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: process parameter status<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: backend:0 name:"in_hot_standby" value:"off"<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: process parameter status<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: backend:1 name:"in_hot_standby" value:"on"<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: process parameter status<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: backend:0 name:"integer_datetimes" value:"on"<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: process parameter status<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: backend:1 name:"integer_datetimes" value:"on"<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: process parameter status<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: backend:0 name:"IntervalStyle" value:"postgres"<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: process parameter status<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: backend:1 name:"IntervalStyle" value:"postgres"<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: process parameter status<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: backend:0 name:"is_superuser" value:"on"<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: process parameter status<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: backend:1 name:"is_superuser" value:"on"<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: process parameter status<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: backend:0 name:"server_encoding" value:"UTF8"<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: process parameter status<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: backend:1 name:"server_encoding" value:"UTF8"<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: process parameter status<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: backend:0 name:"server_version" value:"15.6"<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: process parameter status<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: backend:1 name:"server_version" value:"15.6"<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: process parameter status<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: backend:0 name:"session_authorization" value:"pgbigboss"<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: process parameter status<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: backend:1 name:"session_authorization" value:"pgbigboss"<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: process parameter status<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: backend:0 name:"standard_conforming_strings" value:"on"<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: process parameter status<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: backend:1 name:"standard_conforming_strings" value:"on"<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: process parameter status<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: backend:0 name:"TimeZone" value:"Etc/UTC"<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: process parameter status<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: backend:1 name:"TimeZone" value:"Etc/UTC"<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: authentication backend<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: cp->info[i]:0x7f54139bcc08 pid:1227327<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: authentication backend<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: cp->info[i]:0x7f54139bcca8 pid:1211355<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: sending backend key data<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: send pid 1211355 to frontend<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DEBUG: selecting load balance node<br>2024-12-23 04:17:00.322: [unknown] pid 1227285: DETAIL: selected backend id is 1<br>2024-12-23 04:17:00.325: [unknown] pid 1227285: DEBUG: decide where to send the query<br>2024-12-23 04:17:00.325: [unknown] pid 1227285: DETAIL: destination = 3 for query= "set client_encoding to 'UTF8'"<br>2024-12-23 04:17:00.325: [unknown] pid 1227285: DEBUG: waiting for query response<br>2024-12-23 04:17:00.325: [unknown] pid 1227285: DETAIL: waiting for backend:0 to complete the query<br>2024-12-23 04:17:00.326: [unknown] pid 1227285: DEBUG: waiting for query response<br>2024-12-23 04:17:00.326: [unknown] pid 1227285: DETAIL: waiting for backend:1 to complete the query<br>2024-12-23 04:17:00.330: [unknown] pid 1227285: DEBUG: decide where to send the query<br>2024-12-23 04:17:00.330: [unknown] pid 1227285: DETAIL: destination = 3 for query= "set CLIENT_MIN_MESSAGES TO 'ERROR'"<br>2024-12-23 04:17:00.330: [unknown] pid 1227285: DEBUG: waiting for query response<br>2024-12-23 04:17:00.330: [unknown] pid 1227285: DETAIL: waiting for backend:0 to complete the query<br>2024-12-23 04:17:00.330: [unknown] pid 1227285: DEBUG: waiting for query response<br>2024-12-23 04:17:00.330: [unknown] pid 1227285: DETAIL: waiting for backend:1 to complete the query<br>2024-12-23 04:17:00.355: [unknown] pid 1227285: DEBUG: checking if query has INSERT INTO, FOR SHARE or FOR UPDATE<br>2024-12-23 04:17:00.355: [unknown] pid 1227285: DETAIL: result = 0<br>2024-12-23 04:17:00.355: [unknown] pid 1227285: DEBUG: decide where to send the query<br>2024-12-23 04:17:00.355: [unknown] pid 1227285: DETAIL: destination = 2 for query= "SELECT 1 FROM pg_roles WHERE rolname = 'tpcc'"<br>2024-12-23 04:17:00.355: [unknown] pid 1227285: DEBUG: do_query: extended:0 query:"SELECT current_setting('transaction_isolation')"<br>2024-12-23 04:17:00.355: [unknown] pid 1227285: CONTEXT: while getting transaction isolation<br>2024-12-23 04:17:00.355: [unknown] pid 1227285: DEBUG: checking load balance preconditions. TSTATE:I writing_transaction:0 failed_transaction:0 isolation:2<br>2024-12-23 04:17:00.356: [unknown] pid 1227285: DETAIL: destination = 2 for query= "SELECT 1 FROM pg_roles WHERE rolname = 'tpcc'"<br>2024-12-23 04:17:00.356: [unknown] pid 1227285: DEBUG: system catalog walker, checking relation "pg_roles"<br>2024-12-23 04:17:00.356: [unknown] pid 1227285: DEBUG: hit local relation cache<br>2024-12-23 04:17:00.356: [unknown] pid 1227285: DETAIL: query:SELECT count(*) FROM pg_catalog.pg_class AS c, pg_catalog.pg_namespace AS n WHERE c.oid = pg_catalog.to_regclass('"%s"<br>') AND c.relnamespace = n.oid AND n.nspname = 'pg_catalog'<br>2024-12-23 04:17:00.356: [unknown] pid 1227285: DEBUG: could not load balance because systems catalogs are used<br>2024-12-23 04:17:00.356: [unknown] pid 1227285: DETAIL: destination = 2 for query= "SELECT 1 FROM pg_roles WHERE rolname = 'tpcc'"<br>2024-12-23 04:17:00.356: [unknown] pid 1227285: DEBUG: waiting for query response<br>2024-12-23 04:17:00.356: [unknown] pid 1227285: DETAIL: waiting for backend:0 to complete the query<br>2024-12-23 04:17:00.360: [unknown] pid 1227285: DEBUG: checking if query has INSERT INTO, FOR SHARE or FOR UPDATE<br>2024-12-23 04:17:00.360: [unknown] pid 1227285: DETAIL: result = 0<br>2024-12-23 04:17:00.360: [unknown] pid 1227285: DEBUG: decide where to send the query<br>2024-12-23 04:17:00.360: [unknown] pid 1227285: DETAIL: destination = 2 for query= "SELECT 1 FROM pg_database WHERE datname = 'tpcc'"<br>2024-12-23 04:17:00.360: [unknown] pid 1227285: DEBUG: checking load balance preconditions. TSTATE:I writing_transaction:0 failed_transaction:0 isolation:2<br>2024-12-23 04:17:00.360: [unknown] pid 1227285: DETAIL: destination = 2 for query= "SELECT 1 FROM pg_database WHERE datname = 'tpcc'"<br>2024-12-23 04:17:00.360: [unknown] pid 1227285: DEBUG: system catalog walker, checking relation "pg_database"<br>2024-12-23 04:17:00.360: [unknown] pid 1227285: DEBUG: hit local relation cache<br>2024-12-23 04:17:00.360: [unknown] pid 1227285: DETAIL: query:SELECT count(*) FROM pg_catalog.pg_class AS c, pg_catalog.pg_namespace AS n WHERE c.oid = pg_catalog.to_regclass('"%s"<br>') AND c.relnamespace = n.oid AND n.nspname = 'pg_catalog'<br>2024-12-23 04:17:00.360: [unknown] pid 1227285: DEBUG: could not load balance because systems catalogs are used<br>2024-12-23 04:17:00.360: [unknown] pid 1227285: DETAIL: destination = 2 for query= "SELECT 1 FROM pg_database WHERE datname = 'tpcc'"<br>2024-12-23 04:17:00.360: [unknown] pid 1227285: DEBUG: waiting for query response<br>2024-12-23 04:17:00.360: [unknown] pid 1227285: DETAIL: waiting for backend:0 to complete the query<br>2024-12-23 04:17:00.363: [unknown] pid 1227285: DEBUG: decide where to send the query<br>2024-12-23 04:17:00.363: [unknown] pid 1227285: DETAIL: destination = 0 for query= "CREATE USER "tpcc" PASSWORD 'tpcc'"<br>2024-12-23 04:17:00.363: [unknown] pid 1227285: DEBUG: waiting for query response<br>2024-12-23 04:17:00.363: [unknown] pid 1227285: DETAIL: waiting for backend:0 to complete the query<br>2024-12-23 04:17:00.382: [unknown] pid 1227285: DEBUG: decide where to send the query<br>2024-12-23 04:17:00.382: [unknown] pid 1227285: DETAIL: destination = 0 for query= "GRANT "tpcc" to "pgbigboss""<br>2024-12-23 04:17:00.382: [unknown] pid 1227285: DEBUG: waiting for query response<br>2024-12-23 04:17:00.382: [unknown] pid 1227285: DETAIL: waiting for backend:0 to complete the query<br>2024-12-23 04:17:00.392: [unknown] pid 1227285: DEBUG: decide where to send the query<br>2024-12-23 04:17:00.392: [unknown] pid 1227285: DETAIL: destination = 0 for query= "CREATE DATABASE "tpcc" OWNER "tpcc""<br>2024-12-23 04:17:00.392: [unknown] pid 1227285: DEBUG: waiting for query response<br>2024-12-23 04:17:00.392: [unknown] pid 1227285: DETAIL: waiting for backend:0 to complete the query<br>2024-12-23 04:17:00.648: [unknown] pid 1227285: DEBUG: decide where to send the query<br>2024-12-23 04:17:00.648: [unknown] pid 1227285: DETAIL: destination = 3 for query= "commit"<br>2024-12-23 04:17:00.648: [unknown] pid 1227285: DEBUG: waiting for query response<br>2024-12-23 04:17:00.648: [unknown] pid 1227285: DETAIL: waiting for backend:0 to complete the query<br>2024-12-23 04:17:00.650: [unknown] pid 1227285: DEBUG: decide where to send the query<br>2024-12-23 04:17:00.650: [unknown] pid 1227285: DETAIL: destination = 3 for query= "DISCARD ALL"<br>2024-12-23 04:17:00.650: [unknown] pid 1227285: DEBUG: waiting for query response<br>2024-12-23 04:17:00.650: [unknown] pid 1227285: DETAIL: waiting for backend:0 to complete the query<br>2024-12-23 04:17:00.651: [unknown] pid 1227285: DEBUG: waiting for query response<br>2024-12-23 04:17:00.651: [unknown] pid 1227285: DETAIL: waiting for backend:1 to complete the query<br>2024-12-23 04:17:00.652: [unknown] pid 1227285: DEBUG: setting backend connection close timer<br>2024-12-23 04:17:00.652: [unknown] pid 1227285: DETAIL: close time 1734927420<br>2024-12-23 04:17:00.653: [unknown] pid 1227285: DEBUG: I am 1227285 accept fd 7<br>2024-12-23 04:17:00.653: [unknown] pid 1227285: DEBUG: reading startup packet<br>2024-12-23 04:17:00.653: [unknown] pid 1227285: DETAIL: Protocol Major: 1234 Minor: 5679 database: user: <br>2024-12-23 04:17:00.653: [unknown] pid 1227285: DEBUG: selecting backend connection<br>2024-12-23 04:17:00.653: [unknown] pid 1227285: DETAIL: SSLRequest from client<br>2024-12-23 04:17:00.653: [unknown] pid 1227285: DEBUG: SSL is requested but SSL support is not available<br>2024-12-23 04:17:00.656: [unknown] pid 1227285: DEBUG: reading startup packet<br>2024-12-23 04:17:00.656: [unknown] pid 1227285: DETAIL: Protocol Major: 3 Minor: 0 database: tpcc user: tpcc<br>2024-12-23 04:17:00.656: [unknown] pid 1227285: DEBUG: creating new connection to backend<br>2024-12-23 04:17:00.656: [unknown] pid 1227285: DETAIL: connecting 0 backend<br>2024-12-23 04:17:00.656: [unknown] pid 1227285: DEBUG: creating new connection to backend<br>2024-12-23 04:17:00.656: [unknown] pid 1227285: DETAIL: connecting 1 backend<br>2024-12-23 04:17:00.657: [unknown] pid 1227285: DEBUG: SSL is requested but SSL support is not available<br>2024-12-23 04:17:00.657: [unknown] pid 1227285: DEBUG: SSL is requested but SSL support is not available<br>2024-12-23 04:17:00.665: [unknown] pid 1227285: DEBUG: authentication backend<br>2024-12-23 04:17:00.665: [unknown] pid 1227285: DETAIL: auth kind:0<br>2024-12-23 04:17:00.665: [unknown] pid 1227285: LOG: pool_read_kind: error message from 1 th backend:database "tpcc" does not exist<br>2024-12-23 04:17:00.665: [unknown] pid 1227285: ERROR: unable to read message kind<br>2024-12-23 04:17:00.665: [unknown] pid 1227285: DETAIL: kind does not match between main(53) slot[1] (45)<br>2024-12-23 04:17:01.899: heart_beat_sender pid 1227256: DEBUG: watchdog heartbeat: send heartbeat signal to <a href="http://10.35.8.21:9694" target="_blank">10.35.8.21:9694</a><br>2024-12-23 04:17:03.113: watchdog pid 1227250: DEBUG: STATE MACHINE INVOKED WITH EVENT = COMMAND FINISHED Current State = LEADER<br>2024-12-23 04:17:03.113: watchdog pid 1227250: DEBUG: I am the cluster leader node command finished with status:[COMMAND TIMED OUT] which is success<br>2024-12-23 04:17:03.113: watchdog pid 1227250: DETAIL: The command was sent to 0 nodes and 0 nodes replied to it<br>2024-12-23 04:17:03.900: heart_beat_sender pid 1227256: DEBUG: watchdog heartbeat: send heartbeat signal to <a href="http://10.35.8.21:9694" target="_blank">10.35.8.21:9694</a></div><div><br></div><div><br></div><div><div>Regards</div><font color="#888888"><div>Mukesh Tanuku</div></font></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Dec 23, 2024 at 9:41 AM Mukesh Tanuku <<a href="mailto:mukesh.postgres@gmail.com" target="_blank">mukesh.postgres@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Thanks Tatsuo for giving a response to my ask.<div><br></div><div>We will share the log soon, we have to capture the log in our next test iteration. </div><div>Is this because we set a Asynchronous streaming replication on postgresql nodes? </div><div><br></div><div>Regards</div><div>Mukesh Tanuku</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Dec 23, 2024 at 7:44 AM Tatsuo Ishii <<a href="mailto:ishii@postgresql.org" target="_blank">ishii@postgresql.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">> Hello Everyone,<br>
> <br>
> We have a Postgres setup in Azure (IAAS) with 2 DB nodes in the cluster and<br>
> pgpool is running on each DB node. We have enabled the watchdog.<br>
> <br>
> What we are doing: We are testing the connectivity to DB cluster via<br>
> HammerDB to apply the load.<br>
> HammerDB is connecting to Delegate IP via 9999 port.<br>
> <br>
> Issue: when we initiate the connection it gives error, but when we<br>
> re-initiate the connection again then it is successful. What could be the<br>
> issue<br>
> <br>
> Error message we are seeing when we initiate the connection for the first<br>
> time.<br>
> <br>
> Error in Virtual User 1: Error: Connection to database failed<br>
> connection to server at "10.35.8.4", port 9999 failed: ERROR: unable to<br>
> read message kind<br>
> DETAIL: kind does not match between main(53) slot[1] (45)<br>
> <br>
> If you want to see any configuration settings that i made, i can share.<br>
> <br>
> Please help me in this regard.<br>
<br>
The error message can be interpreted that primary PostgreSQL sent 0x53<br>
= 'S'(parameter status message) while standby sent 0x45 = 'E' (error<br>
response). Perhaps the parameter status cannot be processed on standby<br>
for some reasons. In order to study the cause of error, I need a<br>
pgpool log with debug level 1 (log_min_messages = debug1). Can you<br>
provide it?<br>
<br>
BTW, cross posting pgpool-general and pgsql-general is not<br>
recommended. Please post to pgpool-general only next time.<br>
<br>
Best reagards,<br>
--<br>
Tatsuo Ishii<br>
SRA OSS K.K.<br>
English: <a href="http://www.sraoss.co.jp/index_en/" rel="noreferrer" target="_blank">http://www.sraoss.co.jp/index_en/</a><br>
Japanese:<a href="http://www.sraoss.co.jp" rel="noreferrer" target="_blank">http://www.sraoss.co.jp</a><br>
</blockquote></div>
</blockquote></div>
</blockquote></div>