[pgpool-general: 9330] error in first stage of recovery

[Adam Blomeke]

I am working on setting up a new pgpool cluster. I've gotten load balancing working well and am now trying to implement failover and recovery.   I have a two-node cluster running pg15 and using streaming replication. To start with I am merely attempting shut off my secondary server and fail it back. I can manually reattach the node using pcp_attach_node and that works successfully. When I run the pcp_recovery_node command, however, I get the helpful error of:

ERROR: executing recovery, execution of command failed at "1st stage"
DETAIL: command:"/etc/pgpool-II/scripts/replication_mode_recovery_1st_stage.sh"

I figured out that I need to look at my primary server's postgres logs and there I found this:
< usr:repl host:10.6.1.191 time:2025-02-03 16:49:20.627 EST 42883 pid:2098668 >ERROR: function pgpool_recovery(unknown, unknown, unknown, unknown, integer, unknown, unknown) does not exist at character 8
< usr:repl host:10.6.1.191 time:2025-02-03 16:49:20.627 EST 42883 pid:2098668 >HINT: No function matches the given name and argument types. You might need to add explicit type casts.
< usr:repl host:10.6.1.191 time:2025-02-03 16:49:20.627 EST 42883 pid:2098668 >STATEMENT: SELECT pgpool_recovery('/etc/pgpool-II/scripts/replication_mode_recovery_1st_stage.sh, '10.6.1.131', '/opt/data/data15_new', '5433', 1, '5433', '10.6.1.129')

Looking at a prior email chain that went unresolved, I checked my versions and there might be a mismatch:

nasdw_apps=# \dx pgpool_recovery
List of installed extensions
Name | Version | Schema | Description
-----------------+---------+--------+-------------------------------------------
pgpool_recovery | 1.4 | public | recovery functions for pgpool-II for V4.3
(1 row)

If that's the case, I don't know how. It installed version 4.5 when I ran dnf:

[root at awa-prod-db-vm-pg-nasdw-apps ~]# dnf install pgpool-II-pg15-extensions
Updating Subscription Management repositories.
Last metadata expiration check: 0:10:27 ago on Mon 03 Feb 2025 08:57:58 PM UTC.
Dependencies resolved.
===================================================================================================================================================================================
Package Architecture Version Repository Size
===================================================================================================================================================================================
Installing:
pgpool-II-pg15-extensions x86_64 4.5.5-1pgdg.rhel8 pgpool45 53 k

Transaction Summary
===================================================================================================================================================================================
Install 1 Package

Total download size: 53 k
Installed size: 124 k
Is this ok [y/N]: y
Downloading Packages:
pgpool-II-pg15-extensions-4.5.5-1pgdg.rhel8.x86_64.rpm 111 kB/s | 53 kB 00:00
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Total 110 kB/s | 53 kB 00:00
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
Preparing : 1/1
Installing : pgpool-II-pg15-extensions-4.5.5-1pgdg.rhel8.x86_64 1/1
Running scriptlet: pgpool-II-pg15-extensions-4.5.5-1pgdg.rhel8.x86_64 1/1
Verifying : pgpool-II-pg15-extensions-4.5.5-1pgdg.rhel8.x86_64 1/1
Installed products updated.

Installed:
pgpool-II-pg15-extensions-4.5.5-1pgdg.rhel8.x86_64

Complete!


Here's the version of pgpool on the load balancer:
[postgres at awa-prod-db-vm-pgpool1 ~]$ pgpool -v
pgpool-II version 4.5.5 (hotooriboshi)

Let me know if there's anything else that I should submit. I'm using the sample replication_mode_recovery_1st_stage script with variables set for my local DB instances.

Thanks,
Adam


[Volanno]
Adam Blomeke, PSD | Developer/Analyst
Adam.Blomeke at volanno.com<mailto:Adam.Blomeke at volanno.com>
www.volanno.com<http://www.volanno.com/> | Certified WOSB, DBE, ISO 9001:2015

This message is intended only for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged, or exempt from disclosure under applicable Federal or State Law. If the reader of this message is not the intended recipient or the employee or agent responsible for delivering the message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message.




[Volanno]

Adam Blomeke, PSD | Developer/Analyst |
Adam.Blomeke at volanno.com<mailto:Adam.Blomeke at volanno.com> | 202.455.4781 ext. 109
www.volanno.com<http://www.volanno.com/> | Certified WOSB, ISO 9001:2015

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.pgpool.net/pipermail/pgpool-general/attachments/20250204/609ba750/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 6082 bytes
Desc: image001.png
URL: <http://www.pgpool.net/pipermail/pgpool-general/attachments/20250204/609ba750/attachment-0002.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.png
Type: image/png
Size: 7199 bytes
Desc: image002.png
URL: <http://www.pgpool.net/pipermail/pgpool-general/attachments/20250204/609ba750/attachment-0003.png>