[pgpool-general: 9243] Re: PGPOOL load

[Tatsuo Ishii]

As I said earlier:

>> >>>>>> I have no problem with COPY TO 1.2GB table.
>> >>>>>>
>> >>>>>> test=# select pg_size_pretty(pg_relation_size('pgbench_accounts'));
>> >>>>>>     pg_size_pretty
>> >>>>>> ----------------
>> >>>>>>     1281 MB
>> >>>>>> (1 row)
>> >>>>>>
>> >>>>>> test=# copy pgbench_accounts to '/tmp/copy.out';
>> >>>>>> COPY 10000000

This must be similar to what you did. However I was not able to
reproduce your problem. top command showed no load average
increasing. I have no idea...

Best reagards,
--
Tatsuo Ishii
SRA OSS K.K.
English: http://www.sraoss.co.jp/index_en/
Japanese:http://www.sraoss.co.jp

From: Ilko Krastev <ilko.krastev at gmail.com>
Subject: Re: [pgpool-general: 9240] Re: PGPOOL load
Date: Fri, 25 Oct 2024 21:32:54 +0300
Message-ID: <CAEwyY6xn=arA_KyFy1MzraZr0x3BR_2d_OxAb4+umX41oSWrCw at mail.gmail.com>

> The load is happen also if i send a file and there is no other users
> connected.
> 
> On Fri, Oct 25, 2024, 09:19 Tatsuo Ishii <ishii at postgresql.org> wrote:
> 
>> 10 - 60 seconds are not short duration and I suspect many clients are
>> waiting for connecting to pgpool, which could result in the high load
>> average. To confirm this, you can run the COPY without any other
>> clients connected/trying to connect to pgpool. If you do not see the
>> high load problem, then my theory is correct.
>>
>> Best reagards,
>> --
>> Tatsuo Ishii
>> SRA OSS K.K.
>> English: http://www.sraoss.co.jp/index_en/
>> Japanese:http://www.sraoss.co.jp
>>
>> > How long your COPY takes and what's the value for num_init_children?
>> > It depend of the size of file but is between 10 and 60 sec
>> > num_init_children = 480
>> > max_pool = 2
>> >
>> >
>> > On 23.10.24 4:20, Tatsuo Ishii wrote:
>> >> How long your COPY takes and what's the value for num_init_children?
>> >>
>> >> If the COPY takes long time and there are many clients waiting for
>> >> connecting to pgpool, then as soon as the COPY finished and exits the
>> >> session, all pgpool child process will be waken up and it makes the
>> >> load average high.
>> >>
>> >> Best reagards,
>> >> --
>> >> Tatsuo Ishii
>> >> SRA OSS K.K.
>> >> English: http://www.sraoss.co.jp/index_en/
>> >> Japanese:http://www.sraoss.co.jp
>> >>
>> >>> Hi
>> >>>
>> >>> Does pgpool and PostgreSQL run on the same server?
>> >>>
>> >>> No
>> >>>
>> >>> What versions of pgpool and PostgreSQL?
>> >>> Pool version is pgpool-II version 4.3.5 (tamahomeboshi)
>> >>> Postgresql 16
>> >>>
>> >>> On 21.10.24 14:41, Tatsuo Ishii wrote:
>> >>>> Does pgpool and PostgreSQL run on the same server?
>> >>>> What versions of pgpool and PostgreSQL?
>> >>>>
>> >>>> Best reagards,
>> >>>> --
>> >>>> Tatsuo Ishii
>> >>>> SRA OSS K.K.
>> >>>> English: http://www.sraoss.co.jp/index_en/
>> >>>> Japanese:http://www.sraoss.co.jp
>> >>>>
>> >>>>> You can see 1min load every pick is import.
>> >>>>>
>> >>>>> On 21.10.24 13:45, Tatsuo Ishii wrote:
>> >>>>>> Hi,
>> >>>>>>
>> >>>>>>> Hi
>> >>>>>>>
>> >>>>>>> COPY table TO 'file';
>> >>>>>>> COPY table FROM 'file';
>> >>>>>>>
>> >>>>>>> I make it like this, but  has a problem with load of pool.
>> >>>>>> I have no problem with COPY TO 1.2GB table.
>> >>>>>>
>> >>>>>> test=# select pg_size_pretty(pg_relation_size('pgbench_accounts'));
>> >>>>>>     pg_size_pretty
>> >>>>>> ----------------
>> >>>>>>     1281 MB
>> >>>>>> (1 row)
>> >>>>>>
>> >>>>>> test=# copy pgbench_accounts to '/tmp/copy.out';
>> >>>>>> COPY 10000000
>> >>>>>>
>> >>>>>> Is there anything special with your use-case?
>> >>>>>> Maybe large number of cucurrent COPY?
>> >>>>>>
>> >>>>>> Best reagards,
>> >>>>>> --
>> >>>>>> Tatsuo Ishii
>> >>>>>> SRA OSS K.K.
>> >>>>>> English: http://www.sraoss.co.jp/index_en/
>> >>>>>> Japanese:http://www.sraoss.co.jp
>> >>> _______________________________________________
>> >>> pgpool-general mailing list
>> >>> pgpool-general at pgpool.net
>> >>> http://www.pgpool.net/mailman/listinfo/pgpool-general
>> > _______________________________________________
>> > pgpool-general mailing list
>> > pgpool-general at pgpool.net
>> > http://www.pgpool.net/mailman/listinfo/pgpool-general
>>