[pgcluster: 541] リカバリ終了時にエラーが出る

kazunari takahashi kazunari.takahashi @ ctc-g.co.jp
2004年 9月 15日 (水) 11:45:43 JST


高橋です.

リカバリーをすると必ず下記エラーが出力されます.

ERROR(send_recovery_packet): send() failed. (Bad file number)

リカバリー中にクエリを受け付けないようにしています.
また、リカバリー終了後のclusterDB間のデータの整合性は保たれています.
問題ないのでしょうか?
リカバリー終了を知らせるパケットをcluster,loadblancerに投げているのと思い、
設定ファイルを確認したのですが、問題なさそうです.

質問してばかりで大変申し訳ないのですが、
宜しくお願いいたします.

####################################
#環境
####################################
pgcluster-1.0.8RC2

pglb × 1 (solaris8 sparc) host名:pglb
clusterDB ×2 (solaris8 sparc) host名:serverA , serverB
rgrp × 1 (solaris8 sparc) host名:pgrp

####################################
#手順
####################################


-------------------------
1.テーブル作成
-------------------------

test=> create TABLE test(id serial , name varchar(10));
NOTICE:  CREATE TABLE will create implicit sequence 'test_id_seq' for SERIAL column 'test.id'
CREATE TABLE

-------------------------
2.データをclusterDB上からインサート
-------------------------

test=> insert into test(name) values('a');
INSERT 33366 1

2clusterDBとも正常にインサートされる.

----------------------------
3.serverCのpostmasterを落とす
-----------------------------

$ pg_ctl stop -D /usr/local/pgsql/data -m i

----------------------------
4.serverAのpostmasterを起動
----------------------------
serverB% pg_ctl start -D /usr/local/pgsql/data -o "-i -R"
postmaster successfully started
serverB% Start in recovery mode!
-----------------
デバックログ
-----------------

DEBUG(replicate_loop): wait replicate

DEBUG(replicate_loop): replicate main: selected

DEBUG(pgrecovery_loop): recovery accept port 8101

DEBUG(read_packet): receive packet no:1

DEBUG(first_setup_recovery): 1st setup target serverB

DEBUG(first_setup_recovery): 1st setup port 5432

DEBUG(first_setup_recovery): check another recovery process

DEBUG(PGRsem_unlock): add recovery target to host table

DEBUG(send_recovery_packet): set RECOVERY_PGDATA_REQ packet data

DEBUG(PGRsend_replicate_packet_to_server): host(serverA) : port(5432)
DEBUG(getTransactionTbl): not found in getTransactionTbl
DEBUG(pgr_createConn): PQsetdbLogin host[serverA] port[5432] db[template1] user[postgres]
DEBUG(replicate_loop): wait replicate

DEBUG(pgr_createConn): PQsetdbLogin ok!!
DEBUG(insertTransactionTbl): db:template1 port:5432 user:postgres host:serverA query:VACUUM
DEBUG(insertTransactionTbl): sync_command(SELECT PGR_SYSTEM_COMMAND_FUNCTION(3,0,0,2) )
DEBUG(insertTransactionTbl): PQexec send :VACUUM
DEBUG(insertTransactionTbl): PQexec end
DEBUG(getTransactionTbl): hit !! transaction tbl host serverA db:template1 pid:390
DEBUG(getTransactionTbl): send packet to master serverA recoveryPort 8102

DEBUG(PGRsem_unlock): wait answer from master server

DEBUG(read_packet_from_master): wait

DEBUG(read_packet): get answer from master

DEBUG(send_recovery_packet): 1st master serverA - 5432
DEBUG(send_recovery_packet): 1st target serverB - 5432
DEBUG(replicate_loop): wait replicate

DEBUG(replicate_loop): wait replicate

DEBUG(read_packet): receive packet no:5

DEBUG(PGRsend_replicate_packet_to_server): host(serverA) : port(5432)
DEBUG(getTransactionTbl): not found in getTransactionTbl
DEBUG(pgr_createConn): PQsetdbLogin host[serverA] port[5432] db[template1] user[postgres]
DEBUG(pgr_createConn): PQsetdbLogin ok!!
DEBUG(insertTransactionTbl): db:template1 port:5432 user:postgres host:serverA query:VACUUM FULL
DEBUG(insertTransactionTbl): sync_command(SELECT PGR_SYSTEM_COMMAND_FUNCTION(3,0,0,2) )
DEBUG(replicate_loop): wait replicate

DEBUG(insertTransactionTbl): PQexec send :VACUUM FULL
DEBUG(insertTransactionTbl): PQexec end
DEBUG(getTransactionTbl): hit !! transaction tbl host serverA db:template1 pid:390
DEBUG(read_packet_from_master): wait

DEBUG(send_recovery_packet): 2nd master serverA - 5432
DEBUG(send_recovery_packet): 2nd target serverB - 5432
DEBUG(send_recovery_packet): second_setup_recovery end :1
DEBUG(replicate_loop): wait replicate

DEBUG(pgrecovery_loop): recovery accept port 8101

DEBUG(read_packet): receive packet no:9

DEBUG(read_packet): last master serverA - 5432
DEBUG(read_packet): last target serverB - 5432
DEBUG(replicate_loop): wait replicate

DEBUG(PGRsend_queue): master serverA - 5432

DEBUG(PGRget_HostTbl): target serverB - 5432

DEBUG(PGRget_HostTbl): send_queue return status 0

DEBUG(PGRget_HostTbl): PGRsend_queue ok
ERROR(send_recovery_packet): send() failed. (Bad file number)
DEBUG(replicate_loop): wait replicate

DEBUG(replicate_loop): wait replicate


-----------------
cluster.conf
-----------------

serverB% cat cluster.conf
#============================================================
#          Cluster DB Server configuration file
#------------------------------------------------------------
# file: cluster.conf
#------------------------------------------------------------
# This file controls:
#       o which hosts & port are replication server
#       o which port use for replication request to replication server
#       o which command use for recovery function
#============================================================
#------------------------------------------------------------
# set Replication Server information
#               o Host_Name : hostname
#               o Port : connection for postmaster
#               o Recovery_Port : connection for recovery process
#------------------------------------------------------------
<Replicate_Server_Info>
        <Host_Name> pgrp </Host_Name>
        <Port> 8001 </Port>
        <Recovery_Port> 8101 </Recovery_Port>
</Replicate_Server_Info>
#<Replicate_Server_Info>
#       <Host_Name> replicate2.postgres.jp </Host_Name>
#       <Port> 8002 </Port>
#       <Recovery_Port> 8102 </Recovery_Port>
#</Replicate_Server_Info>
#<Replicate_Server_Info>
#       <Host_Name> replicate3.postgres.jp </Host_Name>
#       <Port> 8003 </Port>
#       <Recovery_Port> 8103 </Recovery_Port>
#</Replicate_Server_Info>
#-------------------------------------------------------------
# set Cluster DB Server information
#               o Recovery_Port : connection for recovery
#               o Rsync_Path : path of rsync command
#               o Rsync_Option : file transfer option for rsync
#       o When_Stand_Alone : When all replication servers fell,
#                            you can set up two kinds of permittion,
#                            "real_only" or "read_write".
#-------------------------------------------------------------
<Recovery_Port> 8102 </Recovery_Port>
<Rsync_Path> /usr/local/bin/rsync </Rsync_Path>
<Rsync_Option> ssh -1 </Rsync_Option>
<When_Stand_Alone> read_only  </When_Stand_Alone>
#-------------------------------------------------------------
# set partitional replicate control information
#     set DB name and Table name to stop reprication
#       o DB_Name : DB name
#       o Table_Name : table name
#-------------------------------------------------------------
#<Not_Replicate_Info>
#       <DB_Name>     test_db      </DB_Name>
#       <Table_Name>  log_table    </Table_Name>
#</Not_Replicate_Info>

-----------------
pglb.conf
-----------------

pglb% cat pglb.conf
#============================================================
#          Load Balance Server configuration file
#-------------------------------------------------------------
# file: pglb.conf
#-------------------------------------------------------------
# This file controls:
#       o which hosts are db cluster server
#       o which port  use connect to db cluster server
#       o how many connections are allowed on each DB server
#============================================================
#-------------------------------------------------------------
# set cluster DB server information
#               o Host_Name : hostname
#               o Port : connection for postmaster
#               o Max_Connection : maximun number of connection to postmaster
#-------------------------------------------------------------
<Cluster_Server_Info>
    <Host_Name>   serverB  </Host_Name>
    <Port>        5432                </Port>
    <Max_Connect> 32                   </Max_Connect>
</Cluster_Server_Info>
<Cluster_Server_Info>
    <Host_Name>   serverA   </Host_Name>
    <Port>        5432                </Port>
    <Max_Connect> 32                  </Max_Connect>
</Cluster_Server_Info>
#<Cluster_Server_Info>
#    <Host_Name>   post3.postgres.jp   </Host_Name>
#    <Port>        5432                </Port>
#    <Max_Connect> 32                  </Max_Connect>
#</Cluster_Server_Info>
#-------------------------------------------------------------
# set Load Balance server information
#               o Backend_Socket_Dir : Unix domain socket path for the backend
#               o Receive_Port : connection from client
#               o Recovery_Port : connection for recovery process
#               o Max_Cluster_Num : maximun number of cluster DB servers
#               o Use_Connection_Pooling : use connection pool [yes/no]
#               o Max_Pool_Each_Server : number of pool connections/DB server
#-------------------------------------------------------------
<Backend_Socket_Dir>    /tmp     </Backend_Socket_Dir>
<Receive_Port>          5432     </Receive_Port>
<Recovery_Port>         6001     </Recovery_Port>
<Max_Cluster_Num>        128     </Max_Cluster_Num>
<Use_Connection_Pooling>  no     </Use_Connection_Pooling>

-----------------
pgreplicate.conf
-----------------

pgrp% cat pgreplicate.conf
#=============================================================
#  PGReplicate configuration file
#-------------------------------------------------------------
# file: pgreplicate.conf
#-------------------------------------------------------------
# This file controls:
#       o which hosts & port are cluster server
#       o which port use for replication request from cluster server
#=============================================================
#
#-------------------------------------------------------------
# A setup of Cluster DB(s)
#
#               o Host_Name : The host name of Cluster DB.
#                             -- please write a host name by FQDN.
#                             -- do not write IP address.
#               o Port : The connection port with postmaster.
#               o Recovery_Port : The connection port at the time of
#                                 a recovery sequence .
#-------------------------------------------------------------
<Cluster_Server_Info>
    <Host_Name>   serverA  </Host_Name>
    <Port>        5432                </Port>
    <Recovery_Port>       8102        </Recovery_Port>
</Cluster_Server_Info>
<Cluster_Server_Info>
    <Host_Name>   serverB </Host_Name>
    <Port>        5432                </Port>
    <Recovery_Port>       8102        </Recovery_Port>
</Cluster_Server_Info>
#<Cluster_Server_Info>
#    <Host_Name>   cluster3.postgres.jp   </Host_Name>
#    <Port>        5432                </Port>
#    <Recovery_Port>       7779       </Recovery_Port>
#</Cluster_Server_Info>
#
#-------------------------------------------------------------
# A setup of Load Balance Server
#
#               o Host_Name : The host name of a load balance server.
#                             -- please write a host name by FQDN.
#                             -- do not write IP address.
#               o Recovery_Port : The connection port at the time of
#                                 a recovery sequence .
#-------------------------------------------------------------
<LoadBalance_Server_Info>
        <Host_Name>   pglb  </Host_Name>
        <Recovery_Port>       6001            </Recovery_Port>
</LoadBalance_Server_Info>
#
#------------------------------------------------------------
# A setup of the upper replication server for cascade connection.
#
#               o Host_Name : The host name of Cluster DB.
#                             -- please write a host name by FQDN.
#                             -- do not write IP address.
#               o Port : The connection port with postmaster.
#               o Recovery_Port : The connection port at the time of
#                                 a recovery sequence .
#------------------------------------------------------------
#<Replicate_Server_Info>
#       <Host_Name> upper_replicate.postgres.jp </Host_Name>
#       <Port> 8002 </Port>
#       <Recovery_Port> 8102 </Recovery_Port>
#</Replicate_Server_Info>
#
#-------------------------------------------------------------
# A setup of a replication server
#
#               o Replicate_Port : connection for reprication
#               o Recovery_Port : connection for recovery
#               o Response_mode : timing which returns a response
#                 normal   -- return result of DB which received the query
#                 reliable -- return result after waiting for response of
#                      all Cluster DBs.
#-------------------------------------------------------------
<Replication_Port>    8001            </Replication_Port>
<Recovery_Port>       8101            </Recovery_Port>
<Response_Mode>       reliable          </Response_Mode>


高橋 一成 <kazunari.takahashi @ ctc-g.co.jp>




pgcluster メーリングリストの案内