Dec 07 10:18:04 [533] virtual2-Master crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (5000ms) Dec 07 10:18:04 [533] virtual2-Master crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped Dec 07 10:18:04 [533] virtual2-Master crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED Dec 07 10:18:04 [532] virtual2-Master pengine: info: process_pe_message: Input has not changed since last time, not saving to disk Dec 07 10:18:04 [532] virtual2-Master pengine: notice: unpack_config: On loss of CCM Quorum: Ignore Dec 07 10:18:04 [532] virtual2-Master pengine: info: determine_online_status: Node virtual2-Master is online Dec 07 10:18:04 [532] virtual2-Master pengine: info: determine_online_status: Node virtual2-Slave is online Dec 07 10:18:04 [532] virtual2-Master pengine: info: determine_op_status: Operation monitor found resource BACULA active on virtual2-Master Dec 07 10:18:04 [532] virtual2-Master pengine: info: determine_op_status: Operation monitor found resource BACULA active on virtual2-Slave Dec 07 10:18:04 [532] virtual2-Master pengine: info: native_print: ASTERISK (systemd:asterisk): Started virtual2-Master Dec 07 10:18:04 [532] virtual2-Master pengine: info: native_print: BACULA (systemd:bacula-fd): Started virtual2-Master Dec 07 10:18:04 [532] virtual2-Master pengine: info: native_print: SNMP (systemd:snmpd): Started virtual2-Master Dec 07 10:18:04 [532] virtual2-Master pengine: info: native_print: IPSHARED (ocf::heartbeat:IPaddr2): Started virtual2-Master Dec 07 10:18:04 [532] virtual2-Master pengine: info: LogActions: Leave ASTERISK (Started virtual2-Master) Dec 07 10:18:04 [532] virtual2-Master pengine: info: LogActions: Leave BACULA (Started virtual2-Master) Dec 07 10:18:04 [532] virtual2-Master pengine: info: LogActions: Leave SNMP (Started virtual2-Master) Dec 07 10:18:04 [532] virtual2-Master pengine: info: LogActions: Leave IPSHARED (Started virtual2-Master) Dec 07 10:18:04 [532] virtual2-Master pengine: notice: process_pe_message: Calculated transition 9323, saving inputs in /var/lib/pacemaker/pengine/pe-input-1401.bz2 Dec 07 10:18:04 [533] virtual2-Master crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response Dec 07 10:18:04 [533] virtual2-Master crmd: info: do_te_invoke: Processing graph 9323 (ref=pe_calc-dc-1512634684-9360) derived from /var/lib/pacemaker/pengine/pe-input-1401.bz2 Dec 07 10:18:04 [533] virtual2-Master crmd: notice: run_graph: Transition 9323 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1401.bz2): Complete Dec 07 10:18:04 [533] virtual2-Master crmd: info: do_log: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd Dec 07 10:18:04 [533] virtual2-Master crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd Dec 07 10:18:09 [533] virtual2-Master crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (5000ms) Dec 07 10:18:09 [533] virtual2-Master crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped Dec 07 10:18:09 [533] virtual2-Master crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED Dec 07 10:18:09 [532] virtual2-Master pengine: info: process_pe_message: Input has not changed since last time, not saving to disk Dec 07 10:18:09 [532] virtual2-Master pengine: notice: unpack_config: On loss of CCM Quorum: Ignore Dec 07 10:18:09 [532] virtual2-Master pengine: info: determine_online_status: Node virtual2-Master is online Dec 07 10:18:09 [532] virtual2-Master pengine: info: determine_online_status: Node virtual2-Slave is online Dec 07 10:18:09 [532] virtual2-Master pengine: info: determine_op_status: Operation monitor found resource BACULA active on virtual2-Master Dec 07 10:18:09 [532] virtual2-Master pengine: info: determine_op_status: Operation monitor found resource BACULA active on virtual2-Slave Dec 07 10:18:09 [532] virtual2-Master pengine: info: native_print: ASTERISK (systemd:asterisk): Started virtual2-Master Dec 07 10:18:09 [532] virtual2-Master pengine: info: native_print: BACULA (systemd:bacula-fd): Started virtual2-Master Dec 07 10:18:09 [532] virtual2-Master pengine: info: native_print: SNMP (systemd:snmpd): Started virtual2-Master Dec 07 10:18:09 [532] virtual2-Master pengine: info: native_print: IPSHARED (ocf::heartbeat:IPaddr2): Started virtual2-Master Dec 07 10:18:09 [532] virtual2-Master pengine: info: LogActions: Leave ASTERISK (Started virtual2-Master) Dec 07 10:18:09 [532] virtual2-Master pengine: info: LogActions: Leave BACULA (Started virtual2-Master) Dec 07 10:18:09 [532] virtual2-Master pengine: info: LogActions: Leave SNMP (Started virtual2-Master) Dec 07 10:18:09 [532] virtual2-Master pengine: info: LogActions: Leave IPSHARED (Started virtual2-Master) Dec 07 10:18:09 [532] virtual2-Master pengine: notice: process_pe_message: Calculated transition 9324, saving inputs in /var/lib/pacemaker/pengine/pe-input-1401.bz2 Dec 07 10:18:09 [533] virtual2-Master crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response Dec 07 10:18:09 [533] virtual2-Master crmd: info: do_te_invoke: Processing graph 9324 (ref=pe_calc-dc-1512634689-9361) derived from /var/lib/pacemaker/pengine/pe-input-1401.bz2 Dec 07 10:18:09 [533] virtual2-Master crmd: notice: run_graph: Transition 9324 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1401.bz2): Complete Dec 07 10:18:09 [533] virtual2-Master crmd: info: do_log: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd Dec 07 10:18:09 [533] virtual2-Master crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd Dec 07 10:18:12 [533] virtual2-Master crmd: info: process_lrm_event: Result of monitor operation for ASTERISK on virtual2-Master: 7 (not running) | call=22 key=ASTERISK_monitor_10000 confirmed=false cib-update=9387 Dec 07 10:18:12 [528] virtual2-Master cib: info: cib_process_request: Forwarding cib_modify operation for section status to all (origin=local/crmd/9387) Dec 07 10:18:12 [528] virtual2-Master cib: info: cib_perform_op: Diff: --- 0.76.34 2 Dec 07 10:18:12 [528] virtual2-Master cib: info: cib_perform_op: Diff: +++ 0.76.35 (null) Dec 07 10:18:12 [528] virtual2-Master cib: info: cib_perform_op: + /cib: @num_updates=35 Dec 07 10:18:12 [528] virtual2-Master cib: info: cib_perform_op: ++ /cib/status/node_state[@id='178676749']/lrm[@id='178676749']/lrm_resources/lrm_resource[@id='ASTERISK']: Dec 07 10:18:12 [528] virtual2-Master cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=virtual2-Master/attrd/7, version=0.76.36) Dec 07 10:18:12 [531] virtual2-Master attrd: info: attrd_cib_callback: Update 7 for fail-count-ASTERISK: OK (0) Dec 07 10:18:12 [531] virtual2-Master attrd: info: attrd_cib_callback: Update 7 for fail-count-ASTERISK[virtual2-Master]=1: OK (0) Dec 07 10:18:12 [528] virtual2-Master cib: info: cib_process_request: Forwarding cib_modify operation for section status to all (origin=local/attrd/8) Dec 07 10:18:12 [533] virtual2-Master crmd: info: abort_transition_graph: Transition aborted by status-178676749-fail-count-ASTERISK doing create fail-count-ASTERISK=1: Transient attribute change | cib=0.76.36 source=abort_unless_down:331 path=/cib/status/node_state[@id='178676749']/transient_attributes[@id='178676749']/instance_attributes[@id='status-178676749'] complete=true Dec 07 10:18:12 [528] virtual2-Master cib: info: cib_perform_op: Diff: --- 0.76.36 2 Dec 07 10:18:12 [528] virtual2-Master cib: info: cib_perform_op: Diff: +++ 0.76.37 (null) Dec 07 10:18:12 [528] virtual2-Master cib: info: cib_perform_op: + /cib: @num_updates=37 Dec 07 10:18:12 [528] virtual2-Master cib: info: cib_perform_op: ++ /cib/status/node_state[@id='178676749']/transient_attributes[@id='178676749']/instance_attributes[@id='status-178676749']: Dec 07 10:18:12 [528] virtual2-Master cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=virtual2-Master/attrd/8, version=0.76.37) Dec 07 10:18:12 [531] virtual2-Master attrd: info: attrd_cib_callback: Update 8 for last-failure-ASTERISK: OK (0) Dec 07 10:18:12 [531] virtual2-Master attrd: info: attrd_cib_callback: Update 8 for last-failure-ASTERISK[virtual2-Master]=1512634692: OK (0) Dec 07 10:18:12 [533] virtual2-Master crmd: info: abort_transition_graph: Transition aborted by status-178676749-last-failure-ASTERISK doing create last-failure-ASTERISK=1512634692: Transient attribute change | cib=0.76.37 source=abort_unless_down:331 path=/cib/status/node_state[@id='178676749']/transient_attributes[@id='178676749']/instance_attributes[@id='status-178676749'] complete=true Dec 07 10:18:12 [532] virtual2-Master pengine: notice: unpack_config: On loss of CCM Quorum: Ignore Dec 07 10:18:12 [532] virtual2-Master pengine: info: determine_online_status: Node virtual2-Master is online Dec 07 10:18:12 [532] virtual2-Master pengine: info: determine_online_status: Node virtual2-Slave is online Dec 07 10:18:12 [532] virtual2-Master pengine: info: get_failcount_full: ASTERISK has failed 1 times on virtual2-Master Dec 07 10:18:12 [532] virtual2-Master pengine: info: get_failcount_full: ASTERISK has failed 1 times on virtual2-Master Dec 07 10:18:12 [532] virtual2-Master pengine: info: get_failcount_full: ASTERISK has failed 1 times on virtual2-Master Dec 07 10:18:12 [532] virtual2-Master pengine: info: get_failcount_full: ASTERISK has failed 1 times on virtual2-Master Dec 07 10:18:12 [532] virtual2-Master pengine: warning: unpack_rsc_op_failure: Processing failed op monitor for ASTERISK on virtual2-Master: not running (7) Dec 07 10:18:12 [532] virtual2-Master pengine: info: determine_op_status: Operation monitor found resource BACULA active on virtual2-Master Dec 07 10:18:12 [532] virtual2-Master pengine: info: determine_op_status: Operation monitor found resource BACULA active on virtual2-Slave Dec 07 10:18:12 [532] virtual2-Master pengine: info: native_print: ASTERISK (systemd:asterisk): FAILED virtual2-Master Dec 07 10:18:12 [532] virtual2-Master pengine: info: native_print: BACULA (systemd:bacula-fd): Started virtual2-Master Dec 07 10:18:12 [532] virtual2-Master pengine: info: native_print: SNMP (systemd:snmpd): Started virtual2-Master Dec 07 10:18:12 [532] virtual2-Master pengine: info: native_print: IPSHARED (ocf::heartbeat:IPaddr2): Started virtual2-Master Dec 07 10:18:12 [532] virtual2-Master pengine: info: get_failcount_full: ASTERISK has failed 1 times on virtual2-Master Dec 07 10:18:12 [532] virtual2-Master pengine: info: check_migration_threshold: ASTERISK can fail 9 more times on virtual2-Master before being forced off Dec 07 10:18:12 [532] virtual2-Master pengine: info: RecurringOp: Start recurring monitor (10s) for ASTERISK on virtual2-Master Dec 07 10:18:12 [532] virtual2-Master pengine: notice: LogActions: Recover ASTERISK (Started virtual2-Master) Dec 07 10:18:12 [532] virtual2-Master pengine: info: LogActions: Leave BACULA (Started virtual2-Master) Dec 07 10:18:12 [532] virtual2-Master pengine: notice: LogActions: Restart SNMP (Started virtual2-Master) Dec 07 10:18:12 [532] virtual2-Master pengine: info: LogActions: Leave IPSHARED (Started virtual2-Master) Dec 07 10:18:12 [532] virtual2-Master pengine: notice: process_pe_message: Calculated transition 9325, saving inputs in /var/lib/pacemaker/pengine/pe-input-1402.bz2 Dec 07 10:18:12 [533] virtual2-Master crmd: info: handle_response: pe_calc calculation pe_calc-dc-1512634692-9362 is obsolete Dec 07 10:18:12 [532] virtual2-Master pengine: notice: unpack_config: On loss of CCM Quorum: Ignore Dec 07 10:18:12 [532] virtual2-Master pengine: info: determine_online_status: Node virtual2-Master is online Dec 07 10:18:12 [532] virtual2-Master pengine: info: determine_online_status: Node virtual2-Slave is online Dec 07 10:18:12 [532] virtual2-Master pengine: info: get_failcount_full: ASTERISK has failed 1 times on virtual2-Master Dec 07 10:18:12 [532] virtual2-Master pengine: info: get_failcount_full: ASTERISK has failed 1 times on virtual2-Master Dec 07 10:18:12 [532] virtual2-Master pengine: info: get_failcount_full: ASTERISK has failed 1 times on virtual2-Master Dec 07 10:18:12 [532] virtual2-Master pengine: info: get_failcount_full: ASTERISK has failed 1 times on virtual2-Master Dec 07 10:18:12 [532] virtual2-Master pengine: warning: unpack_rsc_op_failure: Processing failed op monitor for ASTERISK on virtual2-Master: not running (7) Dec 07 10:18:12 [532] virtual2-Master pengine: info: determine_op_status: Operation monitor found resource BACULA active on virtual2-Master Dec 07 10:18:12 [532] virtual2-Master pengine: info: determine_op_status: Operation monitor found resource BACULA active on virtual2-Slave Dec 07 10:18:12 [532] virtual2-Master pengine: info: native_print: ASTERISK (systemd:asterisk): FAILED virtual2-Master Dec 07 10:18:12 [532] virtual2-Master pengine: info: native_print: BACULA (systemd:bacula-fd): Started virtual2-Master Dec 07 10:18:12 [532] virtual2-Master pengine: info: native_print: SNMP (systemd:snmpd): Started virtual2-Master Dec 07 10:18:12 [532] virtual2-Master pengine: info: native_print: IPSHARED (ocf::heartbeat:IPaddr2): Started virtual2-Master Dec 07 10:18:12 [532] virtual2-Master pengine: info: get_failcount_full: ASTERISK has failed 1 times on virtual2-Master Dec 07 10:18:12 [532] virtual2-Master pengine: info: check_migration_threshold: ASTERISK can fail 9 more times on virtual2-Master before being forced off Dec 07 10:18:12 [532] virtual2-Master pengine: info: RecurringOp: Start recurring monitor (10s) for ASTERISK on virtual2-Master Dec 07 10:18:12 [532] virtual2-Master pengine: notice: LogActions: Recover ASTERISK (Started virtual2-Master) Dec 07 10:18:12 [532] virtual2-Master pengine: info: LogActions: Leave BACULA (Started virtual2-Master) Dec 07 10:18:12 [532] virtual2-Master pengine: notice: LogActions: Restart SNMP (Started virtual2-Master) Dec 07 10:18:12 [532] virtual2-Master pengine: info: LogActions: Leave IPSHARED (Started virtual2-Master) Dec 07 10:18:12 [533] virtual2-Master crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response Dec 07 10:18:12 [532] virtual2-Master pengine: notice: process_pe_message: Calculated transition 9326, saving inputs in /var/lib/pacemaker/pengine/pe-input-1403.bz2 Dec 07 10:18:12 [533] virtual2-Master crmd: info: do_te_invoke: Processing graph 9326 (ref=pe_calc-dc-1512634692-9363) derived from /var/lib/pacemaker/pengine/pe-input-1403.bz2 Dec 07 10:18:12 [533] virtual2-Master crmd: notice: te_rsc_command: Initiating stop operation SNMP_stop_0 locally on virtual2-Master | action 10 Dec 07 10:18:12 [530] virtual2-Master lrmd: info: cancel_recurring_action: Cancelling systemd operation SNMP_status_10000 Dec 07 10:18:12 [533] virtual2-Master crmd: info: do_lrm_rsc_op: Performing key=10:9326:0:096c0839-11c0-4100-ac52-2c4ddd7fcfd5 op=SNMP_stop_0 Dec 07 10:18:12 [530] virtual2-Master lrmd: info: log_execute: executing - rsc:SNMP action:stop call_id:30 Dec 07 10:18:12 [533] virtual2-Master crmd: info: process_lrm_event: Result of monitor operation for SNMP on virtual2-Master: Cancelled | call=24 key=SNMP_monitor_10000 confirmed=true Dec 07 10:18:12 [530] virtual2-Master lrmd: info: systemd_exec_result: Call to stop passed: /org/freedesktop/systemd1/job/9050 Dec 07 10:18:14 [533] virtual2-Master crmd: notice: process_lrm_event: Result of stop operation for SNMP on virtual2-Master: 0 (ok) | call=30 key=SNMP_stop_0 confirmed=true cib-update=9391 Dec 07 10:18:14 [528] virtual2-Master cib: info: cib_process_request: Forwarding cib_modify operation for section status to all (origin=local/crmd/9391) Dec 07 10:18:14 [528] virtual2-Master cib: info: cib_perform_op: Diff: --- 0.76.37 2 Dec 07 10:18:14 [528] virtual2-Master cib: info: cib_perform_op: Diff: +++ 0.76.38 (null) Dec 07 10:18:14 [528] virtual2-Master cib: info: cib_perform_op: + /cib: @num_updates=38 Dec 07 10:18:14 [528] virtual2-Master cib: info: cib_perform_op: + /cib/status/node_state[@id='178676749']/lrm[@id='178676749']/lrm_resources/lrm_resource[@id='SNMP']/lrm_rsc_op[@id='SNMP_last_0']: @operation_key=SNMP_stop_0, @operation=stop, @crm-debug-origin=do_update_resource, @transition-key=10:9326:0:096c0839-11c0-4100-ac52-2c4ddd7fcfd5, @transition-magic=0:0;10:9326:0:096c0839-11c0-4100-ac52-2c4ddd7fcfd5, @call-id=30, @last-run=1512634692, @last-rc-change=1512634692, @exec-time=2481 Dec 07 10:18:14 [528] virtual2-Master cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=virtual2-Master/crmd/9391, version=0.76.38) Dec 07 10:18:14 [533] virtual2-Master crmd: info: match_graph_event: Action SNMP_stop_0 (10) confirmed on virtual2-Master (rc=0) Dec 07 10:18:14 [533] virtual2-Master crmd: notice: te_rsc_command: Initiating stop operation ASTERISK_stop_0 locally on virtual2-Master | action 3 Dec 07 10:18:14 [530] virtual2-Master lrmd: info: cancel_recurring_action: Cancelling systemd operation ASTERISK_status_10000 Dec 07 10:18:14 [533] virtual2-Master crmd: info: do_lrm_rsc_op: Performing key=3:9326:0:096c0839-11c0-4100-ac52-2c4ddd7fcfd5 op=ASTERISK_stop_0 Dec 07 10:18:14 [530] virtual2-Master lrmd: info: log_execute: executing - rsc:ASTERISK action:stop call_id:32 Dec 07 10:18:14 [533] virtual2-Master crmd: info: process_lrm_event: Result of monitor operation for ASTERISK on virtual2-Master: Cancelled | call=22 key=ASTERISK_monitor_10000 confirmed=true Dec 07 10:18:14 [530] virtual2-Master lrmd: info: systemd_exec_result: Call to stop passed: /org/freedesktop/systemd1/job/9051 Dec 07 10:18:16 [533] virtual2-Master crmd: notice: process_lrm_event: Result of stop operation for ASTERISK on virtual2-Master: 0 (ok) | call=32 key=ASTERISK_stop_0 confirmed=true cib-update=9392 Dec 07 10:18:16 [528] virtual2-Master cib: info: cib_process_request: Forwarding cib_modify operation for section status to all (origin=local/crmd/9392) Dec 07 10:18:16 [528] virtual2-Master cib: info: cib_perform_op: Diff: --- 0.76.38 2 Dec 07 10:18:16 [528] virtual2-Master cib: info: cib_perform_op: Diff: +++ 0.76.39 (null) Dec 07 10:18:16 [528] virtual2-Master cib: info: cib_perform_op: + /cib: @num_updates=39 Dec 07 10:18:16 [528] virtual2-Master cib: info: cib_perform_op: + /cib/status/node_state[@id='178676749']/lrm[@id='178676749']/lrm_resources/lrm_resource[@id='ASTERISK']/lrm_rsc_op[@id='ASTERISK_last_0']: @operation_key=ASTERISK_stop_0, @operation=stop, @crm-debug-origin=do_update_resource, @transition-key=3:9326:0:096c0839-11c0-4100-ac52-2c4ddd7fcfd5, @transition-magic=0:0;3:9326:0:096c0839-11c0-4100-ac52-2c4ddd7fcfd5, @call-id=32, @last-run=1512634694, @last-rc-change=1512634694, @exec-time Dec 07 10:18:16 [533] virtual2-Master crmd: info: match_graph_event: Action ASTERISK_stop_0 (3) confirmed on virtual2-Master (rc=0) Dec 07 10:18:16 [533] virtual2-Master crmd: notice: te_rsc_command: Initiating start operation ASTERISK_start_0 locally on virtual2-Master | action 7 Dec 07 10:18:16 [533] virtual2-Master crmd: info: do_lrm_rsc_op: Performing key=7:9326:0:096c0839-11c0-4100-ac52-2c4ddd7fcfd5 op=ASTERISK_start_0 Dec 07 10:18:16 [530] virtual2-Master lrmd: info: log_execute: executing - rsc:ASTERISK action:start call_id:33 Dec 07 10:18:16 [528] virtual2-Master cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=virtual2-Master/crmd/9392, version=0.76.39) Dec 07 10:18:16 [530] virtual2-Master lrmd: info: systemd_exec_result: Call to start passed: /org/freedesktop/systemd1/job/9052 Dec 07 10:18:18 [533] virtual2-Master crmd: notice: process_lrm_event: Result of start operation for ASTERISK on virtual2-Master: 0 (ok) | call=33 key=ASTERISK_start_0 confirmed=true cib-update=9393 Dec 07 10:18:18 [528] virtual2-Master cib: info: cib_process_request: Forwarding cib_modify operation for section status to all (origin=local/crmd/9393) Dec 07 10:18:18 [528] virtual2-Master cib: info: cib_perform_op: Diff: --- 0.76.39 2 Dec 07 10:18:18 [528] virtual2-Master cib: info: cib_perform_op: Diff: +++ 0.76.40 (null) Dec 07 10:18:18 [528] virtual2-Master cib: info: cib_perform_op: + /cib: @num_updates=40 Dec 07 10:18:18 [528] virtual2-Master cib: info: cib_perform_op: + /cib/status/node_state[@id='178676749']/lrm[@id='178676749']/lrm_resources/lrm_resource[@id='ASTERISK']/lrm_rsc_op[@id='ASTERISK_last_0']: @operation_key=ASTERISK_start_0, @operation=start, @transition-key=7:9326:0:096c0839-11c0-4100-ac52-2c4ddd7fcfd5, @transition-magic=0:0;7:9326:0:096c0839-11c0-4100-ac52-2c4ddd7fcfd5, @call-id=33, @last-run=1512634696, @last-rc-change=1512634696, @exec-time=2042 Dec 07 10:18:18 [528] virtual2-Master cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=virtual2-Master/crmd/9393, version=0.76.40) Dec 07 10:18:18 [533] virtual2-Master crmd: info: match_graph_event: Action ASTERISK_start_0 (7) confirmed on virtual2-Master (rc=0) Dec 07 10:18:18 [533] virtual2-Master crmd: notice: te_rsc_command: Initiating monitor operation ASTERISK_monitor_10000 locally on virtual2-Master | action 2 Dec 07 10:18:18 [533] virtual2-Master crmd: info: do_lrm_rsc_op: Performing key=2:9326:0:096c0839-11c0-4100-ac52-2c4ddd7fcfd5 op=ASTERISK_monitor_10000 Dec 07 10:18:18 [533] virtual2-Master crmd: notice: te_rsc_command: Initiating start operation SNMP_start_0 locally on virtual2-Master | action 11 Dec 07 10:18:18 [533] virtual2-Master crmd: info: do_lrm_rsc_op: Performing key=11:9326:0:096c0839-11c0-4100-ac52-2c4ddd7fcfd5 op=SNMP_start_0 Dec 07 10:18:18 [530] virtual2-Master lrmd: info: log_execute: executing - rsc:SNMP action:start call_id:35 Dec 07 10:18:18 [533] virtual2-Master crmd: info: process_lrm_event: Result of monitor operation for ASTERISK on virtual2-Master: 0 (ok) | call=34 key=ASTERISK_monitor_10000 confirmed=false cib-update=9394 Dec 07 10:18:18 [528] virtual2-Master cib: info: cib_process_request: Forwarding cib_modify operation for section status to all (origin=local/crmd/9394) Dec 07 10:18:18 [528] virtual2-Master cib: info: cib_perform_op: Diff: --- 0.76.40 2 Dec 07 10:18:18 [528] virtual2-Master cib: info: cib_perform_op: Diff: +++ 0.76.41 (null) Dec 07 10:18:18 [528] virtual2-Master cib: info: cib_perform_op: + /cib: @num_updates=41 Dec 07 10:18:18 [528] virtual2-Master cib: info: cib_perform_op: + /cib/status/node_state[@id='178676749']/lrm[@id='178676749']/lrm_resources/lrm_resource[@id='ASTERISK']/lrm_rsc_op[@id='ASTERISK_monitor_10000']: @crm-debug-origin=do_update_resource, @transition-key=2:9326:0:096c0839-11c0-4100-ac52-2c4ddd7fcfd5, @transition-magic=0:0;2:9326:0:096c0839-11c0-4100-ac52-2c4ddd7fcfd5, @call-id=34, @last-rc-change=1512634698, @exec-time=1 Dec 07 10:18:18 [533] virtual2-Master crmd: info: match_graph_event: Action ASTERISK_monitor_10000 (2) confirmed on virtual2-Master (rc=0) Dec 07 10:18:18 [528] virtual2-Master cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=virtual2-Master/crmd/9394, version=0.76.41) Dec 07 10:18:18 [530] virtual2-Master lrmd: info: systemd_exec_result: Call to start passed: /org/freedesktop/systemd1/job/9133 Dec 07 10:18:20 [533] virtual2-Master crmd: notice: process_lrm_event: Result of start operation for SNMP on virtual2-Master: 0 (ok) | call=35 key=SNMP_start_0 confirmed=true cib-update=9395 Dec 07 10:18:20 [528] virtual2-Master cib: info: cib_process_request: Forwarding cib_modify operation for section status to all (origin=local/crmd/9395) Dec 07 10:18:20 [528] virtual2-Master cib: info: cib_perform_op: Diff: --- 0.76.41 2 Dec 07 10:18:20 [528] virtual2-Master cib: info: cib_perform_op: Diff: +++ 0.76.42 (null) Dec 07 10:18:20 [528] virtual2-Master cib: info: cib_perform_op: + /cib: @num_updates=42 Dec 07 10:18:20 [528] virtual2-Master cib: info: cib_perform_op: + /cib/status/node_state[@id='178676749']/lrm[@id='178676749']/lrm_resources/lrm_resource[@id='SNMP']/lrm_rsc_op[@id='SNMP_last_0']: @operation_key=SNMP_start_0, @operation=start, @transition-key=11:9326:0:096c0839-11c0-4100-ac52-2c4ddd7fcfd5, @transition-magic=0:0;11:9326:0:096c0839-11c0-4100-ac52-2c4ddd7fcfd5, @call-id=35, @last-run=1512634698, @last-rc-change=1512634698, @exec-time=2045 Dec 07 10:18:20 [528] virtual2-Master cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=virtual2-Master/crmd/9395, version=0.76.42) Dec 07 10:18:20 [533] virtual2-Master crmd: info: match_graph_event: Action SNMP_start_0 (11) confirmed on virtual2-Master (rc=0) Dec 07 10:18:20 [533] virtual2-Master crmd: notice: te_rsc_command: Initiating monitor operation SNMP_monitor_10000 locally on virtual2-Master | action 5 Dec 07 10:18:20 [533] virtual2-Master crmd: info: do_lrm_rsc_op: Performing key=5:9326:0:096c0839-11c0-4100-ac52-2c4ddd7fcfd5 op=SNMP_monitor_10000 Dec 07 10:18:20 [533] virtual2-Master crmd: info: process_lrm_event: Result of monitor operation for SNMP on virtual2-Master: 0 (ok) | call=36 key=SNMP_monitor_10000 confirmed=false cib-update=9396 Dec 07 10:18:20 [528] virtual2-Master cib: info: cib_process_request: Forwarding cib_modify operation for section status to all (origin=local/crmd/9396) Dec 07 10:18:20 [528] virtual2-Master cib: info: cib_perform_op: Diff: --- 0.76.42 2 Dec 07 10:18:20 [528] virtual2-Master cib: info: cib_perform_op: Diff: +++ 0.76.43 (null) Dec 07 10:18:20 [528] virtual2-Master cib: info: cib_perform_op: + /cib: @num_updates=43 Dec 07 10:18:20 [528] virtual2-Master cib: info: cib_perform_op: + /cib/status/node_state[@id='178676749']/lrm[@id='178676749']/lrm_resources/lrm_resource[@id='SNMP']/lrm_rsc_op[@id='SNMP_monitor_10000']: @crm-debug-origin=do_update_resource, @transition-key=5:9326:0:096c0839-11c0-4100-ac52-2c4ddd7fcfd5, @transition-magic=0:0;5:9326:0:096c0839-11c0-4100-ac52-2c4ddd7fcfd5, @call-id=36, @last-rc-change=1512634700 Dec 07 10:18:20 [528] virtual2-Master cib: info: cib_process_request: Completed cib_modify operation for section status: OK (rc=0, origin=virtual2-Master/crmd/9396, version=0.76.43) Dec 07 10:18:20 [533] virtual2-Master crmd: info: match_graph_event: Action SNMP_monitor_10000 (5) confirmed on virtual2-Master (rc=0) Dec 07 10:18:20 [533] virtual2-Master crmd: notice: run_graph: Transition 9326 (Complete=7, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1403.bz2): Complete Dec 07 10:18:20 [533] virtual2-Master crmd: info: do_log: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd Dec 07 10:18:20 [533] virtual2-Master crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd Dec 07 10:18:25 [533] virtual2-Master crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (5000ms) Dec 07 10:18:25 [533] virtual2-Master crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped Dec 07 10:18:25 [533] virtual2-Master crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED Dec 07 10:18:25 [528] virtual2-Master cib: info: cib_process_ping: Reporting our current digest to virtual2-Master: ce905a748fcdc92308804373c14a332f for 0.76.43 (0x55c6550dbd70 0) Dec 07 10:18:25 [532] virtual2-Master pengine: notice: unpack_config: On loss of CCM Quorum: Ignore Dec 07 10:18:25 [532] virtual2-Master pengine: info: determine_online_status: Node virtual2-Master is online Dec 07 10:18:25 [532] virtual2-Master pengine: info: determine_online_status: Node virtual2-Slave is online Dec 07 10:18:25 [532] virtual2-Master pengine: warning: unpack_rsc_op_failure: Processing failed op monitor for ASTERISK on virtual2-Master: not running (7) Dec 07 10:18:25 [532] virtual2-Master pengine: info: determine_op_status: Operation monitor found resource BACULA active on virtual2-Master Dec 07 10:18:25 [532] virtual2-Master pengine: info: determine_op_status: Operation monitor found resource BACULA active on virtual2-Slave Dec 07 10:18:25 [532] virtual2-Master pengine: info: native_print: ASTERISK (systemd:asterisk): Started virtual2-Master Dec 07 10:18:25 [532] virtual2-Master pengine: info: native_print: BACULA (systemd:bacula-fd): Started virtual2-Master Dec 07 10:18:25 [532] virtual2-Master pengine: info: native_print: SNMP (systemd:snmpd): Started virtual2-Master Dec 07 10:18:25 [532] virtual2-Master pengine: info: native_print: IPSHARED (ocf::heartbeat:IPaddr2): Started virtual2-Master Dec 07 10:18:25 [532] virtual2-Master pengine: info: get_failcount_full: ASTERISK has failed 1 times on virtual2-Master Dec 07 10:18:25 [532] virtual2-Master pengine: info: check_migration_threshold: ASTERISK can fail 9 more times on virtual2-Master before being forced off Dec 07 10:18:25 [532] virtual2-Master pengine: info: LogActions: Leave ASTERISK (Started virtual2-Master) Dec 07 10:18:25 [532] virtual2-Master pengine: info: LogActions: Leave BACULA (Started virtual2-Master) Dec 07 10:18:25 [532] virtual2-Master pengine: info: LogActions: Leave SNMP (Started virtual2-Master) Dec 07 10:18:25 [532] virtual2-Master pengine: info: LogActions: Leave IPSHARED (Started virtual2-Master) Dec 07 10:18:25 [532] virtual2-Master pengine: notice: process_pe_message: Calculated transition 9327, saving inputs in /var/lib/pacemaker/pengine/pe-input-1404.bz2 Dec 07 10:18:25 [533] virtual2-Master crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response Dec 07 10:18:25 [533] virtual2-Master crmd: info: do_te_invoke: Processing graph 9327 (ref=pe_calc-dc-1512634705-9370) derived from /var/lib/pacemaker/pengine/pe-input-1404.bz2 Dec 07 10:18:25 [533] virtual2-Master crmd: notice: run_graph: Transition 9327 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1404.bz2): Complete Dec 07 10:18:25 [533] virtual2-Master crmd: info: do_log: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd Dec 07 10:18:25 [533] virtual2-Master crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd Dec 07 10:18:30 [533] virtual2-Master crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (5000ms) Dec 07 10:18:30 [533] virtual2-Master crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped Dec 07 10:18:30 [533] virtual2-Master crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED Dec 07 10:18:30 [532] virtual2-Master pengine: info: process_pe_message: Input has not changed since last time, not saving to disk Dec 07 10:18:30 [532] virtual2-Master pengine: notice: unpack_config: On loss of CCM Quorum: Ignore Dec 07 10:18:30 [532] virtual2-Master pengine: info: determine_online_status: Node virtual2-Master is online Dec 07 10:18:30 [532] virtual2-Master pengine: info: determine_online_status: Node virtual2-Slave is online Dec 07 10:18:30 [532] virtual2-Master pengine: warning: unpack_rsc_op_failure: Processing failed op monitor for ASTERISK on virtual2-Master: not running (7) Dec 07 10:18:30 [532] virtual2-Master pengine: info: determine_op_status: Operation monitor found resource BACULA active on virtual2-Master Dec 07 10:18:30 [532] virtual2-Master pengine: info: determine_op_status: Operation monitor found resource BACULA active on virtual2-Slave Dec 07 10:18:30 [532] virtual2-Master pengine: info: native_print: ASTERISK (systemd:asterisk): Started virtual2-Master Dec 07 10:18:30 [532] virtual2-Master pengine: info: native_print: BACULA (systemd:bacula-fd): Started virtual2-Master Dec 07 10:18:30 [532] virtual2-Master pengine: info: native_print: SNMP (systemd:snmpd): Started virtual2-Master Dec 07 10:18:30 [532] virtual2-Master pengine: info: native_print: IPSHARED (ocf::heartbeat:IPaddr2): Started virtual2-Master Dec 07 10:18:30 [532] virtual2-Master pengine: info: get_failcount_full: ASTERISK has failed 1 times on virtual2-Master Dec 07 10:18:30 [532] virtual2-Master pengine: info: check_migration_threshold: ASTERISK can fail 9 more times on virtual2-Master before being forced off Dec 07 10:18:30 [532] virtual2-Master pengine: info: LogActions: Leave ASTERISK (Started virtual2-Master) Dec 07 10:18:30 [532] virtual2-Master pengine: info: LogActions: Leave BACULA (Started virtual2-Master) Dec 07 10:18:30 [532] virtual2-Master pengine: info: LogActions: Leave SNMP (Started virtual2-Master) Dec 07 10:18:30 [532] virtual2-Master pengine: info: LogActions: Leave IPSHARED (Started virtual2-Master) Dec 07 10:18:30 [532] virtual2-Master pengine: notice: process_pe_message: Calculated transition 9328, saving inputs in /var/lib/pacemaker/pengine/pe-input-1404.bz2 Dec 07 10:18:30 [533] virtual2-Master crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response Dec 07 10:18:30 [533] virtual2-Master crmd: info: do_te_invoke: Processing graph 9328 (ref=pe_calc-dc-1512634710-9371) derived from /var/lib/pacemaker/pengine/pe-input-1404.bz2 Dec 07 10:18:30 [533] virtual2-Master crmd: notice: run_graph: Transition 9328 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1404.bz2): Complete Dec 07 10:18:30 [533] virtual2-Master crmd: info: do_log: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd Dec 07 10:18:30 [533] virtual2-Master crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd Dec 07 10:18:35 [533] virtual2-Master crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (5000ms) Dec 07 10:18:35 [533] virtual2-Master crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped Dec 07 10:18:35 [533] virtual2-Master crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED Dec 07 10:18:35 [532] virtual2-Master pengine: info: process_pe_message: Input has not changed since last time, not saving to disk Dec 07 10:18:35 [532] virtual2-Master pengine: notice: unpack_config: On loss of CCM Quorum: Ignore Dec 07 10:18:35 [532] virtual2-Master pengine: info: determine_online_status: Node virtual2-Master is online Dec 07 10:18:35 [532] virtual2-Master pengine: info: determine_online_status: Node virtual2-Slave is online Dec 07 10:18:35 [532] virtual2-Master pengine: warning: unpack_rsc_op_failure: Processing failed op monitor for ASTERISK on virtual2-Master: not running (7) Dec 07 10:18:35 [532] virtual2-Master pengine: info: determine_op_status: Operation monitor found resource BACULA active on virtual2-Master Dec 07 10:18:35 [532] virtual2-Master pengine: info: determine_op_status: Operation monitor found resource BACULA active on virtual2-Slave Dec 07 10:18:35 [532] virtual2-Master pengine: info: native_print: ASTERISK (systemd:asterisk): Started virtual2-Master Dec 07 10:18:35 [532] virtual2-Master pengine: info: native_print: BACULA (systemd:bacula-fd): Started virtual2-Master Dec 07 10:18:35 [532] virtual2-Master pengine: info: native_print: SNMP (systemd:snmpd): Started virtual2-Master Dec 07 10:18:35 [532] virtual2-Master pengine: info: native_print: IPSHARED (ocf::heartbeat:IPaddr2): Started virtual2-Master Dec 07 10:18:35 [532] virtual2-Master pengine: info: get_failcount_full: ASTERISK has failed 1 times on virtual2-Master Dec 07 10:18:35 [532] virtual2-Master pengine: info: check_migration_threshold: ASTERISK can fail 9 more times on virtual2-Master before being forced off Dec 07 10:18:35 [532] virtual2-Master pengine: info: LogActions: Leave ASTERISK (Started virtual2-Master) Dec 07 10:18:35 [532] virtual2-Master pengine: info: LogActions: Leave BACULA (Started virtual2-Master) Dec 07 10:18:35 [532] virtual2-Master pengine: info: LogActions: Leave SNMP (Started virtual2-Master) Dec 07 10:18:35 [532] virtual2-Master pengine: info: LogActions: Leave IPSHARED (Started virtual2-Master) Dec 07 10:18:35 [532] virtual2-Master pengine: notice: process_pe_message: Calculated transition 9329, saving inputs in /var/lib/pacemaker/pengine/pe-input-1404.bz2 Dec 07 10:18:35 [533] virtual2-Master crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response Dec 07 10:18:35 [533] virtual2-Master crmd: info: do_te_invoke: Processing graph 9329 (ref=pe_calc-dc-1512634715-9372) derived from /var/lib/pacemaker/pengine/pe-input-1404.bz2 Dec 07 10:18:35 [533] virtual2-Master crmd: notice: run_graph: Transition 9329 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1404.bz2): Complete Dec 07 10:18:35 [533] virtual2-Master crmd: info: do_log: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd Dec 07 10:18:35 [533] virtual2-Master crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd Dec 07 10:18:40 [533] virtual2-Master crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (5000ms) Dec 07 10:18:40 [533] virtual2-Master crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped Dec 07 10:18:40 [533] virtual2-Master crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED Dec 07 10:18:40 [532] virtual2-Master pengine: info: process_pe_message: Input has not changed since last time, not saving to disk Dec 07 10:18:40 [532] virtual2-Master pengine: notice: unpack_config: On loss of CCM Quorum: Ignore Dec 07 10:18:40 [532] virtual2-Master pengine: info: determine_online_status: Node virtual2-Master is online Dec 07 10:18:40 [532] virtual2-Master pengine: info: determine_online_status: Node virtual2-Slave is online Dec 07 10:18:40 [532] virtual2-Master pengine: warning: unpack_rsc_op_failure: Processing failed op monitor for ASTERISK on virtual2-Master: not running (7) Dec 07 10:18:40 [532] virtual2-Master pengine: info: determine_op_status: Operation monitor found resource BACULA active on virtual2-Master Dec 07 10:18:40 [532] virtual2-Master pengine: info: determine_op_status: Operation monitor found resource BACULA active on virtual2-Slave Dec 07 10:18:40 [532] virtual2-Master pengine: info: native_print: ASTERISK (systemd:asterisk): Started virtual2-Master Dec 07 10:18:40 [532] virtual2-Master pengine: info: native_print: BACULA (systemd:bacula-fd): Started virtual2-Master Dec 07 10:18:40 [532] virtual2-Master pengine: info: native_print: SNMP (systemd:snmpd): Started virtual2-Master Dec 07 10:18:40 [532] virtual2-Master pengine: info: native_print: IPSHARED (ocf::heartbeat:IPaddr2): Started virtual2-Master Dec 07 10:18:40 [532] virtual2-Master pengine: info: get_failcount_full: ASTERISK has failed 1 times on virtual2-Master Dec 07 10:18:40 [532] virtual2-Master pengine: info: check_migration_threshold: ASTERISK can fail 9 more times on virtual2-Master before being forced off Dec 07 10:18:40 [532] virtual2-Master pengine: info: LogActions: Leave ASTERISK (Started virtual2-Master) Dec 07 10:18:40 [532] virtual2-Master pengine: info: LogActions: Leave BACULA (Started virtual2-Master) Dec 07 10:18:40 [532] virtual2-Master pengine: info: LogActions: Leave SNMP (Started virtual2-Master) Dec 07 10:18:40 [532] virtual2-Master pengine: info: LogActions: Leave IPSHARED (Started virtual2-Master) Dec 07 10:18:40 [532] virtual2-Master pengine: notice: process_pe_message: Calculated transition 9330, saving inputs in /var/lib/pacemaker/pengine/pe-input-1404.bz2 Dec 07 10:18:40 [533] virtual2-Master crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response Dec 07 10:18:40 [533] virtual2-Master crmd: info: do_te_invoke: Processing graph 9330 (ref=pe_calc-dc-1512634720-9373) derived from /var/lib/pacemaker/pengine/pe-input-1404.bz2 Dec 07 10:18:40 [533] virtual2-Master crmd: notice: run_graph: Transition 9330 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1404.bz2): Complete Dec 07 10:18:40 [533] virtual2-Master crmd: info: do_log: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd Dec 07 10:18:40 [533] virtual2-Master crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd Dec 07 10:18:45 [533] virtual2-Master crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (5000ms) Dec 07 10:18:45 [533] virtual2-Master crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped Dec 07 10:18:45 [533] virtual2-Master crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED Dec 07 10:18:45 [532] virtual2-Master pengine: info: process_pe_message: Input has not changed since last time, not saving to disk Dec 07 10:18:45 [532] virtual2-Master pengine: notice: unpack_config: On loss of CCM Quorum: Ignore Dec 07 10:18:45 [532] virtual2-Master pengine: info: determine_online_status: Node virtual2-Master is online Dec 07 10:18:45 [532] virtual2-Master pengine: info: determine_online_status: Node virtual2-Slave is online Dec 07 10:18:45 [532] virtual2-Master pengine: warning: unpack_rsc_op_failure: Processing failed op monitor for ASTERISK on virtual2-Master: not running (7) Dec 07 10:18:45 [532] virtual2-Master pengine: info: determine_op_status: Operation monitor found resource BACULA active on virtual2-Master Dec 07 10:18:45 [532] virtual2-Master pengine: info: determine_op_status: Operation monitor found resource BACULA active on virtual2-Slave Dec 07 10:18:45 [532] virtual2-Master pengine: info: native_print: ASTERISK (systemd:asterisk): Started virtual2-Master Dec 07 10:18:45 [532] virtual2-Master pengine: info: native_print: BACULA (systemd:bacula-fd): Started virtual2-Master Dec 07 10:18:45 [532] virtual2-Master pengine: info: native_print: SNMP (systemd:snmpd): Started virtual2-Master Dec 07 10:18:45 [532] virtual2-Master pengine: info: native_print: IPSHARED (ocf::heartbeat:IPaddr2): Started virtual2-Master Dec 07 10:18:45 [532] virtual2-Master pengine: info: get_failcount_full: ASTERISK has failed 1 times on virtual2-Master Dec 07 10:18:45 [532] virtual2-Master pengine: info: check_migration_threshold: ASTERISK can fail 9 more times on virtual2-Master before being forced off Dec 07 10:18:45 [532] virtual2-Master pengine: info: LogActions: Leave ASTERISK (Started virtual2-Master) Dec 07 10:18:45 [532] virtual2-Master pengine: info: LogActions: Leave BACULA (Started virtual2-Master) Dec 07 10:18:45 [532] virtual2-Master pengine: info: LogActions: Leave SNMP (Started virtual2-Master) Dec 07 10:18:45 [532] virtual2-Master pengine: info: LogActions: Leave IPSHARED (Started virtual2-Master) Dec 07 10:18:45 [532] virtual2-Master pengine: notice: process_pe_message: Calculated transition 9331, saving inputs in /var/lib/pacemaker/pengine/pe-input-1404.bz2 Dec 07 10:18:45 [533] virtual2-Master crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response Dec 07 10:18:45 [533] virtual2-Master crmd: info: do_te_invoke: Processing graph 9331 (ref=pe_calc-dc-1512634725-9374) derived from /var/lib/pacemaker/pengine/pe-input-1404.bz2 Dec 07 10:18:45 [533] virtual2-Master crmd: notice: run_graph: Transition 9331 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1404.bz2): Complete Dec 07 10:18:45 [533] virtual2-Master crmd: info: do_log: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd Dec 07 10:18:45 [533] virtual2-Master crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd Dec 07 10:18:50 [533] virtual2-Master crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (5000ms) Dec 07 10:18:50 [533] virtual2-Master crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped Dec 07 10:18:50 [533] virtual2-Master crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED Dec 07 10:18:50 [532] virtual2-Master pengine: info: process_pe_message: Input has not changed since last time, not saving to disk Dec 07 10:18:50 [532] virtual2-Master pengine: notice: unpack_config: On loss of CCM Quorum: Ignore Dec 07 10:18:50 [532] virtual2-Master pengine: info: determine_online_status: Node virtual2-Master is online Dec 07 10:18:50 [532] virtual2-Master pengine: info: determine_online_status: Node virtual2-Slave is online Dec 07 10:18:50 [532] virtual2-Master pengine: warning: unpack_rsc_op_failure: Processing failed op monitor for ASTERISK on virtual2-Master: not running (7) Dec 07 10:18:50 [532] virtual2-Master pengine: info: determine_op_status: Operation monitor found resource BACULA active on virtual2-Master Dec 07 10:18:50 [532] virtual2-Master pengine: info: determine_op_status: Operation monitor found resource BACULA active on virtual2-Slave Dec 07 10:18:50 [532] virtual2-Master pengine: info: native_print: ASTERISK (systemd:asterisk): Started virtual2-Master Dec 07 10:18:50 [532] virtual2-Master pengine: info: native_print: BACULA (systemd:bacula-fd): Started virtual2-Master Dec 07 10:18:50 [532] virtual2-Master pengine: info: native_print: SNMP (systemd:snmpd): Started virtual2-Master Dec 07 10:18:50 [532] virtual2-Master pengine: info: native_print: IPSHARED (ocf::heartbeat:IPaddr2): Started virtual2-Master Dec 07 10:18:50 [532] virtual2-Master pengine: info: get_failcount_full: ASTERISK has failed 1 times on virtual2-Master Dec 07 10:18:50 [532] virtual2-Master pengine: info: check_migration_threshold: ASTERISK can fail 9 more times on virtual2-Master before being forced off Dec 07 10:18:50 [532] virtual2-Master pengine: info: LogActions: Leave ASTERISK (Started virtual2-Master) Dec 07 10:18:50 [532] virtual2-Master pengine: info: LogActions: Leave BACULA (Started virtual2-Master) Dec 07 10:18:50 [532] virtual2-Master pengine: info: LogActions: Leave SNMP (Started virtual2-Master) Dec 07 10:18:50 [532] virtual2-Master pengine: info: LogActions: Leave IPSHARED (Started virtual2-Master) Dec 07 10:18:50 [532] virtual2-Master pengine: notice: process_pe_message: Calculated transition 9332, saving inputs in /var/lib/pacemaker/pengine/pe-input-1404.bz2 Dec 07 10:18:50 [533] virtual2-Master crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response Dec 07 10:18:50 [533] virtual2-Master crmd: info: do_te_invoke: Processing graph 9332 (ref=pe_calc-dc-1512634730-9375) derived from /var/lib/pacemaker/pengine/pe-input-1404.bz2 Dec 07 10:18:50 [533] virtual2-Master crmd: notice: run_graph: Transition 9332 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1404.bz2): Complete Dec 07 10:18:50 [533] virtual2-Master crmd: info: do_log: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd Dec 07 10:18:50 [533] virtual2-Master crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd Dec 07 10:18:55 [533] virtual2-Master crmd: info: crm_timer_popped: PEngine Recheck Timer (I_PE_CALC) just popped (5000ms) Dec 07 10:18:55 [533] virtual2-Master crmd: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE | input=I_PE_CALC cause=C_TIMER_POPPED origin=crm_timer_popped Dec 07 10:18:55 [533] virtual2-Master crmd: info: do_state_transition: Progressed to state S_POLICY_ENGINE after C_TIMER_POPPED Dec 07 10:18:55 [532] virtual2-Master pengine: info: process_pe_message: Input has not changed since last time, not saving to disk Dec 07 10:18:55 [532] virtual2-Master pengine: notice: unpack_config: On loss of CCM Quorum: Ignore Dec 07 10:18:55 [532] virtual2-Master pengine: info: determine_online_status: Node virtual2-Master is online Dec 07 10:18:55 [532] virtual2-Master pengine: info: determine_online_status: Node virtual2-Slave is online Dec 07 10:18:55 [532] virtual2-Master pengine: warning: unpack_rsc_op_failure: Processing failed op monitor for ASTERISK on virtual2-Master: not running (7) Dec 07 10:18:55 [532] virtual2-Master pengine: info: determine_op_status: Operation monitor found resource BACULA active on virtual2-Master Dec 07 10:18:55 [532] virtual2-Master pengine: info: determine_op_status: Operation monitor found resource BACULA active on virtual2-Slave Dec 07 10:18:55 [532] virtual2-Master pengine: info: native_print: ASTERISK (systemd:asterisk): Started virtual2-Master Dec 07 10:18:55 [532] virtual2-Master pengine: info: native_print: BACULA (systemd:bacula-fd): Started virtual2-Master Dec 07 10:18:55 [532] virtual2-Master pengine: info: native_print: SNMP (systemd:snmpd): Started virtual2-Master Dec 07 10:18:55 [532] virtual2-Master pengine: info: native_print: IPSHARED (ocf::heartbeat:IPaddr2): Started virtual2-Master Dec 07 10:18:55 [532] virtual2-Master pengine: info: get_failcount_full: ASTERISK has failed 1 times on virtual2-Master Dec 07 10:18:55 [532] virtual2-Master pengine: info: check_migration_threshold: ASTERISK can fail 9 more times on virtual2-Master before being forced off Dec 07 10:18:55 [532] virtual2-Master pengine: info: LogActions: Leave ASTERISK (Started virtual2-Master) Dec 07 10:18:55 [532] virtual2-Master pengine: info: LogActions: Leave BACULA (Started virtual2-Master) Dec 07 10:18:55 [532] virtual2-Master pengine: info: LogActions: Leave SNMP (Started virtual2-Master) Dec 07 10:18:55 [532] virtual2-Master pengine: info: LogActions: Leave IPSHARED (Started virtual2-Master) Dec 07 10:18:55 [532] virtual2-Master pengine: notice: process_pe_message: Calculated transition 9333, saving inputs in /var/lib/pacemaker/pengine/pe-input-1404.bz2 Dec 07 10:18:55 [533] virtual2-Master crmd: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE | input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response Dec 07 10:18:55 [533] virtual2-Master crmd: info: do_te_invoke: Processing graph 9333 (ref=pe_calc-dc-1512634735-9376) derived from /var/lib/pacemaker/pengine/pe-input-1404.bz2 Dec 07 10:18:55 [533] virtual2-Master crmd: notice: run_graph: Transition 9333 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-1404.bz2): Complete Dec 07 10:18:55 [533] virtual2-Master crmd: info: do_log: Input I_TE_SUCCESS received in state S_TRANSITION_ENGINE from notify_crmd Dec 07 10:18:55 [533] virtual2-Master crmd: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE | input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd