ASTERISK-28347: ari: Crash while deleting bridge with channels in it

[Home]

Summary: ASTERISK-28347: ari: Crash while deleting bridge with channels in it

Reporter: Joeran Vinzens (jvinzens) Labels: pjsip

Date Opened: 2019-03-26 04:22:01 Date Closed: 2019-03-28 08:42:30

Priority: Minor Regression? No

Status: Closed/Complete Components: Resources/res_ari_bridges Resources/res_ari_channels

Versions: 16.2.1 Frequency of
Occurrence Occasional

Related
Issues:
duplicates ASTERISK-26718 ARI: Bridge destroying doesn't work as expected

Environment: Debian strech on dell R330 hardware. Call controll via ARI Attachments:

Description: An Incoming call (A) gets managed by a stasis App.
1. new channel (B) is created using rest interface
2. bridge is created via rest
3. both channels are put into bridge via rest
4. some channel variables are set via rest
5. bridge gets deleted
6. channel B gets deleted
7. channel A gets deleted

now we see some warnings on the console:
{noformat}[2019-03-22 07:34:26.398] WARNING[5290][C-00000a96] bridge.c: Channel PJSIP/ic_proxy_endpoint-00000a95 has a PBX thread and cannot be imparted into bridge 4c35dd9c-4f74-4fdb-af35-261dfd875c04
{noformat}
after that asterisk crashed.

last log lines:
{noformat}
[2019-03-22 07:34:26.398] VERBOSE[5300] bridge_channel.c: Channel PJSIP/domain-00000a96 left 'simple_bridge' stasis-bridge <CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-bridge>
[2019-03-22 07:34:26.398] VERBOSE[5299][C-00000a96] bridge_channel.c: Channel PJSIP/ic_proxy_endpoint-00000a95 left 'simple_bridge' stasis-bridge <CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-bridge>
[2019-03-22 07:34:26.398] WARNING[5290][C-00000a96] bridge.c: Channel PJSIP/ic_proxy_endpoint-00000a95 has a PBX thread and cannot be imparted into bridge 4c35dd9c-4f74-4fdb-af35-261dfd875c04
[2019-03-22 07:34:26.399] VERBOSE[5303] bridge_channel.c: Channel PJSIP/domain-00000a96 joined 'holding_bridge' stasis-bridge <4c35dd9c-4f74-4fdb-af35-261dfd875c04>
[2019-03-22 07:34:26.412] VERBOSE[5303] bridge_channel.c: Channel PJSIP/domain-00000a96 left 'holding_bridge' stasis-bridge <4c35dd9c-4f74-4fdb-af35-261dfd875c04>
[2019-03-22 07:34:27.094] Asterisk 16.2.1 built by pbuilder @ build machine on a x86_64 running Linux on 2019-03-04 11:01:23 UTC
{noformat}

Due to privacy concerns it is not possible to upload an entire core dump.
Full backtrace:
{noformat}

(gdb) bt full
#0 0x0000564330791ca2 in __ao2_ref (user_data=user_data@entry=0x6b7369726574, delta=delta@entry=1, tag=tag@entry=0x56433096b68e "", file=file@entry=0x564330974dc0 "channel.c", line=line@entry=10535,
func=func@entry=0x56433097bd50 <__PRETTY_FUNCTION__.22856> "ast_channel_get_bridge_channel") at astobj2.c:501
p__LINE__ = 0x6b736972655c
obj = <optimized out>
obj_mutex = <optimized out>
obj_rwlock = <optimized out>
obj_lockobj = <optimized out>
current_value = <optimized out>
ret = <optimized out>
weakproxy = <optimized out>
lock_state = <optimized out>
__PRETTY_FUNCTION__ = "__ao2_ref"
#1 0x00005643307e4956 in ast_channel_get_bridge_channel (chan=chan@entry=0x564330c3ee72 <__ast_string_field_empty_buffer+2>) at channel.c:10535
bridge_channel = 0x6b7369726574
__PRETTY_FUNCTION__ = "ast_channel_get_bridge_channel"
#2 0x00007fca57ee92c6 in dial_bridge_after_cb (data=0x7fca80002820, chan=0x564330c3ee72 <__ast_string_field_empty_buffer+2>) at stasis/control.c:943
control = <optimized out>
bridge_channel = <optimized out>
#3 dial_bridge_after_cb_failed (reason=<optimized out>, data=0x7fca80002820) at stasis/control.c:958
control = 0x7fca80002820
__PRETTY_FUNCTION__ = "dial_bridge_after_cb_failed"
#4 0x00005643307ad348 in after_bridge_cb_failed (node=0x7fca80002060) at bridge_after.c:70
No locals.
#5 after_bridge_cb_run_discard (reason=AST_BRIDGE_AFTER_CB_REASON_DESTROY, after_bridge=0x7fca80005410) at bridge_after.c:99
node = 0x7fca80002060
#6 after_bridge_cb_destroy (data=0x7fca80005410) at bridge_after.c:117
after_bridge = 0x7fca80005410
__PRETTY_FUNCTION__ = "after_bridge_cb_destroy"
#7 0x00005643308077cc in ast_datastore_free (datastore=datastore@entry=0x7fca800053d0) at datastore.c:74
__PRETTY_FUNCTION__ = "ast_datastore_free"
#8 0x00005643307d3db6 in ast_channel_destructor (obj=0x7fca781201e0) at channel.c:2243
chan = 0x7fca781201e0
vardata = <optimized out>
f = <optimized out>
headp = <optimized out>
datastore = 0x7fca800053d0
device_name = "<REMOVED NAME DUE TO PRIVACY CONCERNS>"
callid = <optimized out>
__PRETTY_FUNCTION__ = "ast_channel_destructor"
#9 0x0000564330791f40 in __ao2_ref (user_data=0x7fca781201e0, delta=delta@entry=-1, tag=tag@entry=0x7fca53e06fa4 "", file=file@entry=0x7fca53e06e1f "chan_pjsip.c", line=line@entry=2313,
func=func@entry=0x7fca53e06a00 <__PRETTY_FUNCTION__.29019> "hangup_data_destroy") at astobj2.c:614
obj = 0x7fca781201c8
obj_mutex = <optimized out>
obj_rwlock = <optimized out>
obj_lockobj = <optimized out>
current_value = <optimized out>
ret = <optimized out>
weakproxy = <optimized out>
lock_state = <optimized out>
__PRETTY_FUNCTION__ = "__ao2_ref"
#10 0x00007fca53dfad1d in hangup_data_destroy (obj=0x7fca800024f0) at chan_pjsip.c:2313
h_data = 0x7fca800024f0
__PRETTY_FUNCTION__ = "hangup_data_destroy"
---Type <return> to continue, or q <return> to quit---
#11 0x0000564330791f40 in __ao2_ref (user_data=user_data@entry=0x7fca800024f0, delta=delta@entry=-1, tag=tag@entry=0x7fca53e06fa4 "", file=file@entry=0x7fca53e06e1f "chan_pjsip.c", line=line@entry=2355,
func=func@entry=0x7fca53e06a51 <__PRETTY_FUNCTION__.29041> "hangup") at astobj2.c:614
obj = 0x7fca800024d8
obj_mutex = <optimized out>
obj_rwlock = <optimized out>
obj_lockobj = <optimized out>
current_value = <optimized out>
ret = <optimized out>
weakproxy = <optimized out>
lock_state = <optimized out>
__PRETTY_FUNCTION__ = "__ao2_ref"
#12 0x00005643307923ab in __ao2_cleanup_debug (obj=obj@entry=0x7fca800024f0, tag=tag@entry=0x7fca53e06fa4 "", file=file@entry=0x7fca53e06e1f "chan_pjsip.c", line=line@entry=2355,
function=function@entry=0x7fca53e06a51 <__PRETTY_FUNCTION__.29041> "hangup") at astobj2.c:670
No locals.
#13 0x00007fca53dff640 in hangup (data=0x7fca800024f0) at chan_pjsip.c:2355
h_data = 0x7fca800024f0
ast = 0x7fca781201e0
channel = 0x7fca780bce90
session = 0x7fca781336e0
cause = <optimized out>
__PRETTY_FUNCTION__ = "hangup"
#14 0x00005643308d4478 in ast_taskprocessor_execute (tps=tps@entry=0x564332077540) at taskprocessor.c:990
local = {local_data = 0x564331d40370, data = 0x564332077540}
__PRETTY_FUNCTION__ = "ast_taskprocessor_execute"
#15 0x00005643308db520 in execute_tasks (data=0x564332077540) at threadpool.c:1351
tps = 0x564332077540
#16 0x00005643308d4478 in ast_taskprocessor_execute (tps=0x564331d3d380) at taskprocessor.c:990
local = {local_data = 0x7fca400076d0, data = 0x7fca400076d0}
__PRETTY_FUNCTION__ = "ast_taskprocessor_execute"
#17 0x00005643308dbd84 in threadpool_execute (pool=0x564331d40370) at threadpool.c:367
No locals.
#18 worker_active (worker=0x7fca400076d0) at threadpool.c:1134
No locals.
#19 worker_start (arg=arg@entry=0x7fca400076d0) at threadpool.c:1053
worker = 0x7fca400076d0
saved_state = <optimized out>
__PRETTY_FUNCTION__ = "worker_start"
#20 0x00005643308e417c in dummy_start (data=<optimized out>) at utils.c:1249
__cancel_buf = {__cancel_jmp_buf = {{__cancel_jmp_buf = {140506633891360, -9111150184993695630, 140506953407518, 140506953407519, 140506916360192, 3, 9086593420047636594, 3245072446877423730},
__mask_was_saved = 0}}, __pad = {0x7fca50de4ef0, 0x0, 0x7fcaac7188f8, 0x7fcaac718900}}
__cancel_arg = 0x7fca50de5700
__not_first_call = <optimized out>
ret = <optimized out>
a = {start_routine = 0x5643308db970 <worker_start>, data = 0x7fca400076d0, name = <optimized out>}
__PRETTY_FUNCTION__ = "dummy_start"
#21 0x00007fcaad8614a4 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
No symbol table info available.
#22 0x00007fcaac46bd0f in clone () from /lib/x86_64-linux-gnu/libc.so.6
No symbol table info available.
(gdb)
{noformat}

the entire ARI communication:
{noformat}
[>>> ARI EVENT] Element: {"type":"STASIS_START","commandsTopic":"trunking-commands-000000000002","payload":{"type":"StasisStart","timestamp":"2019-03-22T07:34:24.660+0100","args":[],"channel":{"id":"1553236464.2709","name":"PJSIP/ic_proxy_endpoint-00000a95","state":"Ring","caller":{"name":"491234567","number":"491234567"},"connected":{"name":"","number":""},"accountcode":"","dialplan":{"context":"default","exten":"49987654","priority":4},"creationtime":"2019-03-22T07:34:24.657+0100","language":"en","channelvars":{"DIRECTION":"incoming","PRIVACY":"","X_AUTH_DOMAIN":"","PPI":"<sip:491234567@domain>","X_TO_DOMAIN":"","PAI":"<sip:491234567@domain>","X_AUTH_USER":""}},"asterisk_id":"00:00:00:00:00:02","application":"trunking"},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":null}
[>>> ARI COMMAND] Element: {"ariCommand":{"method":"POST","url":"/channels/create","body":{"channelId":"CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-outgoing-channel","endpoint":"PJSIP/0049987654@domain","app":"trunking","callerId":"01727583244"}},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":"outgoing-channel28b95171-cfcc-4e00-81e5-d93b6a60e73f"}
[>>> ARI EVENT] Element: {"type":"CHANNEL_DIALPLAN","commandsTopic":"trunking-commands-000000000002","payload":{"type":"ChannelDialplan","timestamp":"2019-03-22T07:34:24.849+0100","dialplan_app":"Stasis","dialplan_app_data":"trunking","channel":{"id":"CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-outgoing-channel","name":"PJSIP/domain-00000a96","state":"Down","caller":{"name":"","number":""},"connected":{"name":"","number":""},"accountcode":"","dialplan":{"context":"incoming","exten":"s","priority":1},"creationtime":"2019-03-22T07:34:24.849+0100","language":"en","channelvars":{"DIRECTION":"","PRIVACY":"","X_AUTH_DOMAIN":"","PPI":"","X_TO_DOMAIN":"","PAI":"","X_AUTH_USER":""}},"asterisk_id":"00:00:00:00:00:02","application":"trunking"},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":null}
[>>> ARI EVENT] Element: {"type":"CHANNELVARSET","commandsTopic":"trunking-commands-000000000002","payload":{"variable":"STASISSTATUS","value":"","type":"ChannelVarset","timestamp":"2019-03-22T07:34:24.850+0100","channel":{"id":"CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-outgoing-channel","name":"PJSIP/domain-00000a96","state":"Down","caller":{"name":"","number":""},"connected":{"name":"","number":""},"accountcode":"","dialplan":{"context":"incoming","exten":"s","priority":1},"creationtime":"2019-03-22T07:34:24.849+0100","language":"en","channelvars":{"DIRECTION":"","PRIVACY":"","X_AUTH_DOMAIN":"","PPI":"","X_TO_DOMAIN":"","PAI":"","X_AUTH_USER":""}},"asterisk_id":"00:00:00:00:00:02","application":"trunking"},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":null}
[>>> ARI EVENT] Element: {"type":"STASIS_START","commandsTopic":"trunking-commands-000000000002","payload":{"type":"StasisStart","timestamp":"2019-03-22T07:34:24.850+0100","args":[],"channel":{"id":"CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-outgoing-channel","name":"PJSIP/domain-00000a96","state":"Down","caller":{"name":"","number":""},"connected":{"name":"","number":""},"accountcode":"","dialplan":{"context":"incoming","exten":"s","priority":1},"creationtime":"2019-03-22T07:34:24.849+0100","language":"en","channelvars":{"DIRECTION":"","PRIVACY":"","X_AUTH_DOMAIN":"","PPI":"","X_TO_DOMAIN":"","PAI":"","X_AUTH_USER":""}},"asterisk_id":"00:00:00:00:00:02","application":"trunking"},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":null}
[>>> ARI RESPONSE] Element: {"type":"RESPONSE","commandsTopic":"trunking-commands-000000000002","payload":{"body":{"id":"CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-outgoing-channel","name":"PJSIP/domain-00000a96","state":"Down","caller":{"name":"","number":""},"connected":{"name":"","number":""},"accountcode":"","dialplan":{"context":"incoming","exten":"s","priority":1},"creationtime":"2019-03-22T07:34:24.849+0100","language":"en","channelvars":{"DIRECTION":"","PRIVACY":"","X_AUTH_DOMAIN":"","PPI":"","X_TO_DOMAIN":"","PAI":"","X_AUTH_USER":""}},"status_code":200},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":"outgoing-channel28b95171-cfcc-4e00-81e5-d93b6a60e73f"}
[>>> ARI COMMAND] Element: {"ariCommand":{"method":"POST","url":"/bridges","body":{"bridgeId":"CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-bridge"}},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":"bridge4a51523f-d8e6-4bbe-bca9-69bc16487162"}
[>>> ARI RESPONSE] Element: {"type":"RESPONSE","commandsTopic":"trunking-commands-000000000002","payload":{"body":{"id":"CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-bridge","technology":"simple_bridge","bridge_type":"mixing","bridge_class":"stasis","creator":"Stasis","name":"","channels":[],"video_mode":"talker"},"status_code":200},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":"bridge4a51523f-d8e6-4bbe-bca9-69bc16487162"}
[>>> ARI COMMAND] Element: {"ariCommand":{"method":"POST","url":"/bridges/CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-bridge/addChannel","body":{"channel":["1553236464.2709","CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-outgoing-channel"]}},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":"bridge88c98bf8-5dc5-4d94-8c9d-d921ba4ac6fb"}
[>>> ARI EVENT] Element: {"type":"CHANNEL_ENTERED_BRIDGE","commandsTopic":"trunking-commands-000000000002","payload":{"type":"ChannelEnteredBridge","timestamp":"2019-03-22T07:34:25.060+0100","bridge":{"id":"CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-bridge","technology":"simple_bridge","bridge_type":"mixing","bridge_class":"stasis","creator":"Stasis","name":"","channels":["1553236464.2709"],"video_mode":"talker"},"channel":{"id":"1553236464.2709","name":"PJSIP/ic_proxy_endpoint-00000a95","state":"Ring","caller":{"name":"491234567","number":"491234567"},"connected":{"name":"","number":""},"accountcode":"","dialplan":{"context":"default","exten":"49987654","priority":4},"creationtime":"2019-03-22T07:34:24.657+0100","language":"en","channelvars":{"DIRECTION":"incoming","PRIVACY":"","X_AUTH_DOMAIN":"","PPI":"<sip:491234567@domain>","X_TO_DOMAIN":"","PAI":"<sip:491234567@domain>","X_AUTH_USER":""}},"asterisk_id":"00:00:00:00:00:02","application":"trunking"},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":null}
[>>> ARI RESPONSE] Element: {"type":"RESPONSE","commandsTopic":"trunking-commands-000000000002","payload":{"status_code":204},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":"bridge88c98bf8-5dc5-4d94-8c9d-d921ba4ac6fb"}
[>>> ARI EVENT] Element: {"type":"CHANNEL_ENTERED_BRIDGE","commandsTopic":"trunking-commands-000000000002","payload":{"type":"ChannelEnteredBridge","timestamp":"2019-03-22T07:34:25.251+0100","bridge":{"id":"CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-bridge","technology":"simple_bridge","bridge_type":"mixing","bridge_class":"stasis","creator":"Stasis","name":"","channels":["1553236464.2709","CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-outgoing-channel"],"video_mode":"talker"},"channel":{"id":"CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-outgoing-channel","name":"PJSIP/domain-00000a96","state":"Down","caller":{"name":"","number":""},"connected":{"name":"","number":""},"accountcode":"","dialplan":{"context":"incoming","exten":"s","priority":1},"creationtime":"2019-03-22T07:34:24.849+0100","language":"en","channelvars":{"DIRECTION":"","PRIVACY":"","X_AUTH_DOMAIN":"","PPI":"","X_TO_DOMAIN":"","PAI":"","X_AUTH_USER":""}},"asterisk_id":"00:00:00:00:00:02","application":"trunking"},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":null}
[>>> ARI COMMAND] Element: {"ariCommand":{"method":"POST","url":"/channels/CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-outgoing-channel/variable","body":{"variable":"PJSIP_HEADER(add,P-Preferred-Identity)","value":"<sip:491234567@domain>"}},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":"outgoing-channel212a03d8-c22c-4646-b616-9af0cc53c40e"}
[>>> ARI COMMAND] Element: {"ariCommand":{"method":"POST","url":"/channels/CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-outgoing-channel/variable","body":{"variable":"PJSIP_HEADER(add,P-Asserted-Identity)","value":"<sip:491234567@domain>"}},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":"outgoing-channel2e312dbe-a68a-4f49-9124-e433160c18c6"}
[>>> ARI RESPONSE] Element: {"type":"RESPONSE","commandsTopic":"trunking-commands-000000000002","payload":{"status_code":204},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":"outgoing-channel212a03d8-c22c-4646-b616-9af0cc53c40e"}
[>>> ARI EVENT] Element: {"type":"CHANNELVARSET","commandsTopic":"trunking-commands-000000000002","payload":{"variable":"BRIDGEPEER","value":"PJSIP/domain-00000a96","type":"ChannelVarset","timestamp":"2019-03-22T07:34:25.251+0100","channel":{"id":"1553236464.2709","name":"PJSIP/ic_proxy_endpoint-00000a95","state":"Ring","caller":{"name":"491234567","number":"491234567"},"connected":{"name":"","number":""},"accountcode":"","dialplan":{"context":"default","exten":"49987654","priority":4},"creationtime":"2019-03-22T07:34:24.657+0100","language":"en","channelvars":{"DIRECTION":"incoming","PRIVACY":"","X_AUTH_DOMAIN":"","PPI":"<sip:491234567@domain>","X_TO_DOMAIN":"","PAI":"<sip:491234567@domain>","X_AUTH_USER":""}},"asterisk_id":"00:00:00:00:00:02","application":"trunking"},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":null}
[>>> ARI COMMAND] Element: {"ariCommand":{"method":"POST","url":"/channels/CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-outgoing-channel/variable","body":{"variable":"PJSIP_HEADER(add,Privacy)","value":"none"}},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":"outgoing-channele8f1ccf3-e38b-45e8-8979-569469e09524"}
[>>> ARI RESPONSE] Element: {"type":"RESPONSE","commandsTopic":"trunking-commands-000000000002","payload":{"status_code":204},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":"outgoing-channel2e312dbe-a68a-4f49-9124-e433160c18c6"}
[>>> ARI EVENT] Element: {"type":"CHANNELVARSET","commandsTopic":"trunking-commands-000000000002","payload":{"variable":"BRIDGEPVTCALLID","value":"2fcd4071-d2d8-4dc7-a467-26be4635eea3","type":"ChannelVarset","timestamp":"2019-03-22T07:34:25.251+0100","channel":{"id":"1553236464.2709","name":"PJSIP/ic_proxy_endpoint-00000a95","state":"Ring","caller":{"name":"491234567","number":"491234567"},"connected":{"name":"","number":""},"accountcode":"","dialplan":{"context":"default","exten":"49987654","priority":4},"creationtime":"2019-03-22T07:34:24.657+0100","language":"en","channelvars":{"DIRECTION":"incoming","PRIVACY":"","X_AUTH_DOMAIN":"","PPI":"<sip:491234567@domain>","X_TO_DOMAIN":"","PAI":"<sip:491234567@domain>","X_AUTH_USER":""}},"asterisk_id":"00:00:00:00:00:02","application":"trunking"},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":null}
[>>> ARI RESPONSE] Element: {"type":"RESPONSE","commandsTopic":"trunking-commands-000000000002","payload":{"status_code":204},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":"outgoing-channele8f1ccf3-e38b-45e8-8979-569469e09524"}
[>>> ARI EVENT] Element: {"type":"CHANNELVARSET","commandsTopic":"trunking-commands-000000000002","payload":{"variable":"BRIDGEPEER","value":"PJSIP/ic_proxy_endpoint-00000a95","type":"ChannelVarset","timestamp":"2019-03-22T07:34:25.251+0100","channel":{"id":"CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-outgoing-channel","name":"PJSIP/domain-00000a96","state":"Down","caller":{"name":"","number":""},"connected":{"name":"","number":""},"accountcode":"","dialplan":{"context":"incoming","exten":"s","priority":1},"creationtime":"2019-03-22T07:34:24.849+0100","language":"en","channelvars":{"DIRECTION":"","PRIVACY":"","X_AUTH_DOMAIN":"","PPI":"","X_TO_DOMAIN":"","PAI":"","X_AUTH_USER":""}},"asterisk_id":"00:00:00:00:00:02","application":"trunking"},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":null}
[>>> ARI EVENT] Element: {"type":"CHANNELVARSET","commandsTopic":"trunking-commands-000000000002","payload":{"variable":"BRIDGEPVTCALLID","value":"1339390567@212.9.41.5","type":"ChannelVarset","timestamp":"2019-03-22T07:34:25.251+0100","channel":{"id":"CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-outgoing-channel","name":"PJSIP/domain-00000a96","state":"Down","caller":{"name":"","number":""},"connected":{"name":"","number":""},"accountcode":"","dialplan":{"context":"incoming","exten":"s","priority":1},"creationtime":"2019-03-22T07:34:24.849+0100","language":"en","channelvars":{"DIRECTION":"","PRIVACY":"","X_AUTH_DOMAIN":"","PPI":"","X_TO_DOMAIN":"","PAI":"","X_AUTH_USER":""}},"asterisk_id":"00:00:00:00:00:02","application":"trunking"},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":null}
[>>> ARI EVENT] Element: {"type":"CHANNEL_CONNECTED_LINE","commandsTopic":"trunking-commands-000000000002","payload":{"type":"ChannelConnectedLine","timestamp":"2019-03-22T07:34:25.251+0100","channel":{"id":"CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-outgoing-channel","name":"PJSIP/domain-00000a96","state":"Down","caller":{"name":"","number":""},"connected":{"name":"491234567","number":"491234567"},"accountcode":"","dialplan":{"context":"incoming","exten":"s","priority":1},"creationtime":"2019-03-22T07:34:24.849+0100","language":"en","channelvars":{"DIRECTION":"","PRIVACY":"","X_AUTH_DOMAIN":"","PPI":"","X_TO_DOMAIN":"","PAI":"","X_AUTH_USER":""}},"asterisk_id":"00:00:00:00:00:02","application":"trunking"},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":null}
[>>> ARI COMMAND] Element: {"ariCommand":{"method":"DELETE","url":"/bridges/CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-bridge"},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":"bridge17cf090d-3d3e-43d6-8d18-b48d14290eac"}
[>>> ARI EVENT] Element: {"type":"CHANNELVARSET","commandsTopic":"trunking-commands-000000000002","payload":{"variable":"BRIDGEPEER","value":"","type":"ChannelVarset","timestamp":"2019-03-22T07:34:26.398+0100","channel":{"id":"1553236464.2709","name":"PJSIP/ic_proxy_endpoint-00000a95","state":"Ring","caller":{"name":"491234567","number":"491234567"},"connected":{"name":"","number":""},"accountcode":"","dialplan":{"context":"default","exten":"49987654","priority":4},"creationtime":"2019-03-22T07:34:24.657+0100","language":"en","channelvars":{"DIRECTION":"incoming","PRIVACY":"","X_AUTH_DOMAIN":"","PPI":"<sip:491234567@domain>","X_TO_DOMAIN":"","PAI":"<sip:491234567@domain>","X_AUTH_USER":""}},"asterisk_id":"00:00:00:00:00:02","application":"trunking"},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":null}
[>>> ARI EVENT] Element: {"type":"CHANNELVARSET","commandsTopic":"trunking-commands-000000000002","payload":{"variable":"BRIDGEPVTCALLID","value":"","type":"ChannelVarset","timestamp":"2019-03-22T07:34:26.398+0100","channel":{"id":"1553236464.2709","name":"PJSIP/ic_proxy_endpoint-00000a95","state":"Ring","caller":{"name":"491234567","number":"491234567"},"connected":{"name":"","number":""},"accountcode":"","dialplan":{"context":"default","exten":"49987654","priority":4},"creationtime":"2019-03-22T07:34:24.657+0100","language":"en","channelvars":{"DIRECTION":"incoming","PRIVACY":"","X_AUTH_DOMAIN":"","PPI":"<sip:491234567@domain>","X_TO_DOMAIN":"","PAI":"<sip:491234567@domain>","X_AUTH_USER":""}},"asterisk_id":"00:00:00:00:00:02","application":"trunking"},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":null}
[>>> ARI EVENT] Element: {"type":"CHANNELVARSET","commandsTopic":"trunking-commands-000000000002","payload":{"variable":"BRIDGEPEER","value":"","type":"ChannelVarset","timestamp":"2019-03-22T07:34:26.398+0100","channel":{"id":"CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-outgoing-channel","name":"PJSIP/domain-00000a96","state":"Down","caller":{"name":"","number":""},"connected":{"name":"491234567","number":"491234567"},"accountcode":"","dialplan":{"context":"incoming","exten":"s","priority":1},"creationtime":"2019-03-22T07:34:24.849+0100","language":"en","channelvars":{"DIRECTION":"","PRIVACY":"","X_AUTH_DOMAIN":"","PPI":"","X_TO_DOMAIN":"","PAI":"","X_AUTH_USER":""}},"asterisk_id":"00:00:00:00:00:02","application":"trunking"},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":null}
[>>> ARI RESPONSE] Element: {"type":"RESPONSE","commandsTopic":"trunking-commands-000000000002","payload":{"status_code":204},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":"bridge17cf090d-3d3e-43d6-8d18-b48d14290eac"}
[>>> ARI COMMAND] Element: {"ariCommand":{"method":"DELETE","url":"/channels/CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-outgoing-channel","body":{"reason":"normal"}},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":"outgoing-channel19fc2e5f-8be4-46ae-a34e-3bcf7c1808d3"}
[>>> ARI EVENT] Element: {"type":"CHANNELVARSET","commandsTopic":"trunking-commands-000000000002","payload":{"variable":"BRIDGEPVTCALLID","value":"","type":"ChannelVarset","timestamp":"2019-03-22T07:34:26.398+0100","channel":{"id":"CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-outgoing-channel","name":"PJSIP/domain-00000a96","state":"Down","caller":{"name":"","number":""},"connected":{"name":"491234567","number":"491234567"},"accountcode":"","dialplan":{"context":"incoming","exten":"s","priority":1},"creationtime":"2019-03-22T07:34:24.849+0100","language":"en","channelvars":{"DIRECTION":"","PRIVACY":"","X_AUTH_DOMAIN":"","PPI":"","X_TO_DOMAIN":"","PAI":"","X_AUTH_USER":""}},"asterisk_id":"00:00:00:00:00:02","application":"trunking"},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":null}
[>>> ARI RESPONSE] Element: {"type":"RESPONSE","commandsTopic":"trunking-commands-000000000002","payload":{"status_code":204},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":"outgoing-channel19fc2e5f-8be4-46ae-a34e-3bcf7c1808d3"}
[>>> ARI EVENT] Element: {"type":"CHANNEL_LEFT_BRIDGE","commandsTopic":"trunking-commands-000000000002","payload":{"type":"ChannelLeftBridge","timestamp":"2019-03-22T07:34:26.398+0100","bridge":{"id":"CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-bridge","technology":"simple_bridge","bridge_type":"mixing","bridge_class":"stasis","creator":"Stasis","name":"","channels":["1553236464.2709"],"video_mode":"talker"},"channel":{"id":"CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-outgoing-channel","name":"PJSIP/domain-00000a96","state":"Down","caller":{"name":"","number":""},"connected":{"name":"491234567","number":"491234567"},"accountcode":"","dialplan":{"context":"incoming","exten":"s","priority":1},"creationtime":"2019-03-22T07:34:24.849+0100","language":"en","channelvars":{"DIRECTION":"","PRIVACY":"","X_AUTH_DOMAIN":"","PPI":"","X_TO_DOMAIN":"","PAI":"","X_AUTH_USER":""}},"asterisk_id":"00:00:00:00:00:02","application":"trunking"},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":null}
[>>> ARI EVENT] Element: {"type":"CHANNEL_LEFT_BRIDGE","commandsTopic":"trunking-commands-000000000002","payload":{"type":"ChannelLeftBridge","timestamp":"2019-03-22T07:34:26.398+0100","bridge":{"id":"CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-bridge","technology":"simple_bridge","bridge_type":"mixing","bridge_class":"stasis","creator":"Stasis","name":"","channels":[],"video_mode":"talker"},"channel":{"id":"1553236464.2709","name":"PJSIP/ic_proxy_endpoint-00000a95","state":"Ring","caller":{"name":"491234567","number":"491234567"},"connected":{"name":"","number":""},"accountcode":"","dialplan":{"context":"default","exten":"49987654","priority":4},"creationtime":"2019-03-22T07:34:24.657+0100","language":"en","channelvars":{"DIRECTION":"incoming","PRIVACY":"","X_AUTH_DOMAIN":"","PPI":"<sip:491234567@domain>","X_TO_DOMAIN":"","PAI":"<sip:491234567@domain>","X_AUTH_USER":""}},"asterisk_id":"00:00:00:00:00:02","application":"trunking"},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":null}
[>>> ARI EVENT] Element: {"type":"CHANNEL_HANGUP_REQUEST","commandsTopic":"trunking-commands-000000000002","payload":{"cause":32,"soft":true,"type":"ChannelHangupRequest","timestamp":"2019-03-22T07:34:26.411+0100","channel":{"id":"CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-outgoing-channel","name":"PJSIP/domain-00000a96","state":"Down","caller":{"name":"","number":""},"connected":{"name":"491234567","number":"491234567"},"accountcode":"","dialplan":{"context":"incoming","exten":"s","priority":1},"creationtime":"2019-03-22T07:34:24.849+0100","language":"en","channelvars":{"DIRECTION":"","PRIVACY":"","X_AUTH_DOMAIN":"","PPI":"","X_TO_DOMAIN":"","PAI":"","X_AUTH_USER":""}},"asterisk_id":"00:00:00:00:00:02","application":"trunking"},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":null}
[>>> ARI EVENT] Element: {"type":"STASIS_END","commandsTopic":"trunking-commands-000000000002","payload":{"type":"StasisEnd","timestamp":"2019-03-22T07:34:26.412+0100","channel":{"id":"CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-outgoing-channel","name":"PJSIP/domain-00000a96","state":"Down","caller":{"name":"","number":""},"connected":{"name":"491234567","number":"491234567"},"accountcode":"","dialplan":{"context":"incoming","exten":"s","priority":1},"creationtime":"2019-03-22T07:34:24.849+0100","language":"en","channelvars":{"DIRECTION":"","PRIVACY":"","X_AUTH_DOMAIN":"","PPI":"","X_TO_DOMAIN":"","PAI":"","X_AUTH_USER":""}},"asterisk_id":"00:00:00:00:00:02","application":"trunking"},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":null}
[>>> ARI EVENT] Element: {"type":"CHANNELVARSET","commandsTopic":"trunking-commands-000000000002","payload":{"variable":"STASISSTATUS","value":"SUCCESS","type":"ChannelVarset","timestamp":"2019-03-22T07:34:26.412+0100","channel":{"id":"CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-outgoing-channel","name":"PJSIP/domain-00000a96","state":"Down","caller":{"name":"","number":""},"connected":{"name":"491234567","number":"491234567"},"accountcode":"","dialplan":{"context":"incoming","exten":"s","priority":1},"creationtime":"2019-03-22T07:34:24.849+0100","language":"en","channelvars":{"DIRECTION":"","PRIVACY":"","X_AUTH_DOMAIN":"","PPI":"","X_TO_DOMAIN":"","PAI":"","X_AUTH_USER":""}},"asterisk_id":"00:00:00:00:00:02","application":"trunking"},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":null}
[>>> ARI EVENT] Element: {"type":"CHANNEL_HANGUP_REQUEST","commandsTopic":"trunking-commands-000000000002","payload":{"type":"ChannelHangupRequest","timestamp":"2019-03-22T07:34:26.412+0100","channel":{"id":"CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-outgoing-channel","name":"PJSIP/domain-00000a96","state":"Down","caller":{"name":"","number":""},"connected":{"name":"491234567","number":"491234567"},"accountcode":"","dialplan":{"context":"incoming","exten":"s","priority":1},"creationtime":"2019-03-22T07:34:24.849+0100","language":"en","channelvars":{"DIRECTION":"","PRIVACY":"","X_AUTH_DOMAIN":"","PPI":"","X_TO_DOMAIN":"","PAI":"","X_AUTH_USER":""}},"asterisk_id":"00:00:00:00:00:02","application":"trunking"},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":null}
[>>> ARI EVENT] Element: {"type":"CHANNEL_DESTROYED","commandsTopic":"trunking-commands-000000000002","payload":{"type":"ChannelDestroyed","timestamp":"2019-03-22T07:34:26.412+0100","cause":16,"cause_txt":"Normal Clearing","channel":{"id":"CallHandlingae48a997-d911-44d8-aa0b-2fcf1182446d-outgoing-channel","name":"PJSIP/domain-00000a96","state":"Down","caller":{"name":"","number":""},"connected":{"name":"491234567","number":"491234567"},"accountcode":"","dialplan":{"context":"incoming","exten":"s","priority":1},"creationtime":"2019-03-22T07:34:24.849+0100","language":"en","channelvars":{"DIRECTION":"","PRIVACY":"","X_AUTH_DOMAIN":"","PPI":"","X_TO_DOMAIN":"","PAI":"","X_AUTH_USER":""}},"asterisk_id":"00:00:00:00:00:02","application":"trunking"},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":null}
[>>> ARI COMMAND] Element: {"ariCommand":{"method":"DELETE","url":"/channels/1553236464.2709","body":{"reason":"normal"}},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":"incoming-channel4d94e5ca-e06a-461f-8a64-d890c8e97b39"}
[>>> ARI RESPONSE] Element: {"type":"RESPONSE","commandsTopic":"trunking-commands-000000000002","payload":{"status_code":204},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":"incoming-channel4d94e5ca-e06a-461f-8a64-d890c8e97b39"}
[>>> ARI EVENT] Element: {"type":"CHANNEL_HANGUP_REQUEST","commandsTopic":"trunking-commands-000000000002","payload":{"cause":32,"soft":true,"type":"ChannelHangupRequest","timestamp":"2019-03-22T07:34:26.468+0100","channel":{"id":"1553236464.2709","name":"PJSIP/ic_proxy_endpoint-00000a95","state":"Ring","caller":{"name":"491234567","number":"491234567"},"connected":{"name":"","number":""},"accountcode":"","dialplan":{"context":"default","exten":"49987654","priority":4},"creationtime":"2019-03-22T07:34:24.657+0100","language":"en","channelvars":{"DIRECTION":"incoming","PRIVACY":"","X_AUTH_DOMAIN":"","PPI":"<sip:491234567@domain>","X_TO_DOMAIN":"","PAI":"<sip:491234567@domain>","X_AUTH_USER":""}},"asterisk_id":"00:00:00:00:00:02","application":"trunking"},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":null}
[>>> ARI EVENT] Element: {"type":"STASIS_END","commandsTopic":"trunking-commands-000000000002","payload":{"type":"StasisEnd","timestamp":"2019-03-22T07:34:26.468+0100","channel":{"id":"1553236464.2709","name":"PJSIP/ic_proxy_endpoint-00000a95","state":"Ring","caller":{"name":"491234567","number":"491234567"},"connected":{"name":"","number":""},"accountcode":"","dialplan":{"context":"default","exten":"49987654","priority":4},"creationtime":"2019-03-22T07:34:24.657+0100","language":"en","channelvars":{"DIRECTION":"incoming","PRIVACY":"","X_AUTH_DOMAIN":"","PPI":"<sip:491234567@domain>","X_TO_DOMAIN":"","PAI":"<sip:491234567@domain>","X_AUTH_USER":""}},"asterisk_id":"00:00:00:00:00:02","application":"trunking"},"callContext":"ae48a997-d911-44d8-aa0b-2fcf1182446d","commandId":null}

{noformat}

Comments: By: Asterisk Team (asteriskteam) 2019-03-26 04:22:02.016-0500

Thanks for creating a report! The issue has entered the triage process. That means the issue will wait in this status until a Bug Marshal has an opportunity to review the issue. Once the issue has been reviewed you will receive comments regarding the next steps towards resolution.

A good first step is for you to review the [Asterisk Issue Guidelines|https://wiki.asterisk.org/wiki/display/AST/Asterisk+Issue+Guidelines] if you haven't already. The guidelines detail what is expected from an Asterisk issue report.

Then, if you are submitting a patch, please review the [Patch Contribution Process|https://wiki.asterisk.org/wiki/display/AST/Patch+Contribution+Process].

Please note that once your issue enters an open state it has been accepted. As Asterisk is an open source project there is no guarantee or timeframe on when your issue will be looked into. If you need expedient resolution you will need to find and pay a suitable developer. Asking for an update on your issue will not yield any progress on it and will not result in a response. All updates are posted to the issue when they occur.
By: Joshua C. Colp (jcolp) 2019-03-26 04:33:24.498-0500

What happens if you remove the channels from the bridge before deleting it and them?
By: Joeran Vinzens (jvinzens) 2019-03-26 06:31:28.696-0500

we have changed the behavior in order to ensure all channels are deleted before the bridge gets deleted. So far it is stable (one day with very little traffic). Before we had about a crash per day with same amount of traffic.
As we understood the backtrace and logs it seems to be a problem if the channel try to delete some reference in the bridge (which is deleted at that time).

As soon as we have more information about the updated behavior i will let you know.
By: Joshua C. Colp (jcolp) 2019-03-28 08:22:28.427-0500

Assigning back to you for feedback for confirmation that the workaround is good.
By: Joeran Vinzens (jvinzens) 2019-03-28 08:38:18.528-0500

So far (4 Days now) we have not seen any crash. it seems to work well.

What we do in our code is deleting both channels, and on each response on that delete we check if there are still channels left. Only if there is no channel left we delete the bridge.