======================================================================= === Currently Held Locks ============================================== ======================================================================= === === (): (times locked) === === Thread ID: 0x7f5c6227a710 (logger_thread started at [ 1042] logger.c init_logger()) === ---> Lock #0 (logger.c): RDLOCK 899 logger_print_normal &(&verbosers)->lock 0x812fd0 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_rwlock_rdlock+0xd9) [0x4ebdca] /usr/sbin/asterisk() [0x4ef6df] /usr/sbin/asterisk() [0x4efeb4] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === ------------------------------------------------------------------- === === Thread ID: 0x7f5c62182710 (do_devstate_changes started at [ 724] devicestate.c ast_device_state_engine_init()) === ---> Lock #0 (astobj2.c): MUTEX 668 internal_ao2_callback c 0x7f5c5c5120e0 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xd9) [0x4e9db7] /usr/sbin/asterisk(__ao2_lock+0x5a) [0x449964] /usr/sbin/asterisk() [0x44a6c9] /usr/sbin/asterisk(__ao2_callback+0x5f) [0x44ac08] /usr/sbin/asterisk(__ao2_find+0x31) [0x44ad7a] /usr/sbin/asterisk() [0x471ced] /usr/sbin/asterisk(ast_channel_get_by_name_prefix+0x2e) [0x471dc5] /usr/sbin/asterisk(ast_parse_device_state+0x49) [0x4a39aa] /usr/sbin/asterisk() [0x4a3cc8] /usr/sbin/asterisk() [0x4a4148] /usr/sbin/asterisk() [0x4a45b6] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === ---> Waiting for Lock #1 (channel.c): MUTEX 1667 ast_channel_cmp_cb chan 0x7f5c4817f9b0 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_trylock+0xd9) [0x4ea172] /usr/sbin/asterisk(__ao2_trylock+0x5a) [0x449a26] /usr/lib/asterisk/modules/chan_sip.so(+0x16911) [0x7f5c59043911] /usr/sbin/asterisk(ast_sched_runq+0x18e) [0x551c21] /usr/lib/asterisk/modules/chan_sip.so(+0x7fa8c) [0x7f5c590aca8c] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === --- ---> Locked Here: channel.c line 3704 (__ast_read) === ------------------------------------------------------------------- === === Thread ID: 0x7f5c62106710 (tps_processing_function started at [ 451] taskprocessor.c ast_taskprocessor_get()) === ---> Lock #0 (pbx.c): MUTEX 4383 handle_statechange hints 0x849290 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xd9) [0x4e9db7] /usr/sbin/asterisk(__ao2_lock+0x5a) [0x449964] /usr/sbin/asterisk() [0x5133f1] /usr/sbin/asterisk() [0x55c1af] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === ---> Lock #1 (pbx.c): MUTEX 4384 handle_statechange hint 0x551e410 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xd9) [0x4e9db7] /usr/sbin/asterisk(__ao2_lock+0x5a) [0x449964] /usr/sbin/asterisk() [0x513412] /usr/sbin/asterisk() [0x55c1af] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === ---> Waiting for Lock #2 (astobj2.c): MUTEX 857 internal_ao2_iterator_next a->c 0x7f5c440a9090 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xd9) [0x4e9db7] /usr/sbin/asterisk(__ao2_lock+0x5a) [0x449964] /usr/sbin/asterisk() [0x44a6c9] /usr/sbin/asterisk(__ao2_callback+0x5f) [0x44ac08] /usr/sbin/asterisk(__ao2_find+0x31) [0x44ad7a] /usr/lib/asterisk/modules/app_queue.so(+0xdef9) [0x7f5c5b3c1ef9] /usr/lib/asterisk/modules/app_queue.so(+0x1ed9f) [0x7f5c5b3d2d9f] /usr/sbin/asterisk(ast_func_read+0x187) [0x510cf4] /usr/sbin/asterisk(pbx_substitute_variables_helper_full+0x39d) [0x511fa0] /usr/sbin/asterisk(pbx_substitute_variables_helper+0x54) [0x51252c] /usr/sbin/asterisk() [0x51263b] /usr/sbin/asterisk() [0x5128b2] /usr/sbin/asterisk(ast_spawn_extension+0x65) [0x5145ed] /usr/sbin/asterisk() [0x514ff6] /usr/sbin/asterisk() [0x516b52] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === --- ---> Locked Here: app_queue.c line 4427 (try_calling) === ------------------------------------------------------------------- === === Thread ID: 0x7f5c51a9a710 (do_monitor started at [24874] chan_sip.c restart_monitor()) === ---> Lock #0 (chan_sip.c): MUTEX 24846 do_monitor &monlock 0x7f5c592f70a0 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xd9) [0x4e9db7] /usr/lib/asterisk/modules/chan_sip.so(+0x7fa7a) [0x7f5c590aca7a] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === ---> Tried and failed to get Lock #1 (chan_sip.c): MUTEX 3665 __sip_autodestruct p->owner 0x7f5c4817f9b0 (0) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_trylock+0xd9) [0x4ea172] /usr/sbin/asterisk(__ao2_trylock+0x5a) [0x449a26] /usr/lib/asterisk/modules/chan_sip.so(+0x16911) [0x7f5c59043911] /usr/sbin/asterisk(ast_sched_runq+0x18e) [0x551c21] /usr/lib/asterisk/modules/chan_sip.so(+0x7fa8c) [0x7f5c590aca8c] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === ------------------------------------------------------------------- === === Thread ID: 0x7f5c50e57710 (tps_processing_function started at [ 451] taskprocessor.c ast_taskprocessor_get()) === ---> Waiting for Lock #0 (astobj2.c): MUTEX 857 internal_ao2_iterator_next a->c 0x7f5c440a9090 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xd9) [0x4e9db7] /usr/sbin/asterisk(__ao2_lock+0x5a) [0x449964] /usr/sbin/asterisk() [0x44a6c9] /usr/sbin/asterisk(__ao2_callback+0x5f) [0x44ac08] /usr/sbin/asterisk(__ao2_find+0x31) [0x44ad7a] /usr/lib/asterisk/modules/app_queue.so(+0xdef9) [0x7f5c5b3c1ef9] /usr/lib/asterisk/modules/app_queue.so(+0x1ed9f) [0x7f5c5b3d2d9f] /usr/sbin/asterisk(ast_func_read+0x187) [0x510cf4] /usr/sbin/asterisk(pbx_substitute_variables_helper_full+0x39d) [0x511fa0] /usr/sbin/asterisk(pbx_substitute_variables_helper+0x54) [0x51252c] /usr/sbin/asterisk() [0x51263b] /usr/sbin/asterisk() [0x5128b2] /usr/sbin/asterisk(ast_spawn_extension+0x65) [0x5145ed] /usr/sbin/asterisk() [0x514ff6] /usr/sbin/asterisk() [0x516b52] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === --- ---> Locked Here: app_queue.c line 4427 (try_calling) === ------------------------------------------------------------------- === === Thread ID: 0x7f5c50d5f710 (netconsole started at [ 1349] asterisk.c listener()) === ---> Waiting for Lock #0 (astobj2.c): MUTEX 857 internal_ao2_iterator_next a->c 0x7f5c5c5120e0 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xd9) [0x4e9db7] /usr/sbin/asterisk(__ao2_lock+0x5a) [0x449964] /usr/sbin/asterisk() [0x44a6c9] /usr/sbin/asterisk(__ao2_callback+0x5f) [0x44ac08] /usr/sbin/asterisk(__ao2_unlink+0x4d) [0x44a47a] /usr/sbin/asterisk(ast_channel_release+0x27) [0x4720fc] /usr/sbin/asterisk() [0x5217af] /usr/sbin/asterisk(ast_pbx_outgoing_exten+0x3f5) [0x521baf] /usr/sbin/asterisk() [0x4fb8db] /usr/sbin/asterisk() [0x4fd73b] /usr/sbin/asterisk() [0x4fdeeb] /usr/sbin/asterisk() [0x4fe348] /usr/sbin/asterisk() [0x55d684] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === --- ---> Locked Here: astobj2.c line 668 (internal_ao2_callback) === ------------------------------------------------------------------- === === Thread ID: 0x7f5c50b6f710 (pbx_thread started at [ 5170] pbx.c ast_pbx_start()) === ---> Waiting for Lock #0 (astobj2.c): MUTEX 668 internal_ao2_callback c 0x7f5c440a9090 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xd9) [0x4e9db7] /usr/sbin/asterisk(__ao2_lock+0x5a) [0x449964] /usr/sbin/asterisk() [0x44a6c9] /usr/sbin/asterisk(__ao2_callback+0x5f) [0x44ac08] /usr/sbin/asterisk(__ao2_find+0x31) [0x44ad7a] /usr/lib/asterisk/modules/app_queue.so(+0xdef9) [0x7f5c5b3c1ef9] /usr/lib/asterisk/modules/app_queue.so(+0x1ed9f) [0x7f5c5b3d2d9f] /usr/sbin/asterisk(ast_func_read+0x187) [0x510cf4] /usr/sbin/asterisk(pbx_substitute_variables_helper_full+0x39d) [0x511fa0] /usr/sbin/asterisk(pbx_substitute_variables_helper+0x54) [0x51252c] /usr/sbin/asterisk() [0x51263b] /usr/sbin/asterisk() [0x5128b2] /usr/sbin/asterisk(ast_spawn_extension+0x65) [0x5145ed] /usr/sbin/asterisk() [0x514ff6] /usr/sbin/asterisk() [0x516b52] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === --- ---> Locked Here: app_queue.c line 4427 (try_calling) === ------------------------------------------------------------------- === === Thread ID: 0x7f5c5061b710 (pbx_thread started at [ 5170] pbx.c ast_pbx_start()) === ---> Waiting for Lock #0 (astobj2.c): MUTEX 668 internal_ao2_callback c 0x7f5c440a9090 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xd9) [0x4e9db7] /usr/sbin/asterisk(__ao2_lock+0x5a) [0x449964] /usr/sbin/asterisk() [0x44a6c9] /usr/sbin/asterisk(__ao2_callback+0x5f) [0x44ac08] /usr/sbin/asterisk(__ao2_find+0x31) [0x44ad7a] /usr/lib/asterisk/modules/app_queue.so(+0xdef9) [0x7f5c5b3c1ef9] /usr/lib/asterisk/modules/app_queue.so(+0x1ed9f) [0x7f5c5b3d2d9f] /usr/sbin/asterisk(ast_func_read+0x187) [0x510cf4] /usr/sbin/asterisk(pbx_substitute_variables_helper_full+0x39d) [0x511fa0] /usr/sbin/asterisk(pbx_substitute_variables_helper+0x54) [0x51252c] /usr/sbin/asterisk() [0x51263b] /usr/sbin/asterisk() [0x5128b2] /usr/sbin/asterisk(ast_spawn_extension+0x65) [0x5145ed] /usr/sbin/asterisk() [0x514ff6] /usr/sbin/asterisk() [0x516b52] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === --- ---> Locked Here: app_queue.c line 4427 (try_calling) === ------------------------------------------------------------------- === === Thread ID: 0x7f5c50a77710 (pbx_thread started at [ 5170] pbx.c ast_pbx_start()) === ---> Waiting for Lock #0 (astobj2.c): MUTEX 668 internal_ao2_callback c 0x7f5c440a9090 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xd9) [0x4e9db7] /usr/sbin/asterisk(__ao2_lock+0x5a) [0x449964] /usr/sbin/asterisk() [0x44a6c9] /usr/sbin/asterisk(__ao2_callback+0x5f) [0x44ac08] /usr/sbin/asterisk(__ao2_find+0x31) [0x44ad7a] /usr/lib/asterisk/modules/app_queue.so(+0xdef9) [0x7f5c5b3c1ef9] /usr/lib/asterisk/modules/app_queue.so(+0x1ed9f) [0x7f5c5b3d2d9f] /usr/sbin/asterisk(ast_func_read+0x187) [0x510cf4] /usr/sbin/asterisk(pbx_substitute_variables_helper_full+0x39d) [0x511fa0] /usr/sbin/asterisk(pbx_substitute_variables_helper+0x54) [0x51252c] /usr/sbin/asterisk() [0x51263b] /usr/sbin/asterisk() [0x5128b2] /usr/sbin/asterisk(ast_spawn_extension+0x65) [0x5145ed] /usr/sbin/asterisk() [0x514ff6] /usr/sbin/asterisk() [0x516b52] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === --- ---> Locked Here: app_queue.c line 4427 (try_calling) === ------------------------------------------------------------------- === === Thread ID: 0x7f5c5059f710 (pbx_thread started at [ 5170] pbx.c ast_pbx_start()) === ---> Waiting for Lock #0 (astobj2.c): MUTEX 668 internal_ao2_callback c 0x7f5c440a9090 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xd9) [0x4e9db7] /usr/sbin/asterisk(__ao2_lock+0x5a) [0x449964] /usr/sbin/asterisk() [0x44a6c9] /usr/sbin/asterisk(__ao2_callback+0x5f) [0x44ac08] /usr/sbin/asterisk(__ao2_find+0x31) [0x44ad7a] /usr/lib/asterisk/modules/app_queue.so(+0xdef9) [0x7f5c5b3c1ef9] /usr/lib/asterisk/modules/app_queue.so(+0x1ed9f) [0x7f5c5b3d2d9f] /usr/sbin/asterisk(ast_func_read+0x187) [0x510cf4] /usr/sbin/asterisk(pbx_substitute_variables_helper_full+0x39d) [0x511fa0] /usr/sbin/asterisk(pbx_substitute_variables_helper+0x54) [0x51252c] /usr/sbin/asterisk() [0x51263b] /usr/sbin/asterisk() [0x5128b2] /usr/sbin/asterisk(ast_spawn_extension+0x65) [0x5145ed] /usr/sbin/asterisk() [0x514ff6] /usr/sbin/asterisk() [0x516b52] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === --- ---> Locked Here: app_queue.c line 4427 (try_calling) === ------------------------------------------------------------------- === === Thread ID: 0x7f5c504a7710 (pbx_thread started at [ 5170] pbx.c ast_pbx_start()) === ---> Waiting for Lock #0 (astobj2.c): MUTEX 668 internal_ao2_callback c 0x7f5c5c5120e0 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xd9) [0x4e9db7] /usr/sbin/asterisk(__ao2_lock+0x5a) [0x449964] /usr/sbin/asterisk() [0x44a6c9] /usr/sbin/asterisk(__ao2_callback+0x5f) [0x44ac08] /usr/sbin/asterisk(__ao2_unlink+0x4d) [0x44a47a] /usr/sbin/asterisk(ast_channel_release+0x27) [0x4720fc] /usr/sbin/asterisk() [0x5217af] /usr/sbin/asterisk(ast_pbx_outgoing_exten+0x3f5) [0x521baf] /usr/sbin/asterisk() [0x4fb8db] /usr/sbin/asterisk() [0x4fd73b] /usr/sbin/asterisk() [0x4fdeeb] /usr/sbin/asterisk() [0x4fe348] /usr/sbin/asterisk() [0x55d684] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === --- ---> Locked Here: astobj2.c line 668 (internal_ao2_callback) === ------------------------------------------------------------------- === === Thread ID: 0x7f5c5042b710 (pbx_thread started at [ 5170] pbx.c ast_pbx_start()) === ---> Waiting for Lock #0 (astobj2.c): MUTEX 668 internal_ao2_callback c 0x7f5c440a9090 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xd9) [0x4e9db7] /usr/sbin/asterisk(__ao2_lock+0x5a) [0x449964] /usr/sbin/asterisk() [0x44a6c9] /usr/sbin/asterisk(__ao2_callback+0x5f) [0x44ac08] /usr/sbin/asterisk(__ao2_find+0x31) [0x44ad7a] /usr/lib/asterisk/modules/app_queue.so(+0xdef9) [0x7f5c5b3c1ef9] /usr/lib/asterisk/modules/app_queue.so(+0x1ed9f) [0x7f5c5b3d2d9f] /usr/sbin/asterisk(ast_func_read+0x187) [0x510cf4] /usr/sbin/asterisk(pbx_substitute_variables_helper_full+0x39d) [0x511fa0] /usr/sbin/asterisk(pbx_substitute_variables_helper+0x54) [0x51252c] /usr/sbin/asterisk() [0x51263b] /usr/sbin/asterisk() [0x5128b2] /usr/sbin/asterisk(ast_spawn_extension+0x65) [0x5145ed] /usr/sbin/asterisk() [0x514ff6] /usr/sbin/asterisk() [0x516b52] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === --- ---> Locked Here: app_queue.c line 4427 (try_calling) === ------------------------------------------------------------------- === === Thread ID: 0x7f5c50af3710 (pbx_thread started at [ 5170] pbx.c ast_pbx_start()) === ---> Waiting for Lock #0 (app_queue.c): MUTEX 4427 try_calling queues 0x7f5c440a9090 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xd9) [0x4e9db7] /usr/sbin/asterisk(__ao2_lock+0x5a) [0x449964] /usr/sbin/asterisk() [0x44a6c9] /usr/sbin/asterisk(__ao2_callback+0x5f) [0x44ac08] /usr/sbin/asterisk(__ao2_find+0x31) [0x44ad7a] /usr/lib/asterisk/modules/app_queue.so(+0xdef9) [0x7f5c5b3c1ef9] /usr/lib/asterisk/modules/app_queue.so(+0x1ed9f) [0x7f5c5b3d2d9f] /usr/sbin/asterisk(ast_func_read+0x187) [0x510cf4] /usr/sbin/asterisk(pbx_substitute_variables_helper_full+0x39d) [0x511fa0] /usr/sbin/asterisk(pbx_substitute_variables_helper+0x54) [0x51252c] /usr/sbin/asterisk() [0x51263b] /usr/sbin/asterisk() [0x5128b2] /usr/sbin/asterisk(ast_spawn_extension+0x65) [0x5145ed] /usr/sbin/asterisk() [0x514ff6] /usr/sbin/asterisk() [0x516b52] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === --- ---> Locked Here: app_queue.c line 4427 (try_calling) === ------------------------------------------------------------------- === === Thread ID: 0x7f5c50697710 (pbx_thread started at [ 5170] pbx.c ast_pbx_start()) === ---> Waiting for Lock #0 (astobj2.c): MUTEX 668 internal_ao2_callback c 0x7f5c440a9090 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xd9) [0x4e9db7] /usr/sbin/asterisk(__ao2_lock+0x5a) [0x449964] /usr/sbin/asterisk() [0x44a6c9] /usr/sbin/asterisk(__ao2_callback+0x5f) [0x44ac08] /usr/sbin/asterisk(__ao2_find+0x31) [0x44ad7a] /usr/lib/asterisk/modules/app_queue.so(+0xdef9) [0x7f5c5b3c1ef9] /usr/lib/asterisk/modules/app_queue.so(+0x1ed9f) [0x7f5c5b3d2d9f] /usr/sbin/asterisk(ast_func_read+0x187) [0x510cf4] /usr/sbin/asterisk(pbx_substitute_variables_helper_full+0x39d) [0x511fa0] /usr/sbin/asterisk(pbx_substitute_variables_helper+0x54) [0x51252c] /usr/sbin/asterisk() [0x51263b] /usr/sbin/asterisk() [0x5128b2] /usr/sbin/asterisk(ast_spawn_extension+0x65) [0x5145ed] /usr/sbin/asterisk() [0x514ff6] /usr/sbin/asterisk() [0x516b52] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === --- ---> Locked Here: app_queue.c line 4427 (try_calling) === ------------------------------------------------------------------- === === Thread ID: 0x7f5c50ce3710 (pbx_thread started at [ 5170] pbx.c ast_pbx_start()) === ---> Waiting for Lock #0 (astobj2.c): MUTEX 668 internal_ao2_callback c 0x7f5c440a9090 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xd9) [0x4e9db7] /usr/sbin/asterisk(__ao2_lock+0x5a) [0x449964] /usr/sbin/asterisk() [0x44a6c9] /usr/sbin/asterisk(__ao2_callback+0x5f) [0x44ac08] /usr/sbin/asterisk(__ao2_find+0x31) [0x44ad7a] /usr/lib/asterisk/modules/app_queue.so(+0xdef9) [0x7f5c5b3c1ef9] /usr/lib/asterisk/modules/app_queue.so(+0x1ed9f) [0x7f5c5b3d2d9f] /usr/sbin/asterisk(ast_func_read+0x187) [0x510cf4] /usr/sbin/asterisk(pbx_substitute_variables_helper_full+0x39d) [0x511fa0] /usr/sbin/asterisk(pbx_substitute_variables_helper+0x54) [0x51252c] /usr/sbin/asterisk() [0x51263b] /usr/sbin/asterisk() [0x5128b2] /usr/sbin/asterisk(ast_spawn_extension+0x65) [0x5145ed] /usr/sbin/asterisk() [0x514ff6] /usr/sbin/asterisk() [0x516b52] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === --- ---> Locked Here: app_queue.c line 4427 (try_calling) === ------------------------------------------------------------------- === === Thread ID: 0x7f5c50713710 (pbx_thread started at [ 5170] pbx.c ast_pbx_start()) === ---> Waiting for Lock #0 (astobj2.c): MUTEX 668 internal_ao2_callback c 0x7f5c440a9090 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xd9) [0x4e9db7] /usr/sbin/asterisk(__ao2_lock+0x5a) [0x449964] /usr/sbin/asterisk() [0x44a6c9] /usr/sbin/asterisk(__ao2_callback+0x5f) [0x44ac08] /usr/sbin/asterisk(__ao2_find+0x31) [0x44ad7a] /usr/lib/asterisk/modules/app_queue.so(+0xdef9) [0x7f5c5b3c1ef9] /usr/lib/asterisk/modules/app_queue.so(+0x1ed9f) [0x7f5c5b3d2d9f] /usr/sbin/asterisk(ast_func_read+0x187) [0x510cf4] /usr/sbin/asterisk(pbx_substitute_variables_helper_full+0x39d) [0x511fa0] /usr/sbin/asterisk(pbx_substitute_variables_helper+0x54) [0x51252c] /usr/sbin/asterisk() [0x51263b] /usr/sbin/asterisk() [0x5128b2] /usr/sbin/asterisk(ast_spawn_extension+0x65) [0x5145ed] /usr/sbin/asterisk() [0x514ff6] /usr/sbin/asterisk() [0x516b52] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === --- ---> Locked Here: app_queue.c line 4427 (try_calling) === ------------------------------------------------------------------- === === Thread ID: 0x7f5c50333710 (pbx_thread started at [ 5170] pbx.c ast_pbx_start()) === ---> Waiting for Lock #0 (astobj2.c): MUTEX 668 internal_ao2_callback c 0x7f5c440a9090 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xd9) [0x4e9db7] /usr/sbin/asterisk(__ao2_lock+0x5a) [0x449964] /usr/sbin/asterisk() [0x44a6c9] /usr/sbin/asterisk(__ao2_callback+0x5f) [0x44ac08] /usr/sbin/asterisk(__ao2_find+0x31) [0x44ad7a] /usr/lib/asterisk/modules/app_queue.so(+0xdef9) [0x7f5c5b3c1ef9] /usr/lib/asterisk/modules/app_queue.so(+0x1ed9f) [0x7f5c5b3d2d9f] /usr/sbin/asterisk(ast_func_read+0x187) [0x510cf4] /usr/sbin/asterisk(pbx_substitute_variables_helper_full+0x39d) [0x511fa0] /usr/sbin/asterisk(pbx_substitute_variables_helper+0x54) [0x51252c] /usr/sbin/asterisk() [0x51263b] /usr/sbin/asterisk() [0x5128b2] /usr/sbin/asterisk(ast_spawn_extension+0x65) [0x5145ed] /usr/sbin/asterisk() [0x514ff6] /usr/sbin/asterisk() [0x516b52] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === --- ---> Locked Here: app_queue.c line 4427 (try_calling) === ------------------------------------------------------------------- === === Thread ID: 0x7f5c5080b710 (pbx_thread started at [ 5170] pbx.c ast_pbx_start()) === ---> Lock #0 (channel.c): MUTEX 3704 __ast_read chan 0x7f5c4817f9b0 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xd9) [0x4e9db7] /usr/sbin/asterisk(__ao2_lock+0x5a) [0x449964] /usr/lib/asterisk/modules/chan_sip.so(+0x2a419) [0x7f5c59057419] /usr/lib/asterisk/modules/chan_sip.so(+0x7e29c) [0x7f5c590ab29c] /usr/lib/asterisk/modules/chan_sip.so(+0x7dfbb) [0x7f5c590aafbb] /usr/sbin/asterisk(ast_io_wait+0x19c) [0x4e408a] /usr/lib/asterisk/modules/chan_sip.so(+0x7f9da) [0x7f5c590ac9da] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === ------------------------------------------------------------------- === === Thread ID: 0x7f5c50c67710 (pbx_thread started at [ 5170] pbx.c ast_pbx_start()) === ---> Lock #0 (app_queue.c): MUTEX 4427 try_calling queues 0x7f5c440a9090 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xd9) [0x4e9db7] /usr/sbin/asterisk(__ao2_lock+0x5a) [0x449964] /usr/lib/asterisk/modules/app_queue.so(+0x167e6) [0x7f5c5b3ca7e6] /usr/lib/asterisk/modules/app_queue.so(+0x1e280) [0x7f5c5b3d2280] /usr/sbin/asterisk(pbx_exec+0x1fb) [0x509060] /usr/sbin/asterisk() [0x512b53] /usr/sbin/asterisk(ast_spawn_extension+0x65) [0x5145ed] /usr/sbin/asterisk() [0x514ff6] /usr/sbin/asterisk() [0x516b52] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === ---> Waiting for Lock #1 (chan_sip.c): MUTEX 24863 restart_monitor &monlock 0x7f5c592f70a0 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xd9) [0x4e9db7] /usr/lib/asterisk/modules/chan_sip.so(+0x7fb76) [0x7f5c590acb76] /usr/lib/asterisk/modules/chan_sip.so(+0x839cb) [0x7f5c590b09cb] /usr/sbin/asterisk(ast_request+0x2bb) [0x47d941] /usr/lib/asterisk/modules/app_queue.so(+0x10918) [0x7f5c5b3c4918] /usr/lib/asterisk/modules/app_queue.so(+0x11e3e) [0x7f5c5b3c5e3e] /usr/lib/asterisk/modules/app_queue.so(+0x173bd) [0x7f5c5b3cb3bd] /usr/lib/asterisk/modules/app_queue.so(+0x1e280) [0x7f5c5b3d2280] /usr/sbin/asterisk(pbx_exec+0x1fb) [0x509060] /usr/sbin/asterisk() [0x512b53] /usr/sbin/asterisk(ast_spawn_extension+0x65) [0x5145ed] /usr/sbin/asterisk() [0x514ff6] /usr/sbin/asterisk() [0x516b52] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === --- ---> Locked Here: chan_sip.c line 24846 (do_monitor) === ------------------------------------------------------------------- === === Thread ID: 0x7f5c50887710 (pbx_thread started at [ 5170] pbx.c ast_pbx_start()) === ---> Waiting for Lock #0 (astobj2.c): MUTEX 668 internal_ao2_callback c 0x7f5c440a9090 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xd9) [0x4e9db7] /usr/sbin/asterisk(__ao2_lock+0x5a) [0x449964] /usr/sbin/asterisk() [0x44a6c9] /usr/sbin/asterisk(__ao2_callback+0x5f) [0x44ac08] /usr/sbin/asterisk(__ao2_find+0x31) [0x44ad7a] /usr/lib/asterisk/modules/app_queue.so(+0xdef9) [0x7f5c5b3c1ef9] /usr/lib/asterisk/modules/app_queue.so(+0x1ed9f) [0x7f5c5b3d2d9f] /usr/sbin/asterisk(ast_func_read+0x187) [0x510cf4] /usr/sbin/asterisk(pbx_substitute_variables_helper_full+0x39d) [0x511fa0] /usr/sbin/asterisk(pbx_substitute_variables_helper+0x54) [0x51252c] /usr/sbin/asterisk() [0x51263b] /usr/sbin/asterisk() [0x5128b2] /usr/sbin/asterisk(ast_spawn_extension+0x65) [0x5145ed] /usr/sbin/asterisk() [0x514ff6] /usr/sbin/asterisk() [0x516b52] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === --- ---> Locked Here: app_queue.c line 4427 (try_calling) === ------------------------------------------------------------------- === === Thread ID: 0x7f5c5097f710 (handle_tcptls_connection started at [ 278] tcptls.c ast_tcptls_server_root()) === ---> Waiting for Lock #0 (cli.c): MUTEX 900 handle_chanlist c 0x7f5c4817f9b0 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_trylock+0xd9) [0x4ea172] /usr/sbin/asterisk(__ao2_trylock+0x5a) [0x449a26] /usr/lib/asterisk/modules/chan_sip.so(+0x16911) [0x7f5c59043911] /usr/sbin/asterisk(ast_sched_runq+0x18e) [0x551c21] /usr/lib/asterisk/modules/chan_sip.so(+0x7fa8c) [0x7f5c590aca8c] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === --- ---> Locked Here: channel.c line 3704 (__ast_read) === ------------------------------------------------------------------- === === Thread ID: 0x7f5c50903710 (pbx_thread started at [ 5170] pbx.c ast_pbx_start()) === ---> Waiting for Lock #0 (astobj2.c): MUTEX 668 internal_ao2_callback c 0x7f5c440a9090 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xd9) [0x4e9db7] /usr/sbin/asterisk(__ao2_lock+0x5a) [0x449964] /usr/sbin/asterisk() [0x44a6c9] /usr/sbin/asterisk(__ao2_callback+0x5f) [0x44ac08] /usr/sbin/asterisk(__ao2_find+0x31) [0x44ad7a] /usr/lib/asterisk/modules/app_queue.so(+0xdef9) [0x7f5c5b3c1ef9] /usr/lib/asterisk/modules/app_queue.so(+0x1ed9f) [0x7f5c5b3d2d9f] /usr/sbin/asterisk(ast_func_read+0x187) [0x510cf4] /usr/sbin/asterisk(pbx_substitute_variables_helper_full+0x39d) [0x511fa0] /usr/sbin/asterisk(pbx_substitute_variables_helper+0x54) [0x51252c] /usr/sbin/asterisk() [0x51263b] /usr/sbin/asterisk() [0x5128b2] /usr/sbin/asterisk(ast_spawn_extension+0x65) [0x5145ed] /usr/sbin/asterisk() [0x514ff6] /usr/sbin/asterisk() [0x516b52] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === --- ---> Locked Here: app_queue.c line 4427 (try_calling) === ------------------------------------------------------------------- === === Thread ID: 0x7f5c509fb710 (handle_tcptls_connection started at [ 278] tcptls.c ast_tcptls_server_root()) === ---> Waiting for Lock #0 (astobj2.c): MUTEX 668 internal_ao2_callback c 0x7f5c5c5120e0 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1d) [0x4f0f01] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xd9) [0x4e9db7] /usr/sbin/asterisk(__ao2_lock+0x5a) [0x449964] /usr/sbin/asterisk() [0x44a6c9] /usr/sbin/asterisk(__ao2_callback+0x5f) [0x44ac08] /usr/sbin/asterisk(__ao2_unlink+0x4d) [0x44a47a] /usr/sbin/asterisk(ast_channel_release+0x27) [0x4720fc] /usr/sbin/asterisk() [0x5217af] /usr/sbin/asterisk(ast_pbx_outgoing_exten+0x3f5) [0x521baf] /usr/sbin/asterisk() [0x4fb8db] /usr/sbin/asterisk() [0x4fd73b] /usr/sbin/asterisk() [0x4fdeeb] /usr/sbin/asterisk() [0x4fe348] /usr/sbin/asterisk() [0x55d684] /usr/sbin/asterisk() [0x56d7dc] /lib64/libpthread.so.0(+0x6a4f) [0x7f5c6297fa4f] /lib64/libc.so.6(clone+0x6d) [0x7f5c6362d82d] === --- ---> Locked Here: astobj2.c line 668 (internal_ao2_callback) === ------------------------------------------------------------------- === =======================================================================