======================================================================= === Currently Held Locks ============================================== ======================================================================= === === (): (times locked) === === Thread ID: 1096526144 (tps_processing_function started at [ 451] taskprocessor.c ast_taskprocessor_get()) === ---> Lock #0 (event.c): RDLOCK 1404 handle_event &(&ast_event_subs[event_types[i]])->lock 0x81e918 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1a) [0x4e7d49] /usr/sbin/asterisk(__ast_rwlock_rdlock+0xf6) [0x4e2b80] /usr/sbin/asterisk [0x4b072e] /usr/sbin/asterisk [0x550e08] /usr/sbin/asterisk [0x562ec9] /lib64/libpthread.so.0 [0x3ab140673d] /lib64/libc.so.6(clone+0x6d) [0x3ab0cd3f6d] === ---> Waiting for Lock #1 (astobj2.c): MUTEX 657 internal_ao2_callback c 0x9a782f0 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1a) [0x4e7d49] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xf6) [0x4e09a9] /usr/sbin/asterisk(__ao2_lock+0x53) [0x4451ac] /usr/sbin/asterisk [0x445f6e] /usr/sbin/asterisk(__ao2_callback+0x59) [0x4464fe] /usr/sbin/asterisk(__ao2_unlink+0x3f) [0x445d20] /usr/sbin/asterisk(ast_channel_release+0x1c) [0x46d4d5] /usr/lib/asterisk/modules/cdr_custom.so [0x2aaabf0f8622] /usr/sbin/asterisk [0x4636ad] /usr/sbin/asterisk(ast_cdr_detach+0xce) [0x463fc0] /usr/sbin/asterisk(ast_bridge_call+0x21e4) [0x4bdca5] /usr/lib/asterisk/modules/app_dial.so [0x2aaabdc9eb2e] /usr/lib/asterisk/modules/app_dial.so [0x2aaabdc9f47e] /usr/sbin/asterisk(pbx_exec+0x1f1) [0x4fffff] /usr/sbin/asterisk [0x509fac] /usr/sbin/asterisk(ast_spawn_extension+0x64) [0x50b90d] /usr/sbin/asterisk [0x50c39e] /usr/sbin/asterisk [0x50e064] /usr/sbin/asterisk [0x562ec9] /lib64/libpthread.so.0 [0x3ab140673d] /lib64/libc.so.6(clone+0x6d) [0x3ab0cd3f6d] === --- ---> Locked Here: channel.c line 6241 (ast_do_masquerade) === ------------------------------------------------------------------- === === Thread ID: 1093704000 (do_monitor started at [24579] chan_sip.c restart_monitor()) === ---> Lock #0 (chan_sip.c): MUTEX 24073 handle_request_do &netlock 0x2aaac93a5820 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1a) [0x4e7d49] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xf6) [0x4e09a9] /usr/lib/asterisk/modules/chan_sip.so [0x2aaac9158394] /usr/lib/asterisk/modules/chan_sip.so [0x2aaac915817c] /usr/sbin/asterisk(ast_io_wait+0x1ba) [0x4da9e4] /usr/lib/asterisk/modules/chan_sip.so [0x2aaac9159f31] /usr/sbin/asterisk [0x562ec9] /lib64/libpthread.so.0 [0x3ab140673d] /lib64/libc.so.6(clone+0x6d) [0x3ab0cd3f6d] === ---> Lock #1 (chan_sip.c): MUTEX 6550 sip_new i 0x2aaaacdd3cc0 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1a) [0x4e7d49] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xf6) [0x4e09a9] /usr/sbin/asterisk(__ao2_lock+0x53) [0x4451ac] /usr/lib/asterisk/modules/chan_sip.so [0x2aaac90fd710] /usr/lib/asterisk/modules/chan_sip.so [0x2aaac914da19] /usr/lib/asterisk/modules/chan_sip.so [0x2aaac91576e1] /usr/lib/asterisk/modules/chan_sip.so [0x2aaac91588d6] /usr/lib/asterisk/modules/chan_sip.so [0x2aaac915817c] /usr/sbin/asterisk(ast_io_wait+0x1ba) [0x4da9e4] /usr/lib/asterisk/modules/chan_sip.so [0x2aaac9159f31] /usr/sbin/asterisk [0x562ec9] /lib64/libpthread.so.0 [0x3ab140673d] /lib64/libc.so.6(clone+0x6d) [0x3ab0cd3f6d] === ---> Waiting for Lock #2 (channel.c): MUTEX 5012 set_format chan 0x156ffff0 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1a) [0x4e7d49] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xf6) [0x4e09a9] /usr/sbin/asterisk(__ao2_lock+0x53) [0x4451ac] /usr/sbin/asterisk [0x476e83] /usr/sbin/asterisk(ast_set_write_format+0x46) [0x477186] /usr/sbin/asterisk(ast_openstream_full+0x17e) [0x4c8d81] /usr/sbin/asterisk(ast_openstream+0x2a) [0x4c8c01] /usr/sbin/asterisk(ast_streamfile+0x43) [0x4c9acd] /usr/sbin/asterisk(ast_stream_and_wait+0x64) [0x4cb18f] /usr/sbin/asterisk(ast_pickup_call+0x550) [0x4c5454] /usr/lib/asterisk/modules/chan_sip.so [0x2aaac914e92a] /usr/lib/asterisk/modules/chan_sip.so [0x2aaac91576e1] /usr/lib/asterisk/modules/chan_sip.so [0x2aaac91588d6] /usr/lib/asterisk/modules/chan_sip.so [0x2aaac915817c] /usr/sbin/asterisk(ast_io_wait+0x1ba) [0x4da9e4] /usr/lib/asterisk/modules/chan_sip.so [0x2aaac9159f31] /usr/sbin/asterisk [0x562ec9] /lib64/libpthread.so.0 [0x3ab140673d] /lib64/libc.so.6(clone+0x6d) [0x3ab0cd3f6d] === --- ---> Locked Here: channel.c line 6244 (ast_do_masquerade) === ------------------------------------------------------------------- === === Thread ID: 1087019328 (pbx_thread started at [ 5038] pbx.c ast_pbx_start()) === ---> Lock #0 (cdr.c): RDLOCK 1142 post_cdr &(&be_list)->lock 0x803330 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1a) [0x4e7d49] /usr/sbin/asterisk(__ast_rwlock_rdlock+0xf6) [0x4e2b80] /usr/sbin/asterisk [0x463692] /usr/sbin/asterisk(ast_cdr_detach+0xce) [0x463fc0] /usr/sbin/asterisk(ast_bridge_call+0x21e4) [0x4bdca5] /usr/lib/asterisk/modules/app_dial.so [0x2aaabdc9eb2e] /usr/lib/asterisk/modules/app_dial.so [0x2aaabdc9f47e] /usr/sbin/asterisk(pbx_exec+0x1f1) [0x4fffff] /usr/sbin/asterisk [0x509fac] /usr/sbin/asterisk(ast_spawn_extension+0x64) [0x50b90d] /usr/sbin/asterisk [0x50c39e] /usr/sbin/asterisk [0x50e064] /usr/sbin/asterisk [0x562ec9] /lib64/libpthread.so.0 [0x3ab140673d] /lib64/libc.so.6(clone+0x6d) [0x3ab0cd3f6d] === ---> Waiting for Lock #1 (astobj2.c): MUTEX 657 internal_ao2_callback c 0x9a782f0 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1a) [0x4e7d49] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xf6) [0x4e09a9] /usr/sbin/asterisk(__ao2_lock+0x53) [0x4451ac] /usr/sbin/asterisk [0x445f6e] /usr/sbin/asterisk(__ao2_callback+0x59) [0x4464fe] /usr/sbin/asterisk(__ao2_unlink+0x3f) [0x445d20] /usr/sbin/asterisk(ast_channel_release+0x1c) [0x46d4d5] /usr/lib/asterisk/modules/cdr_custom.so [0x2aaabf0f8622] /usr/sbin/asterisk [0x4636ad] /usr/sbin/asterisk(ast_cdr_detach+0xce) [0x463fc0] /usr/sbin/asterisk(ast_bridge_call+0x21e4) [0x4bdca5] /usr/lib/asterisk/modules/app_dial.so [0x2aaabdc9eb2e] /usr/lib/asterisk/modules/app_dial.so [0x2aaabdc9f47e] /usr/sbin/asterisk(pbx_exec+0x1f1) [0x4fffff] /usr/sbin/asterisk [0x509fac] /usr/sbin/asterisk(ast_spawn_extension+0x64) [0x50b90d] /usr/sbin/asterisk [0x50c39e] /usr/sbin/asterisk [0x50e064] /usr/sbin/asterisk [0x562ec9] /lib64/libpthread.so.0 [0x3ab140673d] /lib64/libc.so.6(clone+0x6d) [0x3ab0cd3f6d] === --- ---> Locked Here: channel.c line 6241 (ast_do_masquerade) === ------------------------------------------------------------------- === === Thread ID: 1088985408 (pbx_thread started at [ 5038] pbx.c ast_pbx_start()) === ---> Lock #0 (channel.c): MUTEX 6241 ast_do_masquerade channels 0x9a782f0 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1a) [0x4e7d49] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xf6) [0x4e09a9] /usr/sbin/asterisk(__ao2_lock+0x53) [0x4451ac] /usr/sbin/asterisk(ast_do_masquerade+0x6a) [0x47b793] /usr/sbin/asterisk [0x47212c] /usr/sbin/asterisk(ast_read+0x1a) [0x4746db] /usr/lib/asterisk/modules/app_queue.so [0x2aaab783c763] /usr/lib/asterisk/modules/app_queue.so [0x2aaab783fd41] /usr/lib/asterisk/modules/app_queue.so [0x2aaab7846dea] /usr/sbin/asterisk(pbx_exec+0x1f1) [0x4fffff] /usr/sbin/asterisk [0x509fac] /usr/sbin/asterisk(ast_spawn_extension+0x64) [0x50b90d] /usr/sbin/asterisk [0x50c39e] /usr/sbin/asterisk [0x50e064] /usr/sbin/asterisk [0x562ec9] /lib64/libpthread.so.0 [0x3ab140673d] /lib64/libc.so.6(clone+0x6d) [0x3ab0cd3f6d] === ---> Lock #1 (channel.c): MUTEX 6244 ast_do_masquerade original 0x156ffff0 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1a) [0x4e7d49] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xf6) [0x4e09a9] /usr/sbin/asterisk(__ao2_lock+0x53) [0x4451ac] /usr/sbin/asterisk(ast_do_masquerade+0x8b) [0x47b7b4] /usr/sbin/asterisk [0x47212c] /usr/sbin/asterisk(ast_read+0x1a) [0x4746db] /usr/lib/asterisk/modules/app_queue.so [0x2aaab783c763] /usr/lib/asterisk/modules/app_queue.so [0x2aaab783fd41] /usr/lib/asterisk/modules/app_queue.so [0x2aaab7846dea] /usr/sbin/asterisk(pbx_exec+0x1f1) [0x4fffff] /usr/sbin/asterisk [0x509fac] /usr/sbin/asterisk(ast_spawn_extension+0x64) [0x50b90d] /usr/sbin/asterisk [0x50c39e] /usr/sbin/asterisk [0x50e064] /usr/sbin/asterisk [0x562ec9] /lib64/libpthread.so.0 [0x3ab140673d] /lib64/libc.so.6(clone+0x6d) [0x3ab0cd3f6d] === ---> Lock #2 (channel.c): MUTEX 6264 ast_do_masquerade clonechan 0x2aaaacdcfde0 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1a) [0x4e7d49] /usr/sbin/asterisk(__ast_pthread_mutex_trylock+0xf6) [0x4e0d6b] /usr/sbin/asterisk(__ao2_trylock+0x53) [0x445309] /usr/sbin/asterisk(ast_do_masquerade+0x2bb) [0x47b9e4] /usr/sbin/asterisk [0x47212c] /usr/sbin/asterisk(ast_read+0x1a) [0x4746db] /usr/lib/asterisk/modules/app_queue.so [0x2aaab783c763] /usr/lib/asterisk/modules/app_queue.so [0x2aaab783fd41] /usr/lib/asterisk/modules/app_queue.so [0x2aaab7846dea] /usr/sbin/asterisk(pbx_exec+0x1f1) [0x4fffff] /usr/sbin/asterisk [0x509fac] /usr/sbin/asterisk(ast_spawn_extension+0x64) [0x50b90d] /usr/sbin/asterisk [0x50c39e] /usr/sbin/asterisk [0x50e064] /usr/sbin/asterisk [0x562ec9] /lib64/libpthread.so.0 [0x3ab140673d] /lib64/libc.so.6(clone+0x6d) [0x3ab0cd3f6d] === ---> Waiting for Lock #3 (chan_sip.c): MUTEX 6182 sip_fixup p 0x2aaaacdd3cc0 (1) /usr/sbin/asterisk(ast_bt_get_addresses+0x1a) [0x4e7d49] /usr/sbin/asterisk(__ast_pthread_mutex_lock+0xf6) [0x4e09a9] /usr/sbin/asterisk(__ao2_lock+0x53) [0x4451ac] /usr/lib/asterisk/modules/chan_sip.so [0x2aaac90fc10d] /usr/sbin/asterisk(ast_do_masquerade+0x19ab) [0x47d0d4] /usr/sbin/asterisk [0x47212c] /usr/sbin/asterisk(ast_read+0x1a) [0x4746db] /usr/lib/asterisk/modules/app_queue.so [0x2aaab783c763] /usr/lib/asterisk/modules/app_queue.so [0x2aaab783fd41] /usr/lib/asterisk/modules/app_queue.so [0x2aaab7846dea] /usr/sbin/asterisk(pbx_exec+0x1f1) [0x4fffff] /usr/sbin/asterisk [0x509fac] /usr/sbin/asterisk(ast_spawn_extension+0x64) [0x50b90d] /usr/sbin/asterisk [0x50c39e] /usr/sbin/asterisk [0x50e064] /usr/sbin/asterisk [0x562ec9] /lib64/libpthread.so.0 [0x3ab140673d] /lib64/libc.so.6(clone+0x6d) [0x3ab0cd3f6d] === --- ---> Locked Here: chan_sip.c line 6550 (sip_new) === ------------------------------------------------------------------- === =======================================================================