[Home]

Summary:ASTERISK-24961: segmenation fault in dtls_perform_handshake
Reporter:Vlad (vladcska)Labels:
Date Opened:2015-04-14 04:42:56Date Closed:2015-04-14 05:21:38
Priority:BlockerRegression?
Status:Closed/CompleteComponents:Resources/res_rtp_asterisk
Versions:13.2.0 Frequency of
Occurrence
Frequent
Related
Issues:
duplicatesASTERISK-24550 res_rtp_asterisk: Crash in ast_rtp_on_ice_complete during DTLS handshake
Environment:Ubuntu 14.04.2 LTS Linux 3.16.0-30-generic #40~14.04.1-Ubuntu SMP x86_64 x86_64 x86_64 GNU/LinuxAttachments:
Description:[New LWP 22325]
[New LWP 22334]
[New LWP 22327]
[New LWP 22328]
[New LWP 22336]
[New LWP 22333]
[New LWP 22332]
[New LWP 22532]
[New LWP 22335]
[New LWP 22287]
[New LWP 22286]
[New LWP 22337]
[New LWP 22307]
[New LWP 22291]
[New LWP 22338]
[New LWP 22299]
[New LWP 22308]
[New LWP 1746]
[New LWP 22309]
[New LWP 22301]
[New LWP 22298]
[New LWP 22310]
[New LWP 22321]
[New LWP 22302]
[New LWP 22324]
[New LWP 22322]
[New LWP 22311]
[New LWP 22294]
[New LWP 22323]
[New LWP 22312]
[New LWP 1745]
[New LWP 20012]
[New LWP 22329]
[New LWP 1744]
[New LWP 22306]
[New LWP 22527]
[New LWP 1747]
[New LWP 22304]
[New LWP 22318]
[New LWP 1748]
[New LWP 1742]
[New LWP 1741]
[New LWP 22340]
[New LWP 1743]
[New LWP 22288]
[New LWP 1740]
[New LWP 24909]
[New LWP 22305]
[New LWP 22635]
[New LWP 22297]
[New LWP 22296]
[New LWP 22331]
[New LWP 22303]
[New LWP 22339]
[New LWP 22300]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/sbin/asterisk -vvvvvvvg -f'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0  __memcpy_sse2_unaligned () at ../sysdeps/x86_64/multiarch/memcpy-sse2-unaligned.S:36
#0  __memcpy_sse2_unaligned () at ../sysdeps/x86_64/multiarch/memcpy-sse2-unaligned.S:36
No locals.
#1  0x00007f31b5184c2a in ?? () from /lib/x86_64-linux-gnu/libssl.so.1.0.0
No symbol table info available.
#2  0x00007f31b5186970 in ?? () from /lib/x86_64-linux-gnu/libssl.so.1.0.0
No symbol table info available.
#3  0x00007f31b5180af5 in ?? () from /lib/x86_64-linux-gnu/libssl.so.1.0.0
No symbol table info available.
#4  0x00007f31135951c5 in dtls_perform_handshake (instance=instance@entry=0x7f31840960e8, dtls=dtls@entry=0x7f31840207e0, rtcp=rtcp@entry=0) at res_rtp_asterisk.c:1601
       rtp = <optimized out>
#5  0x00007f311359526c in ast_rtp_on_ice_complete (ice=<optimized out>, status=0) at res_rtp_asterisk.c:1629
       instance = 0x7f31840960e8
       rtp = 0x7f318401ddb0
#6  0x00007f314aed919d in on_timer () from /usr/local/lib/libpjnath.so.2
No symbol table info available.
#7  0x00007f31b0e1eb67 in pj_timer_heap_poll () from /usr/local/lib/libpj.so.2
No symbol table info available.
#8  0x00007f3113592218 in timer_worker_thread (data=<optimized out>) at res_rtp_asterisk.c:1715
       delay = {sec = 0, msec = 10}
       ioqueue = 0x7f3138003be8
#9  0x00007f31b0e0e66a in thread_main () from /usr/local/lib/libpj.so.2
No symbol table info available.
#10 0x00007f31b4315182 in start_thread (arg=0x7f31085d0700) at pthread_create.c:312
       __res = <optimized out>
       pd = 0x7f31085d0700
       now = <optimized out>
       unwind_buf = {cancel_jmp_buf = {{jmp_buf = {139848570439424, -4106736611105797569, 0, 0, 139848570440128, 139848570439424, 4135395682300365375, 4135035277320686143}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}}
       not_first_call = <optimized out>
       pagesize_m1 = <optimized out>
       sp = <optimized out>
       freesize = <optimized out>
       __PRETTY_FUNCTION__ = "start_thread"
#11 0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
No locals.

Thread 55 (Thread 0x7f31b2cba700 (LWP 22300)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x000000000052e2bd in __ast_cond_wait (filename=<optimized out>, lineno=<optimized out>, func=<optimized out>, cond_name=<optimized out>, mutex_name=<optimized out>, cond=<optimized out>, t=0x8815b0 <state_changes+16>) at lock.c:598
#2  0x00000000004f04a9 in do_devstate_changes (data=data@entry=0x0) at devicestate.c:546
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f31b2cba700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 54 (Thread 0x7f3106a38700 (LWP 22339)):
#0  sem_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/sem_wait.S:85
#1  0x00000000005caf5c in ast_sem_wait (sem=0x1fcb3f0) at /usr/src/asterisk-13.2.0/include/asterisk/sem.h:59
#2  default_tps_processing_function (data=data@entry=0x1fc56b8) at taskprocessor.c:177
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f3106a38700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 53 (Thread 0x7f31b2b46700 (LWP 22303)):
#0  sem_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/sem_wait.S:85
#1  0x00000000005caf5c in ast_sem_wait (sem=0x24fc8e0) at /usr/src/asterisk-13.2.0/include/asterisk/sem.h:59
#2  default_tps_processing_function (data=data@entry=0x2502268) at taskprocessor.c:177
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f31b2b46700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 52 (Thread 0x7f312c087700 (LWP 22331)):
#0  0x00007f31b38e412d in poll () at ../sysdeps/unix/syscall-template.S:81
#1  0x00000000005271ae in poll (__timeout=<optimized out>, __nfds=<optimized out>, __fds=<optimized out>) at /usr/include/x86_64-linux-gnu/bits/poll2.h:46
#2  ast_io_wait (ioc=0x1f4e720, howlong=<optimized out>) at io.c:279
#3  0x00007f3144b2d1de in do_monitor (data=data@entry=0x0) at chan_sip.c:28873
#4  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#5  0x00007f31b4315182 in start_thread (arg=0x7f312c087700) at pthread_create.c:312
#6  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 51 (Thread 0x7f31b2eaa700 (LWP 22296)):
#0  sem_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/sem_wait.S:85
#1  0x00000000005caf5c in ast_sem_wait (sem=0x1d4fa20) at /usr/src/asterisk-13.2.0/include/asterisk/sem.h:59
#2  default_tps_processing_function (data=data@entry=0x1d4faa8) at taskprocessor.c:177
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f31b2eaa700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 50 (Thread 0x7f31b2e2e700 (LWP 22297)):
#0  0x00007f31b38b7f3d in nanosleep () at ../sysdeps/unix/syscall-template.S:81
#1  0x00007f31b38b7dd4 in __sleep (seconds=0, seconds@entry=1) at ../sysdeps/unix/sysv/linux/sleep.c:137
#2  0x00000000004ecbc5 in db_sync_thread (data=data@entry=0x0) at db.c:980
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f31b2e2e700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 49 (Thread 0x7f3105c2c700 (LWP 22635)):
#0  0x00007f31b38e412d in poll () at ../sysdeps/unix/syscall-template.S:81
#1  0x000000000043f85d in poll (__timeout=<optimized out>, __nfds=0, __fds=0x0) at /usr/include/x86_64-linux-gnu/bits/poll2.h:46
#2  shaun_of_the_dead (data=data@entry=0x0) at app.c:163
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f3105c2c700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 48 (Thread 0x7f31b2a4e700 (LWP 22305)):
#0  sem_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/sem_wait.S:85
#1  0x00000000005caf5c in ast_sem_wait (sem=0x2519040) at /usr/src/asterisk-13.2.0/include/asterisk/sem.h:59
#2  default_tps_processing_function (data=data@entry=0x2519338) at taskprocessor.c:177
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f31b2a4e700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 47 (Thread 0x7f3105b34700 (LWP 24909)):
#0  0x00007f31b38e412d in poll () at ../sysdeps/unix/syscall-template.S:81
#1  0x00000000005ddd98 in poll (__timeout=-1, __nfds=1, __fds=0x7f3105b30db0) at /usr/include/x86_64-linux-gnu/bits/poll2.h:46
#2  ast_wait_for_input (fd=<optimized out>, ms=ms@entry=-1) at utils.c:1321
#3  0x00007f3144b50e6a in sip_websocket_callback (session=0x7f3170000a88, parameters=<optimized out>, headers=<optimized out>) at chan_sip.c:2634
#4  0x00007f3148a8960f in __ast_websocket_uri_cb (ser=<optimized out>, urih=<optimized out>, uri=<optimized out>, method=<optimized out>, get_vars=<optimized out>, headers=<optimized out>) at res_http_websocket.c:785
#5  0x0000000000521932 in handle_uri (headers=0x7f3170001790, method=AST_HTTP_GET, uri=0x7f3105b31be7 "", ser=0x7f316c0018b8) at http.c:1480
#6  httpd_process_request (ser=ser@entry=0x7f316c0018b8) at http.c:1899
#7  0x0000000000521d39 in httpd_helper_thread (data=0x7f316c0018b8) at http.c:1986
#8  0x00000000005cdcd5 in handle_tcptls_connection (data=data@entry=0x7f316c0018b8) at tcptls.c:685
#9  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#10 0x00007f31b4315182 in start_thread (arg=0x7f3105b34700) at pthread_create.c:312
#11 0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 46 (Thread 0x7f3105ab8700 (LWP 1740)):
#0  0x00007f31b38e412d in poll () at ../sysdeps/unix/syscall-template.S:81
#1  0x00000000004addb7 in poll (__timeout=-1, __nfds=4, __fds=0x7f3105ab36a0) at /usr/include/x86_64-linux-gnu/bits/poll2.h:46
#2  ast_waitfor_nandfds (c=<optimized out>, n=<optimized out>, fds=<optimized out>, nfds=<optimized out>, exception=<optimized out>, outfd=<optimized out>, ms=0x7f3105ab48c0) at channel.c:3101
#3  0x00000000004ae3d7 in ast_waitfor_n (c=c@entry=0x7f3105ab3de0, n=<optimized out>, ms=ms@entry=0x7f3105ab48c0) at channel.c:3372
#4  0x00007f311808d445 in wait_for_answer (in=in@entry=0x7f318401acf8, out_chans=out_chans@entry=0x7f3105ab4980, to=to@entry=0x7f3105ab48c0, peerflags=<optimized out>, opt_args=opt_args@entry=0x7f3105ab4b80, pa=<optimized out>, num_in=num_in@entry=0x7f3105ab49c0, result=result@entry=0x7f3105ab4900, dtmf_progress=0x0, ignore_cc=1, forced_clid=0x7f3105ab4a20, stored_clid=0x7f3105ab4a80) at app_dial.c:1141
#5  0x00007f31180922f5 in dial_exec_full (chan=0x7f318401acf8, data=<optimized out>, peerflags=peerflags@entry=0x7f3105ab5560, continue_exec=continue_exec@entry=0x0) at app_dial.c:2680
#6  0x00007f3118094436 in dial_exec (chan=<optimized out>, data=<optimized out>) at app_dial.c:3133
#7  0x000000000056b939 in pbx_exec (c=c@entry=0x7f318401acf8, app=app@entry=0x252ab50, data=data@entry=0x7f3105ab5ae0 "Local/79226738733@two-way-calls,,M(on-answer)") at pbx.c:1658
#8  0x0000000000576883 in pbx_extension_helper (c=c@entry=0x7f318401acf8, context=0x7f318401b6b0 "on-agent-answer", exten=exten@entry=0x7f318401b700 "s", priority=priority@entry=2, label=label@entry=0x0, callerid=callerid@entry=0x0, action=action@entry=E_SPAWN, found=found@entry=0x7f3105ab7ba0, combined_find_spawn=combined_find_spawn@entry=1, con=0x0) at pbx.c:4930
#9  0x000000000057db6b in ast_spawn_extension (combined_find_spawn=1, found=0x7f3105ab7ba0, callerid=0x0, priority=2, exten=0x7f318401b700 "s", context=<optimized out>, c=0x7f318401acf8) at pbx.c:5963
#10 __ast_pbx_run (c=c@entry=0x7f318401acf8, args=args@entry=0x0) at pbx.c:6380
#11 0x000000000057f1bc in ast_pbx_run_args (c=0x7f318401acf8, args=0x0) at pbx.c:6748
#12 0x000000000057f559 in ast_pbx_run (c=0x7f318401acf8) at pbx.c:6757
#13 pbx_outgoing_exec (data=data@entry=0x7f3184032868) at pbx.c:10284
#14 0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#15 0x00007f31b4315182 in start_thread (arg=0x7f3105ab8700) at pthread_create.c:312
#16 0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 45 (Thread 0x7f31b5f9c700 (LWP 22288)):
#0  sem_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/sem_wait.S:85
#1  0x00000000005caf5c in ast_sem_wait (sem=0x1d34f90) at /usr/src/asterisk-13.2.0/include/asterisk/sem.h:59
#2  default_tps_processing_function (data=data@entry=0x1d39c98) at taskprocessor.c:177
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f31b5f9c700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 44 (Thread 0x7f3106370700 (LWP 1743)):
#0  __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135
#1  0x00007f31b4317672 in _L_lock_953 () from /lib/x86_64-linux-gnu/libpthread.so.0
#2  0x00007f31b43174da in __GI___pthread_mutex_lock (mutex=0x7f3184031dd8) at ../nptl/pthread_mutex_lock.c:114
#3  0x00007f31b0e0e36b in pj_mutex_lock () from /usr/local/lib/libpj.so.2
#4  0x00007f31b0e14481 in grp_lock_acquire () from /usr/local/lib/libpj.so.2
#5  0x00007f314aedc243 in pj_ice_sess_send_data () from /usr/local/lib/libpjnath.so.2
#6  0x00007f3113594ddf in __rtp_sendto (instance=instance@entry=0x7f31840960e8, buf=buf@entry=0x7f310636f3e8, size=size@entry=91, sa=sa@entry=0x7f310636f490, rtcp=rtcp@entry=0, ice=ice@entry=0x7f310636f47c, use_srtp=use_srtp@entry=0, flags=0) at res_rtp_asterisk.c:2133
#7  0x00007f31135950d5 in dtls_srtp_check_pending (instance=instance@entry=0x7f31840960e8, rtp=rtp@entry=0x7f318401ddb0, rtcp=rtcp@entry=0) at res_rtp_asterisk.c:1841
#8  0x00007f311359576e in __rtp_recvfrom (instance=instance@entry=0x7f31840960e8, buf=buf@entry=0x7f318401de80, sa=sa@entry=0x7f310636f8e0, rtcp=rtcp@entry=0, flags=0, size=8192) at res_rtp_asterisk.c:2047
#9  0x00007f311359bf62 in rtp_recvfrom (sa=0x7f310636f8e0, flags=0, size=8192, buf=0x7f318401de80, instance=0x7f31840960e8) at res_rtp_asterisk.c:2113
#10 ast_rtp_read (instance=0x7f31840960e8, rtcp=<optimized out>) at res_rtp_asterisk.c:4242
#11 0x00007f3144ac9066 in sip_rtp_read (faxdetect=<synthetic pointer>, p=0x7f318409e218, ast=0x7f31840b8338) at chan_sip.c:8346
#12 sip_read (ast=0x7f31840b8338) at chan_sip.c:8452
#13 0x00000000004baf03 in __ast_read (chan=0x7f31840b8338, dropaudio=dropaudio@entry=0) at channel.c:3893
#14 0x00000000004bbe37 in ast_read (chan=<optimized out>) at channel.c:4243
#15 0x000000000047e1dc in bridge_handle_trip (bridge_channel=0x7f31840b0ed8) at bridge_channel.c:2272
#16 bridge_channel_wait (bridge_channel=0x7f31840b0ed8) at bridge_channel.c:2442
#17 bridge_channel_internal_join (bridge_channel=bridge_channel@entry=0x7f31840b0ed8) at bridge_channel.c:2587
#18 0x00000000004678e0 in bridge_channel_ind_thread (data=data@entry=0x7f31840b0ed8) at bridge.c:1690
#19 0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#20 0x00007f31b4315182 in start_thread (arg=0x7f3106370700) at pthread_create.c:312
#21 0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 43 (Thread 0x7f31069bc700 (LWP 22340)):
#0  sem_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/sem_wait.S:85
#1  0x00000000005caf5c in ast_sem_wait (sem=0x1fc81a0) at /usr/src/asterisk-13.2.0/include/asterisk/sem.h:59
#2  default_tps_processing_function (data=data@entry=0x1fc8fb8) at taskprocessor.c:177
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f31069bc700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 42 (Thread 0x7f310527c700 (LWP 1741)):
#0  0x00007f31b38e412d in poll () at ../sysdeps/unix/syscall-template.S:81
#1  0x00000000004addb7 in poll (__timeout=-1, __nfds=3, __fds=0x7f31052778e0) at /usr/include/x86_64-linux-gnu/bits/poll2.h:46
#2  ast_waitfor_nandfds (c=c@entry=0x7f318407e320, n=n@entry=1, fds=fds@entry=0x7f318407e3a8, nfds=nfds@entry=1, exception=exception@entry=0x0, outfd=outfd@entry=0x7f3105277aa0, ms=ms@entry=0x7f3105277a80) at channel.c:3101
#3  0x000000000047dcf0 in bridge_channel_wait (bridge_channel=0x7f318407e2e8) at bridge_channel.c:2427
#4  bridge_channel_internal_join (bridge_channel=bridge_channel@entry=0x7f318407e2e8) at bridge_channel.c:2587
#5  0x000000000046984e in ast_bridge_join (bridge=bridge@entry=0x7f318406a278, chan=chan@entry=0x7f318402f9e8, swap=swap@entry=0x0, features=features@entry=0x7f3105277b80, tech_args=tech_args@entry=0x0, flags=flags@entry=(AST_BRIDGE_JOIN_PASS_REFERENCE | AST_BRIDGE_JOIN_INHIBIT_JOIN_COLP)) at bridge.c:1626
#6  0x00000000005033ef in ast_bridge_call_with_flags (chan=0x7f318402f9e8, peer=peer@entry=0x7f31840b8338, config=config@entry=0x7f3105277e00, flags=flags@entry=56) at features.c:687
#7  0x00007f314660a20f in try_calling (qe=qe@entry=0x7f3105278480, opts=..., opt_args=opt_args@entry=0x7f3105278410, announceoverride=<optimized out>, url=<optimized out>, tries=tries@entry=0x7f31052783c0, noption=noption@entry=0x7f31052783e0, agi=0x7f31052782f5 "", macro=0x7f31052782f6 "on-agent-answer", gosub=0x0, ringing=ringing@entry=1) at app_queue.c:6822
#8  0x00007f314660c108 in queue_exec (chan=<optimized out>, data=<optimized out>) at app_queue.c:7894
#9  0x000000000056b939 in pbx_exec (c=c@entry=0x7f318402f9e8, app=app@entry=0x1fbf230, data=data@entry=0x7f3105279be0 "ITRACEN_APPROVE,r,,,,,on-agent-answer") at pbx.c:1658
#10 0x0000000000576883 in pbx_extension_helper (c=c@entry=0x7f318402f9e8, context=0x7f31840303a0 "callmenow", exten=exten@entry=0x7f31840303f0 "s", priority=priority@entry=5, label=label@entry=0x0, callerid=callerid@entry=0x7f31841038b0 "13255", action=action@entry=E_SPAWN, found=found@entry=0x7f310527bca0, combined_find_spawn=combined_find_spawn@entry=1, con=0x0) at pbx.c:4930
#11 0x000000000057db6b in ast_spawn_extension (combined_find_spawn=1, found=0x7f310527bca0, callerid=0x7f31841038b0 "13255", priority=5, exten=0x7f31840303f0 "s", context=<optimized out>, c=0x7f318402f9e8) at pbx.c:5963
#12 __ast_pbx_run (c=c@entry=0x7f318402f9e8, args=args@entry=0x0) at pbx.c:6380
#13 0x000000000057f09b in pbx_thread (data=data@entry=0x7f318402f9e8) at pbx.c:6700
#14 0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#15 0x00007f31b4315182 in start_thread (arg=0x7f310527c700) at pthread_create.c:312
#16 0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 41 (Thread 0x7f31b00da700 (LWP 1742)):
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238
#1  0x000000000052e2d2 in __ast_cond_timedwait (filename=<optimized out>, lineno=<optimized out>, func=<optimized out>, cond_name=<optimized out>, mutex_name=<optimized out>, cond=<optimized out>, t=0x7f31a4000980, abstime=0x7f31b00d9de0) at lock.c:666
#2  0x00000000005d2bac in worker_idle (worker=0x7f31a4000948) at threadpool.c:1101
#3  worker_start (arg=arg@entry=0x7f31a4000948) at threadpool.c:993
#4  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#5  0x00007f31b4315182 in start_thread (arg=0x7f31b00da700) at pthread_create.c:312
#6  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 40 (Thread 0x7f31064e4700 (LWP 1748)):
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238
#1  0x000000000052e2d2 in __ast_cond_timedwait (filename=<optimized out>, lineno=<optimized out>, func=<optimized out>, cond_name=<optimized out>, mutex_name=<optimized out>, cond=<optimized out>, t=0x7f31a40077d0, abstime=0x7f31064e3de0) at lock.c:666
#2  0x00000000005d2bac in worker_idle (worker=0x7f31a4007798) at threadpool.c:1101
#3  worker_start (arg=arg@entry=0x7f31a4007798) at threadpool.c:993
#4  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#5  0x00007f31b4315182 in start_thread (arg=0x7f31064e4700) at pthread_create.c:312
#6  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 39 (Thread 0x7f3147416700 (LWP 22318)):
#0  0x00007f31b38e8da3 in select () at ../sysdeps/unix/syscall-template.S:81
#1  0x00007f31b0e108b4 in pj_sock_select () from /usr/local/lib/libpj.so.2
#2  0x00007f31b0e0d03d in pj_ioqueue_poll () from /usr/local/lib/libpj.so.2
#3  0x00007f314bbb931c in pjsip_endpt_handle_events2 () from /usr/local/lib/libpjsip.so.2
#4  0x00007f3147e2e478 in monitor_thread_exec (endpt=<optimized out>) at res_pjsip.c:3046
#5  0x00007f31b0e0e66a in thread_main () from /usr/local/lib/libpj.so.2
#6  0x00007f31b4315182 in start_thread (arg=0x7f3147416700) at pthread_create.c:312
#7  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 38 (Thread 0x7f31b2aca700 (LWP 22304)):
#0  sem_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/sem_wait.S:85
#1  0x00000000005caf5c in ast_sem_wait (sem=0x250e3f0) at /usr/src/asterisk-13.2.0/include/asterisk/sem.h:59
#2  default_tps_processing_function (data=data@entry=0x2514de8) at taskprocessor.c:177
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f31b2aca700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 37 (Thread 0x7f31063ec700 (LWP 1747)):
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238
#1  0x000000000052e2d2 in __ast_cond_timedwait (filename=<optimized out>, lineno=<optimized out>, func=<optimized out>, cond_name=<optimized out>, mutex_name=<optimized out>, cond=<optimized out>, t=0x7f31a40079b0, abstime=0x7f31063ebde0) at lock.c:666
#2  0x00000000005d2bac in worker_idle (worker=0x7f31a4007978) at threadpool.c:1101
#3  worker_start (arg=arg@entry=0x7f31a4007978) at threadpool.c:993
#4  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#5  0x00007f31b4315182 in start_thread (arg=0x7f31063ec700) at pthread_create.c:312
#6  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 36 (Thread 0x7f314758a700 (LWP 22527)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x000000000052e2bd in __ast_cond_wait (filename=<optimized out>, lineno=<optimized out>, func=<optimized out>, cond_name=<optimized out>, mutex_name=<optimized out>, cond=<optimized out>, t=0x87c8b0 <aslist+16>) at lock.c:598
#2  0x0000000000463469 in autoservice_run (ign=ign@entry=0x0) at autoservice.c:103
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f314758a700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 35 (Thread 0x7f31b29d2700 (LWP 22306)):
#0  sem_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/sem_wait.S:85
#1  0x00000000005caf5c in ast_sem_wait (sem=0x261d300) at /usr/src/asterisk-13.2.0/include/asterisk/sem.h:59
#2  default_tps_processing_function (data=data@entry=0x2634db8) at taskprocessor.c:177
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f31b29d2700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 34 (Thread 0x7f3106750700 (LWP 1744)):
#0  0x00007f31b38e412d in poll () at ../sysdeps/unix/syscall-template.S:81
#1  0x00000000005c98b6 in poll (__timeout=3000, __nfds=1, __fds=0x7f310674b280) at /usr/include/x86_64-linux-gnu/bits/poll2.h:46
#2  ast_stun_request (s=47, dst=dst@entry=0x7f31137a4140 <stunaddr>, username=username@entry=0x0, answer=answer@entry=0x7f310674bd50) at stun.c:434
#3  0x00007f3113596d97 in rtp_add_candidates_to_ice (instance=instance@entry=0x7f318403c438, rtp=rtp@entry=0x7f3184100bb0, addr=addr@entry=0x7f310674bf10, port=port@entry=11898, component=component@entry=1, transport=transport@entry=0) at res_rtp_asterisk.c:2286
#4  0x00007f3113597438 in ice_create (instance=instance@entry=0x7f318403c438, addr=addr@entry=0x7f310674bf10, port=port@entry=11898, replace=replace@entry=0) at res_rtp_asterisk.c:2374
#5  0x00007f3113597dd6 in ast_rtp_new (instance=0x7f318403c438, sched=0x1f4ddf0, addr=0x7f310674bf10, data=<optimized out>) at res_rtp_asterisk.c:2464
#6  0x00000000005864ca in ast_rtp_instance_new (engine_name=<optimized out>, sched=0x1f4ddf0, sa=sa@entry=0x7f310674bfe0, data=data@entry=0x0) at rtp_engine.c:424
#7  0x00007f3144aca838 in dialog_initialize_rtp (dialog=dialog@entry=0x7f3184016488) at chan_sip.c:5788
#8  0x00007f3144ae9a68 in dialog_initialize_rtp (dialog=0x7f3184016488) at chan_sip.c:5728
#9  create_addr_from_peer (dialog=dialog@entry=0x7f3184016488, peer=peer@entry=0x1f623e8) at chan_sip.c:5907
#10 0x00007f3144b1c54c in create_addr (dialog=dialog@entry=0x7f3184016488, opeer=opeer@entry=0x7f310674c530 "newtel", addr=addr@entry=0x0, newdialog=newdialog@entry=1) at chan_sip.c:6076
#11 0x00007f3144b307a1 in sip_request_call (type=<optimized out>, cap=<optimized out>, assignedids=<optimized out>, requestor=<optimized out>, dest=<optimized out>, cause=0x7f310674ca00) at chan_sip.c:29723
#12 0x00000000004b108a in ast_request (type=0x7f31840ff9f0 "SIP", request_cap=0x7f31840580e0, assignedids=assignedids@entry=0x0, requestor=requestor@entry=0x7f31840d9e08, addr=addr@entry=0x7f31840ff9f8 "newtel/79226738733", cause=cause@entry=0x7f310674ca00) at channel.c:5916
#13 0x00007f3118090f7a in dial_exec_full (chan=0x7f31840d9e08, data=<optimized out>, peerflags=peerflags@entry=0x7f310674d670, continue_exec=continue_exec@entry=0x0) at app_dial.c:2428
#14 0x00007f3118094436 in dial_exec (chan=<optimized out>, data=<optimized out>) at app_dial.c:3133
#15 0x000000000056b939 in pbx_exec (c=c@entry=0x7f31840d9e08, app=app@entry=0x252ab50, data=data@entry=0x7f310674dbe0 "SIP/newtel/79226738733") at pbx.c:1658
#16 0x0000000000576883 in pbx_extension_helper (c=c@entry=0x7f31840d9e08, context=0x7f31840da7c0 "two-way-calls", exten=exten@entry=0x7f31840da810 "79226738733", priority=priority@entry=8, label=label@entry=0x0, callerid=callerid@entry=0x0, action=action@entry=E_SPAWN, found=found@entry=0x7f310674fca0, combined_find_spawn=combined_find_spawn@entry=1, con=0x0) at pbx.c:4930
#17 0x000000000057db6b in ast_spawn_extension (combined_find_spawn=1, found=0x7f310674fca0, callerid=0x0, priority=8, exten=0x7f31840da810 "79226738733", context=<optimized out>, c=0x7f31840d9e08) at pbx.c:5963
#18 __ast_pbx_run (c=c@entry=0x7f31840d9e08, args=args@entry=0x0) at pbx.c:6380
#19 0x000000000057f09b in pbx_thread (data=data@entry=0x7f31840d9e08) at pbx.c:6700
#20 0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#21 0x00007f31b4315182 in start_thread (arg=0x7f3106750700) at pthread_create.c:312
#22 0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 33 (Thread 0x7f312c103700 (LWP 22329)):
#0  0x00007f31b38e412d in poll () at ../sysdeps/unix/syscall-template.S:81
#1  0x00000000005ddd98 in poll (__timeout=<optimized out>, __nfds=1, __fds=0x7f312c102d30) at /usr/include/x86_64-linux-gnu/bits/poll2.h:46
#2  ast_wait_for_input (fd=<optimized out>, ms=<optimized out>) at utils.c:1321
#3  0x00000000005cd782 in ast_tcptls_server_root (data=data@entry=0x7f3144d7df80 <sip_tcp_desc>) at tcptls.c:705
#4  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#5  0x00007f31b4315182 in start_thread (arg=0x7f312c103700) at pthread_create.c:312
#6  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 32 (Thread 0x7f3106940700 (LWP 20012)):
#0  0x00007f31b38e412d in poll () at ../sysdeps/unix/syscall-template.S:81
#1  0x00000000005ddd98 in poll (__timeout=-1, __nfds=1, __fds=0x7f310693f290) at /usr/include/x86_64-linux-gnu/bits/poll2.h:46
#2  ast_wait_for_input (fd=<optimized out>, ms=ms@entry=-1) at utils.c:1321
#3  0x0000000000543a95 in get_input (s=<optimized out>, s=<optimized out>, output=0x7f310693f840 "") at manager.c:6251
#4  do_message (s=0x7f310693f740) at manager.c:6323
#5  session_do (data=0x7f319000a398) at manager.c:6474
#6  0x00000000005cdcd5 in handle_tcptls_connection (data=data@entry=0x7f319000a398) at tcptls.c:685
#7  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#8  0x00007f31b4315182 in start_thread (arg=0x7f3106940700) at pthread_create.c:312
#9  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 31 (Thread 0x7f3105e98700 (LWP 1745)):
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238
#1  0x000000000052e2d2 in __ast_cond_timedwait (filename=<optimized out>, lineno=<optimized out>, func=<optimized out>, cond_name=<optimized out>, mutex_name=<optimized out>, cond=<optimized out>, t=0x7f31a4001600, abstime=0x7f3105e97de0) at lock.c:666
#2  0x00000000005d2bac in worker_idle (worker=0x7f31a40015c8) at threadpool.c:1101
#3  worker_start (arg=arg@entry=0x7f31a40015c8) at threadpool.c:993
#4  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#5  0x00007f31b4315182 in start_thread (arg=0x7f3105e98700) at pthread_create.c:312
#6  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 30 (Thread 0x7f31b0dfe700 (LWP 22312)):
#0  sem_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/sem_wait.S:85
#1  0x00000000005caf5c in ast_sem_wait (sem=0x1de4740) at /usr/src/asterisk-13.2.0/include/asterisk/sem.h:59
#2  default_tps_processing_function (data=data@entry=0x1de7298) at taskprocessor.c:177
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f31b0dfe700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 29 (Thread 0x7f3146895700 (LWP 22323)):
#0  sem_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/sem_wait.S:85
#1  0x00000000005caf5c in ast_sem_wait (sem=0x1e61de0) at /usr/src/asterisk-13.2.0/include/asterisk/sem.h:59
#2  default_tps_processing_function (data=data@entry=0x1e61ea8) at taskprocessor.c:177
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f3146895700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 28 (Thread 0x7f31b2fa2700 (LWP 22294)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x000000000052e2bd in __ast_cond_wait (filename=<optimized out>, lineno=<optimized out>, func=<optimized out>, cond_name=<optimized out>, mutex_name=<optimized out>, cond=<optimized out>, t=0x883ad0 <logmsgs+16>) at lock.c:598
#2  0x000000000052f9df in logger_thread (data=data@entry=0x0) at logger.c:1331
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f31b2fa2700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 27 (Thread 0x7f31b2766700 (LWP 22311)):
#0  sem_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/sem_wait.S:85
#1  0x00000000005caf5c in ast_sem_wait (sem=0x25d3530) at /usr/src/asterisk-13.2.0/include/asterisk/sem.h:59
#2  default_tps_processing_function (data=data@entry=0x2645f08) at taskprocessor.c:177
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f31b2766700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 26 (Thread 0x7f3146911700 (LWP 22322)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x000000000052e2bd in __ast_cond_wait (filename=<optimized out>, lineno=<optimized out>, func=<optimized out>, cond_name=<optimized out>, mutex_name=<optimized out>, cond=<optimized out>, t=0x1e4a610) at lock.c:598
#2  0x00000000005ab347 in sched_run (data=data@entry=0x1e4a610) at sched.c:124
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f3146911700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 25 (Thread 0x7f314407f700 (LWP 22324)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x000000000052e2bd in __ast_cond_wait (filename=<optimized out>, lineno=<optimized out>, func=<optimized out>, cond_name=<optimized out>, mutex_name=<optimized out>, cond=<optimized out>, t=0x7f31149f5268 <timing_thread+8>) at lock.c:598
#2  0x00007f31147f3808 in do_timing (arg=arg@entry=0x0) at res_timing_pthread.c:422
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f314407f700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 24 (Thread 0x7f31b2bc2700 (LWP 22302)):
#0  0x00007f31b38e412d in poll () at ../sysdeps/unix/syscall-template.S:81
#1  0x00000000005ddd98 in poll (__timeout=<optimized out>, __nfds=1, __fds=0x7f31b2bc1d30) at /usr/include/x86_64-linux-gnu/bits/poll2.h:46
#2  ast_wait_for_input (fd=<optimized out>, ms=<optimized out>) at utils.c:1321
#3  0x00000000005cd782 in ast_tcptls_server_root (data=data@entry=0x882860 <https_desc>) at tcptls.c:705
#4  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#5  0x00007f31b4315182 in start_thread (arg=0x7f31b2bc2700) at pthread_create.c:312
#6  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 23 (Thread 0x7f314698d700 (LWP 22321)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x000000000052e2bd in __ast_cond_wait (filename=<optimized out>, lineno=<optimized out>, func=<optimized out>, cond_name=<optimized out>, mutex_name=<optimized out>, cond=<optimized out>, t=0x1e3d5c0) at lock.c:598
#2  0x00000000005ab347 in sched_run (data=data@entry=0x1e3d5c0) at sched.c:124
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f314698d700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 22 (Thread 0x7f31b27e2700 (LWP 22310)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x000000000052e2bd in __ast_cond_wait (filename=<optimized out>, lineno=<optimized out>, func=<optimized out>, cond_name=<optimized out>, mutex_name=<optimized out>, cond=<optimized out>, t=0x2637ac0) at lock.c:598
#2  0x00000000005ab347 in sched_run (data=data@entry=0x2637ac0) at sched.c:124
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f31b27e2700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 21 (Thread 0x7f31b2db2700 (LWP 22298)):
#0  sem_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/sem_wait.S:85
#1  0x00000000005caf5c in ast_sem_wait (sem=0x1d63cd0) at /usr/src/asterisk-13.2.0/include/asterisk/sem.h:59
#2  default_tps_processing_function (data=data@entry=0x1d67278) at taskprocessor.c:177
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f31b2db2700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 20 (Thread 0x7f31b2c3e700 (LWP 22301)):
#0  0x00007f31b38e412d in poll () at ../sysdeps/unix/syscall-template.S:81
#1  0x00000000005ddd98 in poll (__timeout=<optimized out>, __nfds=1, __fds=0x7f31b2c3dd30) at /usr/include/x86_64-linux-gnu/bits/poll2.h:46
#2  ast_wait_for_input (fd=<optimized out>, ms=<optimized out>) at utils.c:1321
#3  0x00000000005cd782 in ast_tcptls_server_root (data=data@entry=0x882a80 <http_desc>) at tcptls.c:705
#4  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#5  0x00007f31b4315182 in start_thread (arg=0x7f31b2c3e700) at pthread_create.c:312
#6  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 19 (Thread 0x7f31b285e700 (LWP 22309)):
#0  sem_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/sem_wait.S:85
#1  0x00000000005caf5c in ast_sem_wait (sem=0x25fa1f0) at /usr/src/asterisk-13.2.0/include/asterisk/sem.h:59
#2  default_tps_processing_function (data=data@entry=0x2639e38) at taskprocessor.c:177
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f31b285e700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 18 (Thread 0x7f3105564700 (LWP 1746)):
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238
#1  0x000000000052e2d2 in __ast_cond_timedwait (filename=<optimized out>, lineno=<optimized out>, func=<optimized out>, cond_name=<optimized out>, mutex_name=<optimized out>, cond=<optimized out>, t=0x7f31a4000cb0, abstime=0x7f3105563de0) at lock.c:666
#2  0x00000000005d2bac in worker_idle (worker=0x7f31a4000c78) at threadpool.c:1101
#3  worker_start (arg=arg@entry=0x7f31a4000c78) at threadpool.c:993
#4  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#5  0x00007f31b4315182 in start_thread (arg=0x7f3105564700) at pthread_create.c:312
#6  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 17 (Thread 0x7f31b28da700 (LWP 22308)):
#0  0x00007f31b38e412d in poll () at ../sysdeps/unix/syscall-template.S:81
#1  0x00000000005ddd98 in poll (__timeout=<optimized out>, __nfds=1, __fds=0x7f31b28d9d30) at /usr/include/x86_64-linux-gnu/bits/poll2.h:46
#2  ast_wait_for_input (fd=<optimized out>, ms=<optimized out>) at utils.c:1321
#3  0x00000000005cd782 in ast_tcptls_server_root (data=data@entry=0x8848c0 <ami_desc>) at tcptls.c:705
#4  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#5  0x00007f31b4315182 in start_thread (arg=0x7f31b28da700) at pthread_create.c:312
#6  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 16 (Thread 0x7f31b2d36700 (LWP 22299)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x000000000052e2bd in __ast_cond_wait (filename=<optimized out>, lineno=<optimized out>, func=<optimized out>, cond_name=<optimized out>, mutex_name=<optimized out>, cond=<optimized out>, t=0x1d7f550) at lock.c:598
#2  0x0000000000465874 in bridge_manager_thread (data=data@entry=0x1d7f5a8) at bridge.c:4645
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f31b2d36700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 15 (Thread 0x7f3106ab4700 (LWP 22338)):
#0  0x00007f31b431cb9d in nanosleep () at ../sysdeps/unix/syscall-template.S:81
#1  0x00007f310c4861bc in cleanup (unused=unused@entry=0x0) at pbx_realtime.c:134
#2  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#3  0x00007f31b4315182 in start_thread (arg=0x7f3106ab4700) at pthread_create.c:312
#4  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 14 (Thread 0x7f31b3116700 (LWP 22291)):
#0  0x00007f31b38e412d in poll () at ../sysdeps/unix/syscall-template.S:81
#1  0x0000000000455840 in poll (__timeout=-1, __nfds=1, __fds=0x7f31b3115d60) at /usr/include/x86_64-linux-gnu/bits/poll2.h:46
#2  listener (unused=unused@entry=0x0) at asterisk.c:1582
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f31b3116700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 13 (Thread 0x7f31b2956700 (LWP 22307)):
#0  sem_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/sem_wait.S:85
#1  0x00000000005caf5c in ast_sem_wait (sem=0x260b600) at /usr/src/asterisk-13.2.0/include/asterisk/sem.h:59
#2  default_tps_processing_function (data=data@entry=0x2631d38) at taskprocessor.c:177
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f31b2956700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 12 (Thread 0x7f3106b30700 (LWP 22337)):
#0  0x00007f31b38e412d in poll () at ../sysdeps/unix/syscall-template.S:81
#1  0x00007f312cc124a1 in poll (__timeout=<optimized out>, __nfds=1, __fds=0x7f3106b2ddd0) at /usr/include/x86_64-linux-gnu/bits/poll2.h:46
#2  scan_thread (unused=unused@entry=0x0) at pbx_spool.c:710
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f3106b30700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 11 (Thread 0x7f31b6019780 (LWP 22286)):
#0  0x00007f31b38e412d in poll () at ../sysdeps/unix/syscall-template.S:81
#1  0x0000000000454785 in poll (__timeout=-1, __nfds=1, __fds=0x7fff51dc5820) at /usr/include/x86_64-linux-gnu/bits/poll2.h:46
#2  monitor_sig_flags (unused=unused@entry=0x0) at asterisk.c:3659
#3  0x0000000000433d5c in main (argc=<optimized out>, argv=<optimized out>) at asterisk.c:4642

Thread 10 (Thread 0x7f31b6018700 (LWP 22287)):
#0  sem_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/sem_wait.S:85
#1  0x00000000005caf5c in ast_sem_wait (sem=0x1c84380) at /usr/src/asterisk-13.2.0/include/asterisk/sem.h:59
#2  default_tps_processing_function (data=data@entry=0x1c84408) at taskprocessor.c:177
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f31b6018700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 9 (Thread 0x7f3106c28700 (LWP 22335)):
#0  sem_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/sem_wait.S:85
#1  0x00000000005caf5c in ast_sem_wait (sem=0x2539e80) at /usr/src/asterisk-13.2.0/include/asterisk/sem.h:59
#2  default_tps_processing_function (data=data@entry=0x1daa3f8) at taskprocessor.c:177
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f3106c28700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 8 (Thread 0x7f31b3192700 (LWP 22532)):
#0  0x00007f31b38e412d in poll () at ../sysdeps/unix/syscall-template.S:81
#1  0x00007f3144b5016a in poll (__timeout=<optimized out>, __nfds=2, __fds=0x7f31b318f4a0) at /usr/include/x86_64-linux-gnu/bits/poll2.h:46
#2  _sip_tcp_helper_thread (tcptls_session=0x7f319800aa48) at chan_sip.c:3042
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f31b3192700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 7 (Thread 0x7f3106d9c700 (LWP 22332)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x000000000052e2bd in __ast_cond_wait (filename=<optimized out>, lineno=<optimized out>, func=<optimized out>, cond_name=<optimized out>, mutex_name=<optimized out>, cond=<optimized out>, t=0x253b2d0) at lock.c:598
#2  0x00000000005ab347 in sched_run (data=data@entry=0x253b2d0) at sched.c:124
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f3106d9c700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 6 (Thread 0x7f3106d20700 (LWP 22333)):
#0  sem_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/sem_wait.S:85
#1  0x00000000005caf5c in ast_sem_wait (sem=0x26493d0) at /usr/src/asterisk-13.2.0/include/asterisk/sem.h:59
#2  default_tps_processing_function (data=data@entry=0x2525988) at taskprocessor.c:177
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f3106d20700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 5 (Thread 0x7f3106bac700 (LWP 22336)):
#0  sem_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/sem_wait.S:85
#1  0x00000000005caf5c in ast_sem_wait (sem=0x1db0b20) at /usr/src/asterisk-13.2.0/include/asterisk/sem.h:59
#2  default_tps_processing_function (data=data@entry=0x1da7118) at taskprocessor.c:177
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f3106bac700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 4 (Thread 0x7f312c17f700 (LWP 22328)):
#0  sem_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/sem_wait.S:85
#1  0x00000000005caf5c in ast_sem_wait (sem=0x1f61490) at /usr/src/asterisk-13.2.0/include/asterisk/sem.h:59
#2  default_tps_processing_function (data=data@entry=0x1f4dfb8) at taskprocessor.c:177
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f312c17f700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 3 (Thread 0x7f312c1fb700 (LWP 22327)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x000000000052e2bd in __ast_cond_wait (filename=<optimized out>, lineno=<optimized out>, func=<optimized out>, cond_name=<optimized out>, mutex_name=<optimized out>, cond=<optimized out>, t=0x1f4d170) at lock.c:598
#2  0x00000000005ab347 in sched_run (data=data@entry=0x1f4d170) at sched.c:124
#3  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#4  0x00007f31b4315182 in start_thread (arg=0x7f312c1fb700) at pthread_create.c:312
#5  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 2 (Thread 0x7f3106ca4700 (LWP 22334)):
#0  0x00007f31b431cb9d in nanosleep () at ../sysdeps/unix/syscall-template.S:81
#1  0x00007f312e2379dd in lock_broker (unused=unused@entry=0x0) at func_lock.c:211
#2  0x00000000005dc00a in dummy_start (data=<optimized out>) at utils.c:1232
#3  0x00007f31b4315182 in start_thread (arg=0x7f3106ca4700) at pthread_create.c:312
#4  0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 1 (Thread 0x7f31085d0700 (LWP 22325)):
#0  __memcpy_sse2_unaligned () at ../sysdeps/x86_64/multiarch/memcpy-sse2-unaligned.S:36
#1  0x00007f31b5184c2a in ?? () from /lib/x86_64-linux-gnu/libssl.so.1.0.0
#2  0x00007f31b5186970 in ?? () from /lib/x86_64-linux-gnu/libssl.so.1.0.0
#3  0x00007f31b5180af5 in ?? () from /lib/x86_64-linux-gnu/libssl.so.1.0.0
#4  0x00007f31135951c5 in dtls_perform_handshake (instance=instance@entry=0x7f31840960e8, dtls=dtls@entry=0x7f31840207e0, rtcp=rtcp@entry=0) at res_rtp_asterisk.c:1601
#5  0x00007f311359526c in ast_rtp_on_ice_complete (ice=<optimized out>, status=0) at res_rtp_asterisk.c:1629
#6  0x00007f314aed919d in on_timer () from /usr/local/lib/libpjnath.so.2
#7  0x00007f31b0e1eb67 in pj_timer_heap_poll () from /usr/local/lib/libpj.so.2
#8  0x00007f3113592218 in timer_worker_thread (data=<optimized out>) at res_rtp_asterisk.c:1715
#9  0x00007f31b0e0e66a in thread_main () from /usr/local/lib/libpj.so.2
#10 0x00007f31b4315182 in start_thread (arg=0x7f31085d0700) at pthread_create.c:312
#11 0x00007f31b38f147d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
Comments: