linux-kernel - Re: [3.6.6] panic on reboot / khungtaskd blocked? (WARNING: at arch/x86/kernel/smp.c:123 native_smp_send_reschedule)
Open Source and information security mailing list archives
Date: Mon, 12 Nov :47 +0100
From: Pawe? Sikora &pawel.sikora@...k.net&
To: Michael Wang &wangyun@...ux.&
Cc: linux-kernel@...r.kernel.org, stable@...r.kernel.org,
torvalds@...ux-foundation.org, arekm@...-linux.org,
baggins@...-linux.org
Subject: Re: [3.6.6] panic on reboot / khungtaskd blocked? (WARNING: at arch/x86/kernel/smp.c:123 native_smp_send_reschedule)
On Monday 12 of November :31 Michael Wang wrote:
& On 11/12/ PM, Pawe? Sikora wrote:
& & On Monday 12 of November :12 Michael Wang wrote:
& && On 11/09/ PM, Pawe? Sikora wrote:
& &&& during playing with new ups i've caught an nice oops on reboot:
& &&& probably the upstream is also affected.
& && Hi, Pawe?
& && Are you using a clean 3.6.6 without any modify?
& & yes, pure 3.6.6 form git tree with modular config.
& && Looks like some threads has set itself to be UNINTERRUPTIBLE with out
& && any design on switch itself back later(or the time is too long), are you
& && accidentally using some bad designed module?
& & hmm, hard to say. mostly all modules are loaded automatically by kernel.
& Could you please provide the whole dmesg in text? your picture lost the
& print info of the hung task.
i've grabbed the console via rs232 but there's no more info (see attached txt).
the dmesg (filesystem) is not synced during panic (leds on keyboard blink, sysrq doesn't work).
how can i grab more info?
INIT: Switching to runlevel: 6
INIT: Sending processes the TERM signal
.[m..[315m.[m..[32mResource Manager: .[m..[315mEntering runlevel number.............................[m..[36m[.[m..[32m 6 .[m..[36m].[m..[315m
Stopping automounter service........................................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Setting terminals to default values.................................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Stopping mdadm service..............................................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Stopping Samba SMB/CIFS Server service..............................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Stopping Samba NetBIOS Name Server service..........................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Stopping cronie crond service.......................................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Stopping NIS client service.........................................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Stopping S.M.A.R.T. Daemon service..................................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Stopping block device availability:.................................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Unmounting NFS filesystems..........................................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Unmounting NFS filesystems..........................................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Stopping Name Switch Cache Daemon service...........................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Saving random seed..................................................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Stopping NFS daemon service.........................................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Stopping NFS mountd service.........................................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Stopping NFS exportfs service.......................................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Stopping RPC idmapd service.........................................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Stopping syslog-ng service..........................................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Stopping D-BUS Message bus service..................................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Stopping rpcbind service............................................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Stopping OpenSSH service............................................[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Shutting down interface eth0........................................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Shutting down interface eth1........................................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Stopping UPS daemon service........................................Network UPS Tools upsd 2.6.4-Unversioned directory
Stopping UPS drivers................................................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Stopping UPSmon service.............................................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Flushing all chains.................................................[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Removing user defined chains........................................[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Resetting built-in chains to the default ACCEPT policy..............[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Flushing all chains.................................................[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Removing user defined chains........................................[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Resetting built-in chains to the default ACCEPT policy..............[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Stopping irqbalance service.........................................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Sending all processes the TERM signal...............................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
Sending all processes the KILL signal...............................[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
PID %CPU %MEM
STAT START
TIME COMMAND
0:15 init [6]
0:00 [kthreadd]
0:00 [ksoftirqd/0]
0:00 [kworker/0:0]
0:00 [kworker/0:0H]
0:00 [kworker/u:0]
0:00 [kworker/u:0H]
0:00 [migration/0]
0:00 [watchdog/0]
0:00 [migration/1]
0:00 [kworker/1:0]
0:00 [kworker/1:0H]
0:00 [ksoftirqd/1]
0:00 [watchdog/1]
0:00 [migration/2]
0:00 [kworker/2:0]
0:00 [kworker/2:0H]
0:00 [ksoftirqd/2]
0:00 [watchdog/2]
0:00 [migration/3]
0:00 [kworker/3:0]
0:00 [kworker/3:0H]
0:00 [ksoftirqd/3]
0:00 [watchdog/3]
0:00 [migration/4]
0:00 [kworker/4:0]
0:00 [kworker/4:0H]
0:00 [ksoftirqd/4]
0:00 [watchdog/4]
0:00 [migration/5]
0:00 [kworker/5:0]
0:00 [kworker/5:0H]
0:00 [ksoftirqd/5]
0:00 [watchdog/5]
0:00 [migration/6]
0:00 [kworker/6:0]
0:00 [kworker/6:0H]
0:00 [ksoftirqd/6]
0:00 [watchdog/6]
0:00 [migration/7]
0:00 [kworker/7:0]
0:00 [kworker/7:0H]
0:00 [ksoftirqd/7]
0:00 [watchdog/7]
0:00 [migration/8]
0:00 [kworker/8:0]
0:00 [kworker/8:0H]
0:00 [ksoftirqd/8]
0:00 [watchdog/8]
0:00 [migration/9]
0:00 [kworker/9:0]
0:00 [kworker/9:0H]
0:00 [ksoftirqd/9]
0:00 [watchdog/9]
0:00 [migration/10]
0:00 [kworker/10:0]
0:00 [kworker/10:0H]
0:00 [ksoftirqd/10]
0:00 [watchdog/10]
0:00 [migration/11]
0:00 [kworker/11:0]
0:00 [kworker/11:0H]
0:00 [ksoftirqd/11]
0:00 [watchdog/11]
0:00 [migration/12]
0:00 [kworker/12:0]
0:00 [kworker/12:0H]
0:00 [ksoftirqd/12]
0:00 [watchdog/12]
0:00 [migration/13]
0:00 [kworker/13:0]
0:00 [kworker/13:0H]
0:00 [ksoftirqd/13]
0:00 [watchdog/13]
0:00 [migration/14]
0:00 [kworker/14:0]
0:00 [kworker/14:0H]
0:00 [ksoftirqd/14]
0:00 [watchdog/14]
0:00 [migration/15]
0:00 [kworker/15:0]
0:00 [kworker/15:0H]
0:00 [ksoftirqd/15]
0:00 [watchdog/15]
0:00 [cpuset]
0:00 [khelper]
0:00 [kdevtmpfs]
0:00 [netns]
0:00 [bdi-default]
0:00 [kintegrityd]
0:00 [kblockd]
0:00 [kworker/13:1]
0:00 [irq/40-AMD-Vi]
0:00 [khungtaskd]
0:00 [kswapd0]
0:00 [kswapd1]
0:00 [kswapd2]
0:00 [kswapd3]
0:00 [ksmd]
0:00 [khugepaged]
0:00 [fsnotify_mark]
0:00 [crypto]
0:00 [kthrotld]
0:07 [kworker/0:1]
0:00 [kworker/14:1]
0:00 [kworker/15:1]
0:00 [kworker/12:1]
0:00 [kworker/5:1]
0:00 [kworker/1:1]
0:00 [kworker/2:1]
0:00 [kworker/3:1]
0:00 [deferwq]
0:00 [kworker/u:1]
0:00 [charger_manage
0:00 [devfreq_wq]
0:00 [kworker/4:1]
0:01 [kworker/9:1]
0:00 [kworker/6:1]
0:00 [kworker/10:1]
0:00 [kworker/11:1]
0:00 [khubd]
0:00 [kworker/0:2]
0:00 [kworker/7:1]
0:00 [kworker/8:1]
0:00 [ata_sff]
0:00 [scsi_eh_0]
0:00 [scsi_eh_1]
0:00 [scsi_eh_2]
0:00 [scsi_eh_3]
0:00 [kworker/u:2]
0:01 [kworker/u:3]
0:00 [kworker/u:4]
0:00 [kworker/u:5]
0:00 [kworker/0:1H]
0:00 [kworker/10:1H]
0:00 [kworker/7:1H]
0:00 [kworker/4:1H]
0:00 [kworker/1:2]
0:00 [kworker/11:1H]
0:00 [kworker/13:1H]
0:00 [kworker/14:1H]
0:00 [kworker/12:1H]
0:00 [kworker/15:1H]
0:00 [kworker/6:1H]
0:00 [kworker/5:1H]
0:00 [md0_raid1]
0:00 [kworker/9:1H]
0:00 [kjournald]
0:00 [kworker/8:1H]
0:00 [kworker/1:1H]
0:00 [edac-poller]
0:00 [kvm-irqfd-clea
0:00 [kworker/0:3]
0:00 [ttm_swap]
0:00 [kworker/12:2]
0:00 [flush-9:0]
0:00 [kauditd]
0:00 [kworker/4:2]
0:00 [kworker/6:2]
0:00 [kworker/5:2]
0:00 [kworker/7:2]
0:01 [jbd2/md1-8]
0:00 [ext4-dio-unwri
0:00 [jbd2/md2-8]
0:00 [ext4-dio-unwri
0:10 [flush-9:1]
0:00 [flush-9:2]
0:00 [kipmi0]
0:00 [rpciod]
0:00 [lockd]
0:00 [kworker/3:1H]
0:00 [nfsiod]
0:00 [Xvnc]
0:00 [vncconfig]
0:00 [xfce4-session]
0:00 xfwm4
0:00 xfce4-panel
0:00 [Thunar]
0:00 xfdesktop
0:00 xfsettingsd
0:00 [panel-6-systra
0:00 [panel-2-action
0:00 [kworker/2:1H]
0:00 [flush-0:29]
0:00 [kworker/3:2]
0:00 [nfsv4.0-svc]
0:00 [wish]
0:00 [slave_odra_d_0
0:00 [flush-0:32]
0:00 /bin/sh /etc/rc
0:00 [kworker/10:2]
0:00 ps aux
+ is_yes no
+ [ 1 = 0 ]
+ return 1
+ run_cmd Turning off swap swapoff -a
+ typeset force_err=0 exit_code=0 errors user
+ [ 3 -gt 0 ]
+ typeset message=Turning off swap
+ show Turning off swap
+ typeset text len
+ is_no no
+ [ 1 = 0 ]
+ return 0
+ is_yes yes
+ [ 1 = 0 ]
+ return 0
+ nls -n Turning off swap
+ typeset msg_echo nls_domain text message
+ msg_echo=\n
+ nls_domain=
+ [ -n != n ]
+ msg_echo=
+ [ Turning off swap != Turning off swap ]
+ message=Turning off swap
+ [ -z Turning off swap ]
+ is_yes yes
+ [ 1 = 0 ]
+ return 0
+ gettext -e --domain=rc-scripts Turning off swap
+ TEXTDOMAINDIR=/etc/sysconfig/locale
+ message=Turning off swap
+ printf Turning off swap
+ echo -en
+ text=Turning off swap
+ [ 16 -lt 67 ]
+ text=Turning off swap.
+ [ 17 -lt 67 ]
+ text=Turning off swap..
+ [ 18 -lt 67 ]
+ text=Turning off swap...
+ text=Turning off swap..................................................
+ [ 66 -lt 67 ]
+ text=Turning off swap...................................................
+ [ 67 -lt 67 ]
+ echo -n Turning off swap...................................................
Turning off swap...................................................+ busy
+ echo -n .[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m
.[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m+ cd /
+ export HOME=/tmp TMPDIR=/tmp
+ is_no no
+ [ 1 = 0 ]
+ return 0
+ swapoff -a
+ echo .[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
+ log_success swapoff Turning off swap
+ return 0
+ [ -x /etc/rc.d/rc.acct ]
+ [ -x /sbin/quotaoff ]
+ cat /sys/kernel/kexec_loaded
+ 2&/dev/null
+ kexec_loaded=0
+ UMOUNT_IGNORE=/
+ awk -v ig=^(/)$ BEGIN { gsub(/[\t ]+/, "|", ig); } \
$3 !~ /^(proc|loopfs|devpts|devtmpfs|shm|iso9660|ramfs|tmpfs|sysfs|securityfs|squashfs)$/ \
&& $1 !~ /^(none|\/dev\/root)$/ \
&& $2 !~ ig {print $2} /proc/mounts
+ remaining=/home/atest
/home/users
/proc/fs/nfsd
/var/lib/nfs/rpc_pipefs
/remote/dragon
/remote/nexus
+ [ -n /home/atest
/home/users
/proc/fs/nfsd
/var/lib/nfs/rpc_pipefs
/remote/dragon
/remote/nexus -a 3 -gt 0 ]
+ show Unmounting file systems
+ typeset text len
+ is_no no
+ [ 1 = 0 ]
+ return 0
+ is_yes yes
+ [ 1 = 0 ]
+ return 0
+ nls -n Unmounting file systems
+ typeset msg_echo nls_domain text message
+ msg_echo=\n
+ nls_domain=
+ [ -n != n ]
+ msg_echo=
+ [ Unmounting file systems != Unmounting file systems ]
+ message=Unmounting file systems
+ [ -z Unmounting file systems ]
+ is_yes yes
+ [ 1 = 0 ]
+ return 0
+ gettext -e --domain=rc-scripts Unmounting file systems
+ TEXTDOMAINDIR=/etc/sysconfig/locale
+ message=Unmounting file systems
+ printf Unmounting file systems
+ echo -en
+ text=Unmounting file systems
+ [ 23 -lt 67 ]
+ text=Unmounting file systems.
+ [ 24 -lt 67 ]
+ text=Unmounting file systems..
+ text=Unmounting file systems............................................
+ [ 67 -lt 67 ]
+ echo -n Unmounting file systems............................................
Unmounting file systems............................................+ busy
+ echo -n .[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m
.[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m+ umount -a -t noproc
+ ERRORS=umount: /home/atest: target is busy.
(In some cases useful info about processes that use
the device is found by lsof(8) or fuser(1))
umount: /dev: target is busy.
(In some cases useful info about processes that use
the device is found by lsof(8) or fuser(1))
+ is_yes yes
+ [ 1 = 0 ]
+ return 0
+ rc_gettext_init
+ [ -z yes ]
+ [ -d /usr/share/terminfo ]
+ [ -x /usr/bin/tput -o -x /bin/tput ]
+ TPUT=yes
+ tput longname
+ &/dev/null
+ [ 32 = 0 ]
+ echo .[68G.[m..[36m[.[m..[31m FAIL .[m..[36m].[m..[315m
.[68G.[m..[36m[.[m..[31m FAIL .[m..[36m].[m..[315m
+ return 1
+ [ -n umount: /home/atest: target is busy.
(In some cases useful info about processes that use
the device is found by lsof(8) or fuser(1))
umount: /dev: target is busy.
(In some cases useful info about processes that use
the device is found by lsof(8) or fuser(1)) ]
+ echo umount: /home/atest: target is busy.
(In some cases useful info about processes that use
the device is found by lsof(8) or fuser(1))
umount: /dev: target is busy.
(In some cases useful info about processes that use
the device is found by lsof(8) or fuser(1))
umount: /home/atest: target is busy.
(In some cases useful info about processes that use
the device is found by lsof(8) or fuser(1))
umount: /dev: target is busy.
(In some cases useful info about processes that use
the device is found by lsof(8) or fuser(1))
+ awk -v ig=^(/)$ BEGIN { gsub(/[\t ]+/, "|", ig); } \
$3 !~ /^(proc|loopfs|devpts|devtmpfs|shm|iso9660|ramfs|tmpfs|sysfs|securityfs|squashfs)$/ \
&& $1 !~ /^(none|\/dev\/root)$/ \
&& $2 !~ ig {print $2} /proc/mounts
+ remaining=/home/atest
+ [ -z /home/atest ]
+ fuser -k -m -15 /home/atest
+ &/dev/null
Cannot stat file /proc/2025/fd/1: Connection timed out
Cannot stat file /proc/2025/fd/2: Connection timed out
Cannot stat file /proc/2029/fd/1: Connection timed out
Cannot stat file /proc/2029/fd/2: Connection timed out
Cannot stat file /proc/2033/fd/1: Connection timed out
Cannot stat file /proc/2033/fd/2: Connection timed out
Cannot stat file /proc/2041/fd/1: Connection timed out
Cannot stat file /proc/2041/fd/2: Connection timed out
+ force=-f
+ [ -n /home/atest -a 2 -gt 0 ]
+ show Unmounting file systems
+ typeset text len
+ is_no no
+ [ 1 = 0 ]
+ return 0
+ is_yes yes
+ [ 1 = 0 ]
+ return 0
+ nls -n Unmounting file systems
+ typeset msg_echo nls_domain text message
+ msg_echo=\n
+ nls_domain=
+ [ -n != n ]
+ msg_echo=
+ [ Unmounting file systems != Unmounting file systems ]
+ message=Unmounting file systems
+ [ -z Unmounting file systems ]
+ is_yes yes
+ [ 1 = 0 ]
+ return 0
+ gettext -e --domain=rc-scripts Unmounting file systems
+ TEXTDOMAINDIR=/etc/sysconfig/locale
+ message=Unmounting file systems
+ printf Unmounting file systems
+ echo -en
+ text=Unmounting file systems
+ [ 23 -lt 67 ]
+ text=Unmounting file systems.
+ [ 24 -lt 67 ]
+ text=Unmounting file systems..
+ text=Unmounting file systems............................................
+ [ 67 -lt 67 ]
+ echo -n Unmounting file systems............................................
Unmounting file systems............................................+ busy
+ echo -n .[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m
.[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m+ umount -a -f -t noproc
+ ERRORS=umount: /home/atest: target is busy.
(In some cases useful info about processes that use
the device is found by lsof(8) or fuser(1))
umount: /dev: target is busy.
(In some cases useful info about processes that use
the device is found by lsof(8) or fuser(1))
+ is_yes yes
+ [ 1 = 0 ]
+ return 0
+ rc_gettext_init
+ [ -z yes ]
+ [ -d /usr/share/terminfo ]
+ [ -x /usr/bin/tput -o -x /bin/tput ]
+ TPUT=yes
+ tput longname
+ &/dev/null
+ [ 32 = 0 ]
+ echo .[68G.[m..[36m[.[m..[31m FAIL .[m..[36m].[m..[315m
.[68G.[m..[36m[.[m..[31m FAIL .[m..[36m].[m..[315m
+ return 1
+ [ -n umount: /home/atest: target is busy.
(In some cases useful info about processes that use
the device is found by lsof(8) or fuser(1))
umount: /dev: target is busy.
(In some cases useful info about processes that use
the device is found by lsof(8) or fuser(1)) ]
+ echo umount: /home/atest: target is busy.
(In some cases useful info about processes that use
the device is found by lsof(8) or fuser(1))
umount: /dev: target is busy.
(In some cases useful info about processes that use
the device is found by lsof(8) or fuser(1))
umount: /home/atest: target is busy.
(In some cases useful info about processes that use
the device is found by lsof(8) or fuser(1))
umount: /dev: target is busy.
(In some cases useful info about processes that use
the device is found by lsof(8) or fuser(1))
+ awk -v ig=^(/)$ BEGIN { gsub(/[\t ]+/, "|", ig); } \
$3 !~ /^(proc|loopfs|devpts|devtmpfs|shm|iso9660|ramfs|tmpfs|sysfs|securityfs|squashfs)$/ \
&& $1 !~ /^(none|\/dev\/root)$/ \
&& $2 !~ ig {print $2} /proc/mounts
+ remaining=/home/atest
+ [ -z /home/atest ]
+ fuser -k -m -9 /home/atest
+ &/dev/null
Cannot stat file /proc/2025/fd/1: Connection timed out
Cannot stat file /proc/2025/fd/2: Connection timed out
Cannot stat file /proc/2029/fd/1: Connection timed out
Cannot stat file /proc/2029/fd/2: Connection timed out
Cannot stat file /proc/2033/fd/1: Connection timed out
Cannot stat file /proc/2033/fd/2: Connection timed out
Cannot stat file /proc/2041/fd/1: Connection timed out
Cannot stat file /proc/2041/fd/2: Connection timed out
+ force=-f
+ [ -n /home/atest -a 1 -gt 0 ]
+ show Unmounting file systems
+ typeset text len
+ is_no no
+ [ 1 = 0 ]
+ return 0
+ is_yes yes
+ [ 1 = 0 ]
+ return 0
+ nls -n Unmounting file systems
+ typeset msg_echo nls_domain text message
+ msg_echo=\n
+ nls_domain=
+ [ -n != n ]
+ msg_echo=
+ [ Unmounting file systems != Unmounting file systems ]
+ message=Unmounting file systems
+ [ -z Unmounting file systems ]
+ is_yes yes
+ [ 1 = 0 ]
+ return 0
+ gettext -e --domain=rc-scripts Unmounting file systems
+ TEXTDOMAINDIR=/etc/sysconfig/locale
+ message=Unmounting file systems
+ printf Unmounting file systems
+ echo -en
+ text=Unmounting file systems
+ [ 23 -lt 67 ]
+ text=Unmounting file systems.
+ [ 24 -lt 67 ]
+ text=Unmounting file systems..
+ [ 67 -lt 67 ]
+ echo -n Unmounting file systems............................................
Unmounting file systems............................................+ busy
+ echo -n .[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m
.[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m+ umount -a -f -t noproc
+ ERRORS=umount: /home/atest: target is busy.
(In some cases useful info about processes that use
the device is found by lsof(8) or fuser(1))
umount: /dev: target is busy.
(In some cases useful info about processes that use
the device is found by lsof(8) or fuser(1))
+ is_yes yes
+ [ 1 = 0 ]
+ return 0
+ rc_gettext_init
+ [ -z yes ]
+ [ -d /usr/share/terminfo ]
+ [ -x /usr/bin/tput -o -x /bin/tput ]
+ TPUT=yes
+ tput longname
+ &/dev/null
+ [ 32 = 0 ]
+ echo .[68G.[m..[36m[.[m..[31m FAIL .[m..[36m].[m..[315m
.[68G.[m..[36m[.[m..[31m FAIL .[m..[36m].[m..[315m
+ return 1
+ [ -n umount: /home/atest: target is busy.
(In some cases useful info about processes that use
the device is found by lsof(8) or fuser(1))
umount: /dev: target is busy.
(In some cases useful info about processes that use
the device is found by lsof(8) or fuser(1)) ]
+ echo umount: /home/atest: target is busy.
(In some cases useful info about processes that use
the device is found by lsof(8) or fuser(1))
umount: /dev: target is busy.
(In some cases useful info about processes that use
the device is found by lsof(8) or fuser(1))
umount: /home/atest: target is busy.
(In some cases useful info about processes that use
the device is found by lsof(8) or fuser(1))
umount: /dev: target is busy.
(In some cases useful info about processes that use
the device is found by lsof(8) or fuser(1))
+ awk -v ig=^(/)$ BEGIN { gsub(/[\t ]+/, "|", ig); } \
$3 !~ /^(proc|loopfs|devpts|devtmpfs|shm|iso9660|ramfs|tmpfs|sysfs|securityfs|squashfs)$/ \
&& $1 !~ /^(none|\/dev\/root)$/ \
&& $2 !~ ig {print $2} /proc/mounts
+ remaining=/home/atest
+ [ -z /home/atest ]
+ fuser -k -m -9 /home/atest
+ &/dev/null
Cannot stat file /proc/2025/fd/1: Connection timed out
Cannot stat file /proc/2025/fd/2: Connection timed out
Cannot stat file /proc/2029/fd/1: Connection timed out
Cannot stat file /proc/2029/fd/2: Connection timed out
Cannot stat file /proc/2033/fd/1: Connection timed out
Cannot stat file /proc/2033/fd/2: Connection timed out
+ force=-f
+ [ -n /home/atest -a 0 -gt 0 ]
+ run_cmd Remounting root filesystem in ro mode mount -n -o remount,ro /
+ typeset force_err=0 exit_code=0 errors user
+ [ 6 -gt 0 ]
+ typeset message=Remounting root filesystem in ro mode
+ show Remounting root filesystem in ro mode
+ typeset text len
+ is_no no
+ [ 1 = 0 ]
+ return 0
+ is_yes yes
+ [ 1 = 0 ]
+ return 0
+ nls -n Remounting root filesystem in ro mode
+ typeset msg_echo nls_domain text message
+ msg_echo=\n
+ nls_domain=
+ [ -n != n ]
+ msg_echo=
+ [ Remounting root filesystem in ro mode != Remounting root filesystem in ro mode ]
+ message=Remounting root filesystem in ro mode
+ [ -z Remounting root filesystem in ro mode ]
+ is_yes yes
+ [ 1 = 0 ]
+ return 0
+ gettext -e --domain=rc-scripts Remounting root filesystem in ro mode
+ TEXTDOMAINDIR=/etc/sysconfig/locale
+ message=Remounting root filesystem in ro mode
+ printf Remounting root filesystem in ro mode
+ echo -en
+ text=Remounting root filesystem in ro mode
+ [ 37 -lt 67 ]
+ text=Remounting root filesystem in ro mode.
+ [ 38 -lt 67 ]
+ text=Remounting root filesystem in ro mode..
+ text=Remounting root filesystem in ro mode..............................
+ [ 67 -lt 67 ]
+ echo -n Remounting root filesystem in ro mode..............................
Remounting root filesystem in ro mode..............................+ busy
+ echo -n .[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m
.[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m+ cd /
+ export HOME=/tmp TMPDIR=/tmp
+ is_no no
+ [ 1 = 0 ]
+ return 0
+ mount -n -o remount,ro /
+ errors=mount: / is busy
+ echo .[68G.[m..[36m[.[m..[31m FAIL .[m..[36m].[m..[315m
.[68G.[m..[36m[.[m..[31m FAIL .[m..[36m].[m..[315m
+ return 1
+ log_failed mount Remounting root filesystem in ro mode
+ exit_code=1
+ [ -n mount: / is busy ]
+ [ 1 -eq 1 -o 0 -eq 1 ]
+ echo mount: / is busy
mount: / is busy
+ return 1
+ [ -x /sbin/vgchange ]
+ /sbin/vgchange --version
+ 2&/dev/null
+ awk /LVM version:/{if ($3 &= 2) print "2"}
+ lvmversion=2
+ [ 2 = 2 ]
+ lvmsysinit=--sysinit
+ /sbin/vgchange -a n --sysinit
+ &/dev/null
+ goraidtab=1
+ [ -x /sbin/mdadm -a -f /etc/mdadm.conf ]
+ grep -qE ^([[:blank:]]|)ARRAY[[:blank:]] /etc/mdadm.conf
+ 2&/dev/null
+ /sbin/mdadm --stop --scan
+ &/dev/null
+ [ 1 -eq 0 ]
+ [ -x /sbin/raidstop -a -f /etc/raidtab -a 1 -eq 1 ]
+ show Remounting remaining filesystems ro mode
+ typeset text len
+ is_no no
+ [ 1 = 0 ]
+ return 0
+ is_yes yes
+ [ 1 = 0 ]
+ return 0
+ nls -n Remounting remaining filesystems ro mode
+ typeset msg_echo nls_domain text message
+ msg_echo=\n
+ nls_domain=
+ [ -n != n ]
+ msg_echo=
+ [ Remounting remaining filesystems ro mode != Remounting remaining filesystems ro mode ]
+ message=Remounting remaining filesystems ro mode
+ [ -z Remounting remaining filesystems ro mode ]
+ is_yes yes
+ [ 1 = 0 ]
+ return 0
+ gettext -e --domain=rc-scripts Remounting remaining filesystems ro mode
+ TEXTDOMAINDIR=/etc/sysconfig/locale
+ message=Remounting remaining filesystems ro mode
+ printf Remounting remaining filesystems ro mode
+ echo -en
+ text=Remounting remaining filesystems ro mode
+ [ 40 -lt 67 ]
+ text=Remounting remaining filesystems ro mode.
+ text=Remounting remaining filesystems ro mode...........................
+ [ 67 -lt 67 ]
+ echo -n Remounting remaining filesystems ro mode...........................
Remounting remaining filesystems ro mode...........................+ busy
+ echo -n .[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m
.[68G.[m..[36m[.[m..[35m BUSY .[m..[36m].[m..[315m+ mount
+ awk /ext2|ext3|reiserfs|xfs|jfs/ { print $3 }
+ read line
+ mount -n -o ro,remount /
mount: / is busy
+ read line
+ echo .[68G.[m..[36m[.[m..[31m FAIL .[m..[36m].[m..[315m
.[68G.[m..[36m[.[m..[31m FAIL .[m..[36m].[m..[315m
+ return 1
+ _rebootwhat=system
+ [ -f /etc/crypttab ]
+ is_empty_file /etc/crypttab
+ [ -s /etc/crypttab ]
+ grep -vqE ^(#|[[:blank:]]*$) /etc/crypttab
+ return 0
+ [ 6 = 0 ]
+ show Please stand by while rebooting the system
+ typeset text len
+ is_no no
+ [ 1 = 0 ]
+ return 0
+ is_yes yes
+ [ 1 = 0 ]
+ return 0
+ nls -n Please stand by while rebooting the system
+ typeset msg_echo nls_domain text message
+ msg_echo=\n
+ nls_domain=
+ [ -n != n ]
+ msg_echo=
+ [ Please stand by while rebooting the system != Please stand by while rebooting the system ]
+ message=Please stand by while rebooting the system
+ [ -z Please stand by while rebooting the system ]
+ is_yes yes
+ [ 1 = 0 ]
+ return 0
+ gettext -e --domain=rc-scripts Please stand by while rebooting the system
+ TEXTDOMAINDIR=/etc/sysconfig/locale
+ message=Please stand by while rebooting the system
+ printf Please stand by while rebooting the system
+ echo -en
+ text=Please stand by while rebooting the system
+ [ 42 -lt 67 ]
+ text=Please stand by while rebooting the system.
+ text=Please stand by while rebooting the system.........................
+ [ 67 -lt 67 ]
+ echo -n Please stand by while rebooting the system.........................
Please stand by while rebooting the system.........................+ ok
+ echo .[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
.[68G.[m..[36m[.[m..[32m DONE .[m..[36m].[m..[315m
+ [ -f /fastboot ]
+ emit stopped JOB=shutdown
+ use_upstart
+ is_yes no
+ [ 1 = 0 ]
+ return 1
+ is_no no
+ [ 1 = 0 ]
+ return 0
+ return 1
+ return 0
+ emit stopping JOB=shutdown
+ use_upstart
+ is_yes no
+ [ 1 = 0 ]
+ return 1
+ is_no no
+ [ 1 = 0 ]
+ return 0
+ return 1
+ return 0
+ [ -x /sbin/kexec ]
+ [ 3 != unknown ]
+ eval reboot -d -f
+ reboot -d -f
493.548872] Kernel panic - not syncing: hung_task: blocked tasks
493.620619] Pid: 94, comm: khungtaskd Tainted: G
493.698572] Call Trace:
493.727745]
[&ffffffff&] panic+0xbc/0x1cb
493.784938]
[&ffffffff810c6eb5&] watchdog+0x245/0x250
493.846286]
[&ffffffff810c6c70&] ? hung_task_panic+0x20/0x20
493.914898]
[&ffffffff810727ce&] kthread+0x8e/0xa0
493.973132]
[&ffffffff814afa04&] kernel_thread_helper+0x4/0x10
494.043821]
[&ffffffff&] ? kthread_freezable_should_stop+0x70/0x70
494.126966]
[&ffffffff814afa00&] ? gs_change+0x13/0x13
494.189390] panic occurred, switching back to text console
494.254971] ------------[ cut here ]------------
494.310074] WARNING: at arch/x86/kernel/smp.c:123 native_smp_send_reschedule+0x53/0x60()
494.406710] Hardware name: H8DGU
494.445221] Modules linked in: nfsv4 fuse nfsv3 nfs fscache nfsd lockd nfs_acl auth_rpcgss sunrpc ipmi_si ipmi_devintf ipmi_msghandler sch_sfq iptable_nat nf_nat nf_conntrack_ipv4 nf_conntrack nf_defrag_ipv4 iptable_filter xt_TCPMSS xt_tcpudp iptable_mangle ip_tables ip6table_filter ip6_tables x_tables ext4 jbd2 crc16 raid0 dm_mod autofs4 dummy ide_cd_mod cdrom ata_generic pata_acpi sp5100_tco pata_atiixp ide_pci_generic mgag200 ttm drm_kms_helper drm igb powernow_k8 freq_table mperf joydev kvm_amd i2c_algo_bit sysimgblt sysfillrect syscopyarea dca ptp hid_generic kvm pps_core k10temp microcode i2c_piix4 evdev pcspkr hwmon amd64_edac_mod edac_core atiixp ide_core edac_mce_amd i2c_core processor button ext3 jbd mbcache sd_mod crc_t10dif raid1 md_mod ahci libahci libata scsi_mod usbhid hid ohci_hcd ehci_hcd usbcore usb_common
495.326812] Pid: 94, comm: khungtaskd Tainted: G
495.404768] Call Trace:
495.433938]
[&ffffffff810500da&] warn_slowpath_common+0x7a/0xb0
495.513036]
[&ffffffff&] warn_slowpath_null+0x15/0x20
495.582688]
[&ffffffff81034d73&] native_smp_send_reschedule+0x53/0x60
495.660644]
[&ffffffff81089fcc&] trigger_load_balance+0x17c/0x220
495.734446]
[&ffffffff81081ae4&] scheduler_tick+0x104/0x140
495.802022]
[&ffffffff&] update_process_times+0x67/0x80
495.873749]
[&ffffffff&] tick_sched_timer+0x69/0xe0
495.941324]
[&ffffffff810769ce&] __run_hrtimer+0x6e/0x1c0
496.006822]
[&ffffffff&] ? tick_nohz_handler+0x100/0x100
496.079589]
[&ffffffff81058a15&] ? __do_softirq+0x115/0x1f0
496.147163]
[&ffffffff810772af&] hrtimer_interrupt+0xef/0x220
496.216814]
[&ffffffff81035b34&] smp_apic_timer_interrupt+0x64/0xa0
496.292694]
[&ffffffff814af40a&] apic_timer_interrupt+0x6a/0x70
496.364420]
[&ffffffff&] ? panic+0x187/0x1cb
496.432100]
[&ffffffff810c6eb5&] watchdog+0x245/0x250
496.493445]
[&ffffffff810c6c70&] ? hung_task_panic+0x20/0x20
496.562059]
[&ffffffff810727ce&] kthread+0x8e/0xa0
496.620293]
[&ffffffff814afa04&] kernel_thread_helper+0x4/0x10
496.690981]
[&ffffffff&] ? kthread_freezable_should_stop+0x70/0x70
496.774126]
[&ffffffff814afa00&] ? gs_change+0x13/0x13
496.836511] ---[ end trace f42d1c6fc3b40f64 ]---