[Bug 1053306] Re: iscsiadm hangs in recvmsg()
Bug Watch Updater
1053306 at bugs.launchpad.net
Sat Oct 28 03:26:28 UTC 2017
Launchpad has imported 11 comments from the remote bug at
https://bugzilla.redhat.com/show_bug.cgi?id=624344.
If you reply to an imported comment from within Launchpad, your comment
will be sent to the remote bug automatically. Read more about
Launchpad's inter-bugtracker facilities at
https://help.launchpad.net/InterBugTracking.
------------------------------------------------------------------------
On 2010-08-16T04:07:59+00:00 Wade wrote:
Description of problem:
Each process must have its own semarg structure - or they step on each
others' toes - which could cause either deadlocks or smearing of the shared
memory protected by the semaphore.
Version-Release number of selected component (if applicable):
iscsi-initiator-utils-6.2.0.871-0.18.fc12.src.rpm (Anything based on 871
series).
How reproducible:
Unknown.
Steps to Reproduce:
1. Configure the iscsi initator util with at least two target devices.
2. Configure it to the maximum amount of logging
3. ?????
Actual results:
Logging can possibly cause a deadlock in waiting for semaphore access.
Expected results:
No deadlock to occur.
Additional info:
This is a backport of the patch from :
http://git.kernel.org/?p=linux/kernel/git/mnc/open-
iscsi.git;a=commitdiff;h=b95a7ca80b255f0c5b34b2669367b629c8489552;hp=fb4f2d3072bee96606d01e3535c100dc99b8d331
to the 871 series.
Mike Christie posted Guy Kerens patch (I think). This patch is already
in the EL6 build.
Reply at: https://bugs.launchpad.net/ubuntu/+source/open-
iscsi/+bug/1053306/comments/0
------------------------------------------------------------------------
On 2010-08-16T04:17:19+00:00 RHEL wrote:
This request was evaluated by Red Hat Product Management for
inclusion in the current release of Red Hat Enterprise Linux.
Because the affected component is not scheduled to be updated in the
current release, Red Hat is unfortunately unable to address this
request at this time. Red Hat invites you to ask your support
representative to propose this request, if appropriate and relevant,
in the next release of Red Hat Enterprise Linux.
Reply at: https://bugs.launchpad.net/ubuntu/+source/open-
iscsi/+bug/1053306/comments/1
------------------------------------------------------------------------
On 2010-08-16T21:11:45+00:00 Mike wrote:
I am going to resync the iscsi package to the upstream/rhel6 version, so
this will get brought in.
Thanks for the patch and report.
Reply at: https://bugs.launchpad.net/ubuntu/+source/open-
iscsi/+bug/1053306/comments/2
------------------------------------------------------------------------
On 2010-08-17T00:26:24+00:00 Issue wrote:
Event posted on 2010-08-17 09:26 JST by fuchi
G'day Wade,
A bugzilla has been opened, thank you so much!!
And here is a HotFix request. please approve this request.
http://seg.rdu.redhat.com/scripts/hotfix/edit.pl?id=5453
Kind regards,
Fuchi
This event sent from IssueTracker by fuchi
issue 1256153
Reply at: https://bugs.launchpad.net/ubuntu/+source/open-
iscsi/+bug/1053306/comments/3
------------------------------------------------------------------------
On 2010-09-01T02:51:17+00:00 Mike wrote:
Fixed in iscsi-initiator-utils-6.2.0.871-0.19:
http://people.redhat.com/mchristi/iscsi/rhel5.5.z/iscsi-initiator-utils/
This is what I am making for 5.5.z.
Reply at: https://bugs.launchpad.net/ubuntu/+source/open-
iscsi/+bug/1053306/comments/4
------------------------------------------------------------------------
On 2010-09-22T09:39:10+00:00 michal wrote:
Patch is included as iscsi-initiator-utils-fix-semop-log.patch in iscsi-initiator-utils-6.2.0.871-0.20.el5 and compiles correctly.
Reply at: https://bugs.launchpad.net/ubuntu/+source/open-
iscsi/+bug/1053306/comments/5
------------------------------------------------------------------------
On 2010-11-23T13:22:09+00:00 Florian wrote:
Technical note added. If any revisions are required, please edit the "Technical Notes" field
accordingly. All revisions will be proofread by the Engineering Content Services team.
New Contents:
* Previously, the open-iscsi administration utility (iscsiadm) sent incorrect initiator task tags (ITT) when encountering a multi-PDU This caused the discovery to fail. With this update, the ITT initialization and allocation sends the correct tags and iscsiadm works as expected. (BZ#633122)
Reply at: https://bugs.launchpad.net/ubuntu/+source/open-
iscsi/+bug/1053306/comments/6
------------------------------------------------------------------------
On 2010-11-23T13:22:51+00:00 Florian wrote:
Technical note updated. If any revisions are required, please edit the "Technical Notes" field
accordingly. All revisions will be proofread by the Engineering Content Services team.
Diffed Contents:
@@ -1 +1 @@
-* Previously, the open-iscsi administration utility (iscsiadm) sent incorrect initiator task tags (ITT) when encountering a multi-PDU This caused the discovery to fail. With this update, the ITT initialization and allocation sends the correct tags and iscsiadm works as expected. (BZ#633122)+Previously, iscsid shared the 'semarg' structure between multiple devices and could cause a deadlock when waiting for the semaphore access. With this update, each process is assigned its own structure and deadlocks no longer occur.
Reply at: https://bugs.launchpad.net/ubuntu/+source/open-
iscsi/+bug/1053306/comments/7
------------------------------------------------------------------------
On 2010-11-23T13:23:14+00:00 Florian wrote:
Technical note updated. If any revisions are required, please edit the "Technical Notes" field
accordingly. All revisions will be proofread by the Engineering Content Services team.
Diffed Contents:
@@ -1 +1 @@
-Previously, iscsid shared the 'semarg' structure between multiple devices and could cause a deadlock when waiting for the semaphore access. With this update, each process is assigned its own structure and deadlocks no longer occur.+Previously, iscsid shared the 'semarg' structure between multiple devices and thus caused a deadlock to occur when logging was initiated. With this update, each process is assigned its own structure and deadlocks no longer occurs during the logging process.
Reply at: https://bugs.launchpad.net/ubuntu/+source/open-
iscsi/+bug/1053306/comments/8
------------------------------------------------------------------------
On 2010-12-08T10:57:26+00:00 Jaromir wrote:
Technical note updated. If any revisions are required, please edit the "Technical Notes" field
accordingly. All revisions will be proofread by the Engineering Content Services team.
Diffed Contents:
@@ -1 +1 @@
-Previously, iscsid shared the 'semarg' structure between multiple devices and thus caused a deadlock to occur when logging was initiated. With this update, each process is assigned its own structure and deadlocks no longer occurs during the logging process.+Due to iscsid sharing the "semarg" structure between multiple devices, a deadlock may have occurred when logging was initiated. With this update, each process is assigned its own structure, so that such deadlocks no longer occur.
Reply at: https://bugs.launchpad.net/ubuntu/+source/open-
iscsi/+bug/1053306/comments/9
------------------------------------------------------------------------
On 2011-01-13T22:58:48+00:00 errata-xmlrpc wrote:
An advisory has been issued which should help the problem
described in this bug report. This report is therefore being
closed with a resolution of ERRATA. For more information
on therefore solution and/or where to find the updated files,
please follow the link below. You may reopen this bug report
if the solution does not work for you.
http://rhn.redhat.com/errata/RHBA-2011-0072.html
Reply at: https://bugs.launchpad.net/ubuntu/+source/open-
iscsi/+bug/1053306/comments/10
** Changed in: open-iscsi (Fedora)
Status: Unknown => Fix Released
** Changed in: open-iscsi (Fedora)
Importance: Unknown => High
--
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to open-iscsi in Ubuntu.
https://bugs.launchpad.net/bugs/1053306
Title:
iscsiadm hangs in recvmsg()
Status in open-iscsi package in Ubuntu:
Fix Released
Status in open-iscsi source package in Precise:
Fix Released
Status in open-iscsi source package in Quantal:
Fix Released
Status in open-iscsi package in Fedora:
Fix Released
Bug description:
[Impact]
iscsid can hang or crash
[Test Case]
1) This issue is exacerbated by increased logging output. To configure open-iscsi to emit the maximum amount of messages, edit /etc/init.d/open-iscsi and change the line:
start-stop-daemon --start --quiet --exec $DAEMON
to:
start-stop-daemon --start --quiet --exec $DAEMON -- -d 8
On your storage server, create multiple LUN targets and expose them to
your Ubuntu system. I recommend 3 or more.
Edit the attached repro.sh script to set the TARGET variable to point
to the correct IP of your storage server. Execute this script on your
Ubuntu system. When an error occurs, this script should hang or begin
emitting errors.
[Regression Potential]
I would expect regressions here to have the same symptoms of the original bug - e.g. hangs, crashes.
Original report follows.
We occasionally see iscsiadm hang indefinitely on a system. It is
difficult to reproduce, there maybe months between occurrences. This
happened again today, and we collected the following information.
We captured an strace of a failing iscsiadm discover process, I'll
attach it here. All iscsiadm processes that are hung are also in
recvmsg() when we attach strace.
It was observed that there was one iscsid process - where normally
there is 2. The pids are normally consecutive, so I presume one forks
the other before daemonizing.
syslog contains the following messages from iscsid:
Sep 20 15:55:57 cn5 iscsid: semop up failed 4
Sep 20 15:56:05 cn5 iscsid: semop down failed
Sep 20 15:56:23 cn5 iscsid: semop up failed 4
Sep 20 16:02:23 cn5 iscsid: semop up failed 4
Sep 20 16:02:26 cn5 iscsid: semop up failed 4
Sep 20 16:02:26 cn5 iscsid: semop up failed 4
Sep 20 16:02:26 cn5 iscsid: semop up failed 4
Sep 20 16:02:32 cn5 iscsid: semop up failed 4
Sep 20 18:01:49 cn5 iscsid: semop up failed 4
Sep 20 18:03:56 cn5 iscsid: semop up failed 4
Sep 20 18:05:03 cn5 iscsid: semop up failed 4
This sounds similar to the issue described in
https://bugzilla.redhat.com/show_bug.cgi?id=676804, but note the
different errno.
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/open-iscsi/+bug/1053306/+subscriptions
More information about the foundations-bugs
mailing list