Hi,

Cluster resource failback operation failed due to evms engine lock error.

When we tried to check failover and failback operation for cluster resources, first we powered off node1 (where all the resources are running) so that all the resources migrate to node2. when we powered on node1 resources starts to failback during that time, failback operation was failed for few resources due to evms engine lock problem

Error message:
ncs-node1:~/swift/log # vi /var/log/messages
Mar 16 15:43:45 ncs-node1 kernel: JBD: barrier-based sync failed on dm-41 - disabling barriers
Mar 16 15:43:51 ncs-node1 kernel: JBD: barrier-based sync failed on dm-43 - disabling barriers
Mar 16 15:44:07 ncs-node1 kernel: JBD: barrier-based sync failed on dm-45 - disabling barriers
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: CRM: Wed Mar 16 15:43:43 2011
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: ++ NCSVAR_IP_ADDR=/etc/ha.d/resource.d/IPaddr2
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: ++ NCSVAR_FILE_SYSTEM=/etc/ha.d/resource.d/Filesystem
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: ++ NCSVAR_OCF_DIR=/usr/lib/ocf/resource.d/heartbeat
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: ++ PATH=/bin:/usr/bin:/sbin:/usr/sbin:/opt/novell/afptcpd/bin/:/opt/novell/bin
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: + RESOURCE_IP=192.168.80.162
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: + MOUNT_FS=ext3
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: + container_name=con12
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: + MOUNT_DEV=/dev/evms/con12/mpath-m
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: + MOUNT_POINT=/mnt/mpath-m
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: + exit_on_error activate_evms_container con12 /dev/evms/con12/mpath-m 360
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: + eval activate_evms_container con12 /dev/evms/con12/mpath-m 360
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: ++ activate_evms_container con12 /dev/evms/con12/mpath-m 360
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: ++ '[' -z 360 ']'
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: ++ let 'delay=(360-6)/6'
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: ++ '[' 59 -lt 10 ']'
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: ++ '[' 50 -lt 59 ']'
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: ++ let delay=50
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: ++ let 'retry=(360-50)/50/2'
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: ++ '[' 3 -lt 3 ']'
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: ++ '[' '!' -b /dev/evms/con12/mpath-m ']'
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: ++ (( a=0 ))
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: ++ (( a < 3 ))
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: ++ '[' 0 -ne 0 ']'
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: ++ cluster view
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: ++ grep 'master node'
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: This node ncs-node1 [ epoch 3 master node ncs-node2 ]
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: +++ runlevel
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: +++ sed 's/^. //'
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: ++ '[' 6 == 5 ']'
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: ++ /opt/novell/ncs/bin/ch_csm_attr -a -v con12
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: Container name=con12, timeout=0, retry=3, activate=1.
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: fd = 3.
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: echo -e "modify:\"con12\",type=private,node=\"$HOSTNAM E\"
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: save
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: exit" | evms -b.
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load:
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load:
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: EVMS Command Line Interpreter Version 2.5.5
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load:
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: Engine: The EVMS Engine is currently in use by process 19030 (/sbin/evmsd_worker).
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: The process has locked the Engine on behalf of node ncs-node2.
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load:
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: Unable to open the EVMS Engine. Engine returns code 13.
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: Permission denied
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: echo -e "modify:\"con12\",type=private,node=\"$HOSTNAM E\"
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: save
Mar 16 15:45:25 ncs-node1 ncs-resourced: fs12.load: exit" | evms -b.



Kindly help us in this problem

Regards,
Shanthakumar K