VxVM vxvol ERROR V-5-1-10128 Disk group version doesn't support feature; see the vxdg upgrade command

Issue

vxprint shows all plexes are ENABLED ACTIVE state but volume is in DETACHED DETACH state

root@host1 # vxprint -htqg vvrpridg vol03
v  vol03        myrvg        DETACHED DETACH   892928   SELECT    -        fsgen
pl vol03-01     vol03        ENABLED  ACTIVE   892928   CONCAT    -        RW
sd vvrdg04-01   vol03-01     vvrdg04  32       892928   0         sdc3tC0d12s3 ENA
pl vol03-02     vol03        ENABLED  ACTIVE   LOGONLY  CONCAT    -        RW
sd vvrdg01-05   vol03-02     vvrdg01  894048   32       LOG       sdc3tC0d13s3 ENA
pl vol03-03     vol03        ENABLED  ACTIVE   LOGONLY  CONCAT    -        RW
sd vvrdg04-02   vol03-03     vvrdg04  0        32       LOG       sdc3tC0d12s3 ENA

Error

But volume startup will fail with following error

#vxvol -g vvrpridg -f start vol03
VxVM vxvol ERROR V-5-1-10128  Disk group version doesn't support feature; see the vxdg upgrade command

Environment

Solaris/AIX/Linux/HP-UX

Solution

Following example shows how to resolve this issue
Setup details
host1 - VVR primary site
host2 - VVR secondary site
Diskgroup on primary site - vvrpridg
diskgroup on secondary site - vvrsecdg
RVG name - myrvg
VOlume in question - vol03

1. Create new volume on primary site

root@host1 # vxassist -g vvrpridg make vol03  logtype=dcm

root@host1 # vxassist -g vvrpridg make vol03 892928 logtype=dcm

root@host1 # mkfs -F vxfs /dev/vx/rdsk/vvrpridg/vol03
    version 7 layout
    892928 sectors, 446464 blocks of size 1024, log size 1024 blocks
    largefiles supported

root@host1 # mkdir /vol03
root@host1 # mount -F vxfs /dev/vx/dsk/vvrpridg/vol03 /vol03
root@host1 # cp /etc/passwd /vol03/

2. Add same volume on secondary

root@host2 #vxassist -g vvrsecdg make vol03 892928 logtype=dcm

3. For existing volume skip step number 1 and 2

root@host1 # vxprint -htqg vvrpridg vol03
v  vol03        myrvg        DETACHED DETACH   892928   SELECT    -        fsgen
pl vol03-01     vol03        ENABLED  ACTIVE   892928   CONCAT    -        RW
sd vvrdg04-01   vol03-01     vvrdg04  32       892928   0         sdc3tC0d12s3 ENA
pl vol03-02     vol03        ENABLED  ACTIVE   LOGONLY  CONCAT    -        RW
sd vvrdg01-05   vol03-02     vvrdg01  894048   32       LOG       sdc3tC0d13s3 ENA
pl vol03-03     vol03        ENABLED  ACTIVE   LOGONLY  CONCAT    -        RW
sd vvrdg04-02   vol03-03     vvrdg04  0        32       LOG       sdc3tC0d12s3 ENA

Error message during Volume startup

#vxvol -g vvrpridg -f start vol03
VxVM vxvol ERROR V-5-1-10128  Disk group version doesn't support feature; see the vxdg upgrade command

4. Remove volume from RVG

#vxvol -g vvrpridg -f dis vol03

6. For existing first volume start volume, collect metasave, run fsck and mount it to verify data. If required restore in from tape backup
7. Un-mount file system

root@host1 # umount /vol03

8. Perform full sync

root@host1 # vradmin -g vvrpridg  -s -full syncvol vol03 host2:vvrsecdg:vol03
Message from Primary:

VxVM VVR vxrsync INFO V-5-52-2232 Starting full volume synchronization to remote

VxVM VVR vxrsync INFO V-5-52-2211    Source host:         10.251.58.93
VxVM VVR vxrsync INFO V-5-52-2212    Destination host(s): 10.251.58.94
VxVM VVR vxrsync INFO V-5-52-2213    Total volumes:       1
VxVM VVR vxrsync INFO V-5-52-2214    Total size:          436.000 M

Eps_time Dest_host       Src_vol     Dest_vol     F'shed/Tot_sz  Diff  Done
00:00:00 10.251.58.94    vol03       vol03            0M/436M      --    0%
00:00:10 10.251.58.94    vol03       vol03          112M/436M      --   26%
Message from Primary:
00:00:20 10.251.58.94    vol03       vol03          226M/436M      --   52%
Message from Primary:
00:00:30 10.251.58.94    vol03       vol03          346M/436M      --   79%
Message from Primary:
00:00:37 10.251.58.94    vol03       vol03          436M/436M      --  100%
VxVM VVR vxrsync INFO V-5-52-2219 VxRSync operation completed.
VxVM VVR vxrsync INFO V-5-52-2220 Total elapsed time: 0:00:37

9. After resync completed associate new/old volume to RVG

root@host1 # vxvol -g vvrpridg assoc myrvg vol03

root@host1 # vxprint -htqg vvrpridg vol03
v  vol03        myrvg        ENABLED  ACTIVE   892928   SELECT    -        fsgen
pl vol03-01     vol03        ENABLED  ACTIVE   892928   CONCAT    -        RW
sd vvrdg04-01   vol03-01     vvrdg04  32       892928   0         sdc3tC0d12s3 ENA
pl vol03-02     vol03        ENABLED  ACTIVE   LOGONLY  CONCAT    -        RW
sd vvrdg01-05   vol03-02     vvrdg01  894048   32       LOG       sdc3tC0d13s3 ENA
pl vol03-03     vol03        ENABLED  ACTIVE   LOGONLY  CONCAT    -        RW
sd vvrdg04-02   vol03-03     vvrdg04  0        32       LOG       sdc3tC0d12s3 ENA

10. Mount volume on primary and verify data

root@host1 # mount -F vxfs /dev/vx/dsk/vvrpridg/vol03 /vol03
root@host1 # ls -l /vol03
total 2
drwxr-xr-x   2 root     root          96 Nov 14 11:16 lost+found
-rw-r--r--   1 root     root         712 Nov 14 11:17 passwd

11. Temporary mount volume as read only on secondary site to verify data

root@host2 # mount -F vxfs -o ro /dev/vx/dsk/vvrsecdg/vol03 /vol03
root@host2 # ls -l /vol03
total 2
drwxr-xr-x   2 root     root          96 Nov 14 11:16 lost+found
-rw-r--r--   1 root     root         712 Nov 14 11:17 passwd

12. Un-mount volume on secondary

root@host2 # umount /vol03