Zextras Migration Tool in multiserver - Page 2
Page 2 of 2 FirstFirst 12
Results 11 to 17 of 17
Like Tree2Likes

Thread: Zextras Migration Tool in multiserver

  1. #11
    ZeXtras Community Manager ZeXtras Employee Cine's Avatar
    Join Date
    Apr 2011
    Posts
    2,342
    Hello SysAdm!

    As D0s_0n previously asked, it would be great to know what kind of storage devices you are using and how those are set up in order to properly help you...
    Also, I'd like to know where the Import Path is stored (local disk, remote disk mounted via sshfs etc...) and the output of the following commands:

    - mount
    - iostat -xm 1 (let it run for 3-4 seconds, stop it and paste the full output here)

    The import should reasonably last a bit more than the FullScan, anything longer is usually caused by poor I/O performances (or network issues if using sshfs)...

    Have a nice day,
    Cine
    the ZeXtras Team
    Last edited by Cine; 10-28-2013 at 10:01 AM.
    IT Support Team Contact Form
    Sales Team Contact Form

    ZeXtras Website
    # ZeXtras Wiki # ZeXtras Store

    Have ZeXtras Suite or ZeXtras Migration Tool been helpful to you?
    Share your experience in the Zimbra Gallery!

    ZeXtras Suite on the Zimbra Gallery
    ZeXtras Migration Tool on the Zimbra Gallery

  2. #12
    Active Member
    Join Date
    Oct 2013
    Posts
    13
    Hi cine,

    when i ran the command "zxsuite backup doExport" i stored it in the path /opt/zimbra of my source server,
    then i transferred this backup via rsync to my destination server with the path /opt/zimbra, so i am using the local disk.

    the outuput of mount command is:

    /dev/mapper/vg_mailbox-LogVol_root on / type ext4 (rw)
    proc on /proc type proc (rw)
    sysfs on /sys type sysfs (rw)
    devpts on /dev/pts type devpts (rw,gid=5,mode=620)
    tmpfs on /dev/shm type tmpfs (rw)
    /dev/sda2 on /boot type ext4 (rw)
    /dev/sda1 on /boot/efi type vfat (rw,umask=0077,shortname=winnt)
    /dev/mapper/vg_mailbox-LogVol_opt on /opt type ext4 (rw)
    none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)
    sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)

    the output of iostat -xm 1 command is:

    avg-cpu: %user %nice %system %iowait %steal %idle
    1.11 0.27 0.20 0.01 0.00 98.42

    Device: rrqm/s wrqm/s r/s w/s rMB/s wMB/s avgrq-sz avgqu-sz await svctm %util
    sda 0.01 18.27 0.06 4.81 0.00 0.10 43.21 0.00 0.84 0.37 0.18
    dm-0 0.00 0.00 0.00 0.00 0.00 0.00 8.00 0.00 0.67 0.57 0.00
    dm-1 0.00 0.00 0.02 2.47 0.00 0.01 8.21 0.00 1.10 0.36 0.09
    dm-2 0.00 0.00 0.05 20.64 0.00 0.09 9.18 0.04 1.83 0.05 0.10

    avg-cpu: %user %nice %system %iowait %steal %idle
    0.00 0.12 0.12 0.00 0.00 99.75

    Device: rrqm/s wrqm/s r/s w/s rMB/s wMB/s avgrq-sz avgqu-sz await svctm %util
    sda 0.00 1.00 0.00 3.00 0.00 0.02 10.67 0.00 0.33 0.33 0.10
    dm-0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
    dm-1 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
    dm-2 0.00 0.00 0.00 4.00 0.00 0.02 8.00 0.00 0.25 0.25 0.10

    avg-cpu: %user %nice %system %iowait %steal %idle
    0.13 0.00 0.00 0.00 0.00 99.87

    Device: rrqm/s wrqm/s r/s w/s rMB/s wMB/s avgrq-sz avgqu-sz await svctm %util
    sda 0.00 0.00 0.00 1.00 0.00 0.00 8.00 0.00 3.00 3.00 0.30
    dm-0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
    dm-1 0.00 0.00 0.00 1.00 0.00 0.00 8.00 0.00 3.00 3.00 0.30
    dm-2 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00

    avg-cpu: %user %nice %system %iowait %steal %idle
    0.00 0.00 0.13 0.00 0.00 99.87

    Device: rrqm/s wrqm/s r/s w/s rMB/s wMB/s avgrq-sz avgqu-sz await svctm %util
    sda 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
    dm-0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
    dm-1 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
    dm-2 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00

    avg-cpu: %user %nice %system %iowait %steal %idle
    0.12 0.00 0.12 0.00 0.00 99.75

    Device: rrqm/s wrqm/s r/s w/s rMB/s wMB/s avgrq-sz avgqu-sz await svctm %util
    sda 0.00 8.00 0.00 6.00 0.00 0.05 18.67 0.00 0.33 0.17 0.10
    dm-0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
    dm-1 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
    dm-2 0.00 0.00 0.00 14.00 0.00 0.05 8.00 0.01 0.57 0.07 0.10

    avg-cpu: %user %nice %system %iowait %steal %idle
    0.12 0.12 0.00 0.00 0.00 99.75

    Device: rrqm/s wrqm/s r/s w/s rMB/s wMB/s avgrq-sz avgqu-sz await svctm %util
    sda 0.00 6.00 0.00 3.00 0.00 0.04 24.00 0.00 0.33 0.33 0.10
    dm-0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
    dm-1 0.00 0.00 0.00 9.00 0.00 0.04 8.00 0.00 0.11 0.11 0.10
    dm-2 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00

    Regards.

  3. #13
    ZeXtras Community Manager ZeXtras Employee Cine's Avatar
    Join Date
    Apr 2011
    Posts
    2,342
    Hello SysAdm!

    I'd like to know a bit more about your storage devices on the destination servers (Which kind of local disks are you using (e.g. SATAII)? How's the LVM configured?.

    Also, did you run the iostat command while the import process was running? Can you see any errors in the /opt/zimbra/log/mailbox.log file? Do you experience slowdowns when transferring files from/to the server (e.g. adding a large attachment to an email or uploading a large file on a briefcase)?

    Have a nice day,
    Cine
    the ZeXtras Team
    IT Support Team Contact Form
    Sales Team Contact Form

    ZeXtras Website
    # ZeXtras Wiki # ZeXtras Store

    Have ZeXtras Suite or ZeXtras Migration Tool been helpful to you?
    Share your experience in the Zimbra Gallery!

    ZeXtras Suite on the Zimbra Gallery
    ZeXtras Migration Tool on the Zimbra Gallery

  4. #14
    Active Member
    Join Date
    Oct 2013
    Posts
    13
    Hi Cine,

    When i ran the previous commands the import process was running, i can see the following errors in the /opt/zimbra/log/mailbox.log file:

    2013-10-28 11:36:20,363 WARN [Index-9] [name=account@domain;mid=84;] mailbox - transaction canceled because of lock failure
    2013-10-28 11:36:20,400 WARN [ZxBackup Thread] [] lmtp - Unable to send intercept message to captchmailall@gmail.com.
    javax.mail.MessagingException: connect timed out;
    nested exception is:
    java.net.SocketTimeoutException: connect timed out
    at com.zimbra.cs.mailclient.smtp.SmtpTransport.protoc olConnect(SmtpTransport.java:185)
    at javax.mail.Service.connect(Service.java:295)
    at javax.mail.Service.connect(Service.java:176)
    at javax.mail.Service.connect(Service.java:125)
    at javax.mail.Transport.send0(Transport.java:194)
    at javax.mail.Transport.send(Transport.java:124)
    at com.zimbra.cs.mailbox.Notification.interceptIfNece ssary(Notification.java:598)
    at com.zimbra.cs.mailbox.Mailbox.addMessageInternal(M ailbox.java:5626)
    at com.zimbra.cs.mailbox.Mailbox.addMessage(Mailbox.j ava:5307)
    at com.zimbra.cs.mailbox.Mailbox.addMessage(Mailbox.j ava:5241)
    at com.zimbra.cs.mailbox.Mailbox.addMessage(Mailbox.j ava:5236)
    at com.zimbra.cs.mailbox.Mailbox.addMessage(Mailbox.j ava:5227)
    at com.zextras.zal.ZEMailbox.addMessage(ZEMailbox.jav a:736)
    at com.zextras.backup.ZEBItem.createZimbraItem(ZEBIte m.java:1599)
    at com.zextras.backup.ZEBItem.restore(ZEBItem.java:65 2)
    at com.zextras.op.backup.ZEExternalRestoreOperation.r estoreItemsFromExternal(ZEExternalRestoreOperation .java:933)
    at com.zextras.op.backup.ZEExternalRestoreOperation.d oOperation(ZEExternalRestoreOperation.java:748)
    at com.zextras.op.ZEOperation.exec(ZEOperation.java:6 52)
    at com.zextras.backup.ZEBackupThread.execOperation(ZE BackupThread.java:225)
    at com.zextras.backup.ZEBackupThread.run(ZEBackupThre ad.java:114)
    Caused by: java.net.SocketTimeoutException: connect timed out
    at java.net.PlainSocketImpl.socketConnect(Native Method)
    at java.net.AbstractPlainSocketImpl.doConnect(Abstrac tPlainSocketImpl.java:339)
    at java.net.AbstractPlainSocketImpl.connectToAddress( AbstractPlainSocketImpl.java:200)
    at java.net.AbstractPlainSocketImpl.connect(AbstractP lainSocketImpl.java:182)
    at java.net.SocksSocketImpl.connect(SocksSocketImpl.j ava:392)
    at java.net.Socket.connect(Socket.java:579)
    at com.zimbra.cs.mailclient.MailConnection.newSocket( MailConnection.java:419)
    at com.zimbra.cs.mailclient.MailConnection.connect(Ma ilConnection.java:74)
    at com.zimbra.cs.mailclient.smtp.SmtpTransport.protoc olConnect(SmtpTransport.java:183)
    ... 19 more


    2013-10-28 11:37:20,429 ERROR [Index-9] [name=account@domain;mid=84;] mailbox - Failed to lock mailbox
    Lock Owner - ZxBackup Thread prio=5 id=57 state=RUNNABLE
    at java.net.PlainSocketImpl.socketConnect(Native Method)
    at java.net.AbstractPlainSocketImpl.doConnect(Abstrac tPlainSocketImpl.java:339)
    at java.net.AbstractPlainSocketImpl.connectToAddress( AbstractPlainSocketImpl.java:200)
    at java.net.AbstractPlainSocketImpl.connect(AbstractP lainSocketImpl.java:182)
    at java.net.SocksSocketImpl.connect(SocksSocketImpl.j ava:392)
    at java.net.Socket.connect(Socket.java:579)
    at com.zimbra.cs.mailclient.MailConnection.newSocket( MailConnection.java:419)
    at com.zimbra.cs.mailclient.MailConnection.connect(Ma ilConnection.java:74)
    at com.zimbra.cs.mailclient.smtp.SmtpTransport.protoc olConnect(SmtpTransport.java:183)
    at javax.mail.Service.connect(Service.java:295)
    at javax.mail.Service.connect(Service.java:176)
    at javax.mail.Service.connect(Service.java:125)
    at javax.mail.Transport.send0(Transport.java:194)
    at javax.mail.Transport.send(Transport.java:124)
    at com.zimbra.cs.mailbox.Notification.interceptIfNece ssary(Notification.java:598)
    at com.zimbra.cs.mailbox.Mailbox.addMessageInternal(M ailbox.java:5626)
    at com.zimbra.cs.mailbox.Mailbox.addMessage(Mailbox.j ava:5307)
    at com.zimbra.cs.mailbox.Mailbox.addMessage(Mailbox.j ava:5241)
    at com.zimbra.cs.mailbox.Mailbox.addMessage(Mailbox.j ava:5236)
    at com.zimbra.cs.mailbox.Mailbox.addMessage(Mailbox.j ava:5227)
    at com.zextras.zal.ZEMailbox.addMessage(ZEMailbox.jav a:736)
    at com.zextras.backup.ZEBItem.createZimbraItem(ZEBIte m.java:1599)
    at com.zextras.backup.ZEBItem.restore(ZEBItem.java:65 2)
    at com.zextras.op.backup.ZEExternalRestoreOperation.r estoreItemsFromExternal(ZEExternalRestoreOperation .java:933)
    at com.zextras.op.backup.ZEExternalRestoreOperation.d oOperation(ZEExternalRestoreOperation.java:748)
    at com.zextras.op.ZEOperation.exec(ZEOperation.java:6 52)
    at com.zextras.backup.ZEBackupThread.execOperation(ZE BackupThread.java:225)
    at com.zextras.backup.ZEBackupThread.run(ZEBackupThre ad.java:114)

    com.zimbra.cs.mailbox.MailboxLock$LockFailedExcept ion: timeout
    at com.zimbra.cs.mailbox.MailboxLock.lock(MailboxLock .java:58)
    at com.zimbra.cs.mailbox.Mailbox.beginTransaction(Mai lbox.java:1489)
    at com.zimbra.cs.mailbox.Mailbox.beginTransaction(Mai lbox.java:1474)
    at com.zimbra.cs.mailbox.MailboxIndex.indexItemList(M ailboxIndex.java:709)
    at com.zimbra.cs.mailbox.MailboxIndex.indexDeferredIt ems(MailboxIndex.java:373)
    at com.zimbra.cs.mailbox.MailboxIndex.access$600(Mail boxIndex.java:83)
    at com.zimbra.cs.mailbox.MailboxIndex$BatchIndexTask. exec(MailboxIndex.java:1404)
    at com.zimbra.cs.mailbox.MailboxIndex$IndexTask.run(M ailboxIndex.java:1383)
    at java.util.concurrent.Executors$RunnableAdapter.cal l(Executors.java:471)
    at java.util.concurrent.FutureTask$Sync.innerRun(Futu reTask.java:334)
    at java.util.concurrent.FutureTask.run(FutureTask.jav a:166)
    at java.util.concurrent.ThreadPoolExecutor.runWorker( ThreadPoolExecutor.java:1145)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:724)


    2013-10-28 11:37:20,430 WARN [Index-9] [name=account@domain;mid=84;] index - Failed to fetch deferred item id=11171
    com.zimbra.cs.mailbox.MailboxLock$LockFailedExcept ion: timeout
    at com.zimbra.cs.mailbox.MailboxLock.lock(MailboxLock .java:58)
    at com.zimbra.cs.mailbox.Mailbox.beginTransaction(Mai lbox.java:1489)
    at com.zimbra.cs.mailbox.Mailbox.beginTransaction(Mai lbox.java:1474)
    at com.zimbra.cs.mailbox.MailboxIndex.indexItemList(M ailboxIndex.java:709)
    at com.zimbra.cs.mailbox.MailboxIndex.indexDeferredIt ems(MailboxIndex.java:373)
    at com.zimbra.cs.mailbox.MailboxIndex.access$600(Mail boxIndex.java:83)
    at com.zimbra.cs.mailbox.MailboxIndex$BatchIndexTask. exec(MailboxIndex.java:1404)
    at com.zimbra.cs.mailbox.MailboxIndex$IndexTask.run(M ailboxIndex.java:1383)
    at java.util.concurrent.Executors$RunnableAdapter.cal l(Executors.java:471)
    at java.util.concurrent.FutureTask$Sync.innerRun(Futu reTask.java:334)
    at java.util.concurrent.FutureTask.run(FutureTask.jav a:166)
    at java.util.concurrent.ThreadPoolExecutor.runWorker( ThreadPoolExecutor.java:1145)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:724)

    I do not experience slowdowns when transferring files from/to the server. The server disk is configured with LVM, this is the df -h command output:

    Filesystem Size Used Avail Use% Mounted on
    /dev/mapper/vg_mailbox-LogVol_root
    30G 2.8G 26G 10% /
    tmpfs 32G 0 32G 0% /dev/shm
    /dev/sda2 194M 58M 126M 32% /boot
    /dev/sda1 1022M 264K 1022M 1% /boot/efi
    /dev/mapper/vg_mailbox-LogVol_opt
    2.3T 38G 2.2T 2% /opt

    The output of fdisk -l :

    Disk /dev/sda: 2577.0 GB, 2576980377600 bytes
    255 heads, 63 sectors/track, 313300 cylinders
    Units = cylinders of 16065 * 512 = 8225280 bytes
    Sector size (logical/physical): 512 bytes / 512 bytes
    I/O size (minimum/optimal): 512 bytes / 512 bytes
    Disk identifier: 0x00000000

    Device Boot Start End Blocks Id System
    /dev/sda1 1 267350 2147483647+ ee GPT

    Disk /dev/mapper/vg_mailbox-LogVol_swap: 8589 MB, 8589934592 bytes
    255 heads, 63 sectors/track, 1044 cylinders
    Units = cylinders of 16065 * 512 = 8225280 bytes
    Sector size (logical/physical): 512 bytes / 512 bytes
    I/O size (minimum/optimal): 512 bytes / 512 bytes
    Disk identifier: 0x00000000


    Disk /dev/mapper/vg_mailbox-LogVol_root: 32.2 GB, 32212254720 bytes
    255 heads, 63 sectors/track, 3916 cylinders
    Units = cylinders of 16065 * 512 = 8225280 bytes
    Sector size (logical/physical): 512 bytes / 512 bytes
    I/O size (minimum/optimal): 512 bytes / 512 bytes
    Disk identifier: 0x00000000


    Disk /dev/mapper/vg_mailbox-LogVol_opt: 2534.8 GB, 2534836011008 bytes
    255 heads, 63 sectors/track, 308176 cylinders
    Units = cylinders of 16065 * 512 = 8225280 bytes
    Sector size (logical/physical): 512 bytes / 512 bytes
    I/O size (minimum/optimal): 512 bytes / 512 bytes
    Disk identifier: 0x00000000

    My server is a DELL PowerEdge R720 with raid 10 array disk, the information about each disk: 1TB 7.2K RPM Near-Line SAS 6Gbps 3.5in Hot-plug Hard Drive.

    The server has 8 cpu Intel(R) Xeon(R) CPU E5-2643 0 @ 3.30GHz and 64 GB RAM.

    Thank for your help Cine. Regards.

  5. #15
    ZeXtras Community Manager ZeXtras Employee Cine's Avatar
    Join Date
    Apr 2011
    Posts
    2,342
    Hello SysAdm!

    It might not be the cause (however, probably it is), but it's at least a huge hindrance: the legal intercept on an external account.
    Each time a new message is imported, the legal intercept kicks in and sends a copy to the address you can see in the log, and this slows down the operation a lot because of a timeout error (2013-10-28 11:36:20,400 WARN [ZxBackup Thread] [] lmtp - Unable to send intercept message to captchmailall@gmail.com.javax.mail.MessagingException: connect timed out;).

    My suggestion would be to turn off the legal intercept on all mailboxes on the source server, run a smartscan, rsync the data, restart the import...

    Have a nice day,
    Cine
    the ZeXtras Team
    Last edited by Cine; 10-29-2013 at 11:07 AM. Reason: Improved suggestion
    SysAdm likes this.
    IT Support Team Contact Form
    Sales Team Contact Form

    ZeXtras Website
    # ZeXtras Wiki # ZeXtras Store

    Have ZeXtras Suite or ZeXtras Migration Tool been helpful to you?
    Share your experience in the Zimbra Gallery!

    ZeXtras Suite on the Zimbra Gallery
    ZeXtras Migration Tool on the Zimbra Gallery

  6. #16
    Active Member
    Join Date
    Oct 2013
    Posts
    13
    Hi Cine,

    Is a pleasure to greet, i have done the migration because i followed your recomendations, in fact the problem was the legal intercept, this slows down on the restore process.

    Thanks to the forums for help.

    Regards.
    d0s0n likes this.

  7. #17
    ZeXtras Community Manager ZeXtras Employee Cine's Avatar
    Join Date
    Apr 2011
    Posts
    2,342
    Quote Originally Posted by SysAdm View Post
    Hi Cine,

    Is a pleasure to greet, i have done the migration because i followed your recomendations, in fact the problem was the legal intercept, this slows down on the restore process.

    Thanks to the forums for help.

    Regards.
    Hello SysAdm,
    this is great news!

    Have a nice day,
    Cine
    IT Support Team Contact Form
    Sales Team Contact Form

    ZeXtras Website
    # ZeXtras Wiki # ZeXtras Store

    Have ZeXtras Suite or ZeXtras Migration Tool been helpful to you?
    Share your experience in the Zimbra Gallery!

    ZeXtras Suite on the Zimbra Gallery
    ZeXtras Migration Tool on the Zimbra Gallery

Page 2 of 2 FirstFirst 12

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •