migrating 900 mailboxes and store of 100 GB
Results 1 to 9 of 9

Thread: migrating 900 mailboxes and store of 100 GB

  1. #1
    Active Member
    Join Date
    Aug 2012
    Posts
    6

    migrating 900 mailboxes and store of 100 GB

    Hi,

    I am working on migrating ZCS 7.1 32-bit to 7.2 64-bit. I has been a nightmare. After 7 hours, the mail boxes that got exported were just 380 and of 17 GB. Can I know if there is any other process or way to speed this up. I only have 4 hours of downtime to do this in production.

  2. #2
    ZeXtras Community Manager ZeXtras Employee Cine's Avatar
    Join Date
    Apr 2011
    Posts
    2,342
    Hello Rajesh,

    17GB in 7 hours is a really low export rate, can you please answer the following questions so that we'll be able to identify the issue?

    - What version of ZeXtras Migration Tool/ZeXtras Suite are you running?
    - What migration method are you using (Export with ZxMig and Import with ZxBackup or both Export and Import with ZxBackup)?
    - What kind of storage are you migrating your data on (SATA/Network Share/SAS/Fibre)?
    - What are the specs of the source server (ram, cpu, storage, OS)?
    - Is the Source server a Virtual Server or a physical one?

    Also, please note that neither the Export nor the Import require the system to be off, you can easily migrate your data with your Zimbra on. To reduce any downtime to the minimum (possibly to zero), please see the following guide: ZxBackup: Incremental migration with ZeXtras Backup - ZeXtras Suite Wiki


    Have a nice day,
    Cine
    IT Support Team Contact Form
    Sales Team Contact Form

    ZeXtras Website
    # ZeXtras Wiki # ZeXtras Store

    Have ZeXtras Suite or ZeXtras Migration Tool been helpful to you?
    Share your experience in the Zimbra Gallery!

    ZeXtras Suite on the Zimbra Gallery
    ZeXtras Migration Tool on the Zimbra Gallery

  3. #3
    Active Member
    Join Date
    Aug 2012
    Posts
    6
    - What version of ZeXtras Migration Tool/ZeXtras Suite are you running?

    The latest version downloaded yesterday

    - What migration method are you using (Export with ZxMig and Import with ZxBackup or both Export and Import with ZxBackup)?
    Export with ZxMig
    - What kind of storage are you migrating your data on (SATA/Network Share/SAS/Fibre)?
    SCSI Disk
    - What are the specs of the source server (ram, cpu, storage, OS)?

    8 GB, Quad core, 500 GB RAID, RHEL 4 i386
    - Is the Source server a Virtual Server or a physical one?

  4. #4
    ZeXtras Community Manager ZeXtras Employee Cine's Avatar
    Join Date
    Apr 2011
    Posts
    2,342
    Hello Rajesh,
    thank you for your answers.

    Another question: What's the exact configuration of your RAID array (raid type, controller type and type of the attached disks)?
    IT Support Team Contact Form
    Sales Team Contact Form

    ZeXtras Website
    # ZeXtras Wiki # ZeXtras Store

    Have ZeXtras Suite or ZeXtras Migration Tool been helpful to you?
    Share your experience in the Zimbra Gallery!

    ZeXtras Suite on the Zimbra Gallery
    ZeXtras Migration Tool on the Zimbra Gallery

  5. #5
    Active Member
    Join Date
    Aug 2012
    Posts
    6
    Raid Type - RAID 5
    Controller type -PERC Attached disks -SCSI

  6. #6
    ZeXtras Community Manager ZeXtras Employee Cine's Avatar
    Join Date
    Apr 2011
    Posts
    2,342
    Hmmm... I/O throughtput seems to be the issue here...

    I'd need to understand better your infrastructure in order to help:

    - Can you please run `htop` and see if the system load is high?
    - Can you please run `iostat -xm 1`, let it run for 5-10 seconds and post the full output here? Please also specify the device name for the disk containing the /opt/zimbra/store/ folder and the export folder's one.
    - Is the Raid controller directly attached to the server or is there another transport medium between the server and the disks?
    IT Support Team Contact Form
    Sales Team Contact Form

    ZeXtras Website
    # ZeXtras Wiki # ZeXtras Store

    Have ZeXtras Suite or ZeXtras Migration Tool been helpful to you?
    Share your experience in the Zimbra Gallery!

    ZeXtras Suite on the Zimbra Gallery
    ZeXtras Migration Tool on the Zimbra Gallery

  7. #7
    Active Member
    Join Date
    Aug 2012
    Posts
    6
    Linux 2.6.9-89.0.9.ELsmp (mymail.semanticindia.com) 08/23/2012

    avg-cpu: %user %nice %sys %iowait %idle
    15.40 0.01 3.03 4.02 77.54

    Device: rrqm/s wrqm/s r/s w/s rsec/s wsec/s rkB/s wkB/s avgrq-sz avgqu-sz await svctm %util
    hda 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 77.71 0.00 1096.00 1084.43 0.00
    sda 0.28 74.84 30.33 54.49 108.89 124.34 54.45 62.17 2.75 0.13 1.51 1.95 16.54
    sda1 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 109.49 0.00 22.36 20.57 0.00
    sda2 0.01 14.07 0.23 3.61 7.64 141.50 3.82 70.75 38.77 0.08 21.70 6.48 2.49
    sda3 0.28 60.65 30.09 50.70 100.83 173.59 50.42 86.80 3.40 0.04 0.53 2.00 16.13
    sda4 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 42.40 0.00 11.80 11.80 0.00
    sda5 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 29.20 0.00 2.48 2.21 0.00
    sda6 0.00 0.12 0.01 0.18 0.41 2.41 0.21 1.21 15.09 0.00 11.29 7.92 0.15

    avg-cpu: %user %nice %sys %iowait %idle
    11.50 0.00 7.00 0.25 81.25

    Device: rrqm/s wrqm/s r/s w/s rsec/s wsec/s rkB/s wkB/s avgrq-sz avgqu-sz await svctm %util
    hda 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
    sda 0.00 18.00 2.00 8.00 16.00 208.00 8.00 104.00 22.40 0.01 1.20 1.00 1.00
    sda1 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
    sda2 0.00 0.00 2.00 0.00 16.00 0.00 8.00 0.00 8.00 0.01 4.50 4.50 0.90
    sda3 0.00 18.00 0.00 8.00 0.00 208.00 0.00 104.00 26.00 0.00 0.38 0.12 0.10
    sda4 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
    sda5 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
    sda6 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00

    avg-cpu: %user %nice %sys %iowait %idle
    33.25 0.00 13.50 0.25 53.00

    Device: rrqm/s wrqm/s r/s w/s rsec/s wsec/s rkB/s wkB/s avgrq-sz avgqu-sz await svctm %util
    hda 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
    sda 0.00 106.00 1.00 17.00 8.00 984.00 4.00 492.00 55.11 0.02 1.00 1.00 1.80
    sda1 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
    sda2 0.00 75.00 0.00 7.00 0.00 656.00 0.00 328.00 93.71 0.00 0.14 0.14 0.10
    sda3 0.00 31.00 1.00 10.00 8.00 328.00 4.00 164.00 30.55 0.02 1.55 1.55 1.70
    sda4 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
    sda5 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
    sda6 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00

  8. #8
    Active Member
    Join Date
    Aug 2012
    Posts
    6
    Now Export fails with the following error:

    - exception -
    java.lang.NullPointerException
    at com.zextras.lib.ZEOperationException.(ZEOperationE xception.java:11)
    at com.zextras.lib.ZEBlockingException.(ZEBlockingExc eption.java:9)
    at com.zextras.backup.ZEBItem.synchronize(ZEBItem.jav a:1002)
    at com.zextras.backup.ZEBAccount.synchronize(ZEBAccou nt.java:1313)
    at com.zextras.op.backup.ZEScanOperation.doItemsScan( ZEScanOperation.java:378)
    at com.zextras.op.backup.ZEScanOperation.doAllItemsSc an(ZEScanOperation.java:335)
    at com.zextras.op.backup.ZEScanOperation.doAccountSca n(ZEScanOperation.java:291)
    at com.zextras.op.backup.ZEScanOperation.doDomainScan (ZEScanOperation.java:72)
    at com.zextras.op.backup.ZEScanOperation.doDomainScan (ZEScanOperation.java:63)
    at com.zextras.op.backup.ZEExportOperation.doOperatio n(ZEExportOperation.java:327)
    at com.zextras.op.ZEOperation.exec(ZEOperation.java:5 74)
    at com.zextras.backup.ZEBackupThread.execOperation(ZE BackupThread.java:197)
    at com.zextras.backup.ZEBackupThread.run(ZEBackupThre ad.java:107)

  9. #9
    ZeXtras Community Manager ZeXtras Employee Cine's Avatar
    Join Date
    Apr 2011
    Posts
    2,342
    Hello Rajesh,

    this error is usually caused by a bad package, please re-download an install ZeXtras Migration Tool and make sure that the md5sum of the downloaded package is 64c2b7608dda0fb9287b8437d6c0cb9c


    Have a nice day,
    Cine
    IT Support Team Contact Form
    Sales Team Contact Form

    ZeXtras Website
    # ZeXtras Wiki # ZeXtras Store

    Have ZeXtras Suite or ZeXtras Migration Tool been helpful to you?
    Share your experience in the Zimbra Gallery!

    ZeXtras Suite on the Zimbra Gallery
    ZeXtras Migration Tool on the Zimbra Gallery

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •