Migration from zimbra 7.x 32bit to zimbra 8 64bit over NFS slow migration
Results 1 to 2 of 2

Thread: Migration from zimbra 7.x 32bit to zimbra 8 64bit over NFS slow migration

  1. #1
    Active Member
    Join Date
    Feb 2014
    Posts
    5

    Migration from zimbra 7.x 32bit to zimbra 8 64bit over NFS slow migration

    Hi,
    I have a server running Centos 5 and Zimbra 7, this is the original zimbra with 63 users and 18GB datastore. the new server has Centos 6 and latest zimbra in 64 bit.
    I did a zxmig and the resulting backup was exported via NFS from old server to new server. They share the same physical gigiabit switch.
    On the new server I followed the procedure to import the backup, and the backup is running fine. Fine but slow (or so I think).
    I am importing 18GB of data over NFS in a gigabit link for 63 users and its been 22 hours and the migration is still running.
    Code:
    [zimbra@correo ~]$ zxsuite core getNotification
    
    | ID                                   | DATE       | SUBJECT
    | 492564f8-e1bb-4dde-9f36-dba06c0f83e1 | 21/02/2014 | ZeXtras ZxBackup Notification, Full Scan started.
    | 877dd91d-4d08-4070-a1cd-f76839f054d6 | 21/02/2014 | ZeXtras ZxBackup Notification, Full Scan completed.
    | 9e0cbcc9-9057-4cbc-8c08-75e77c960dd6 | 21/02/2014 | ZeXtras ZxBackup Notification, Smart Scan started.
    | 2deaafe6-d9c8-4e0a-b6f7-49aec358f5d2 | 21/02/2014 | ZeXtras ZxBackup Notification, Smart Scan completed.
    | c3b8b6a2-2c44-4689-8a88-b58ad90249a0 | 22/02/2014 | ZeXtras ZxBackup Notification, External Restore started.
    | 0da91384-c71e-43ee-86a2-8b85ca1b888a | 22/02/2014 | ZeXtras ZxBackup Notification, External Restore running.
    Code:
    [zimbra@correo ~]$ zxsuite core getNotification id 0da91384-c71e-43ee-86a2-8b85ca1b888a
    
    Subject: ZeXtras ZxBackup Notification, External Restore running.
    Date: 22/02/2014 01:21:02
    Operation id: b30e0e94-d4c9-4841-8f27-a106a15c0a20
    Group: BACKUP
    Level: Information
    Ack: false
    Server: correo.binal.ac.pa
    Notification id: 0da91384-c71e-43ee-86a2-8b85ca1b888a
    Text:
    This is an automated notification from ZxBackup about External Restore.
    
    Operation External Restore is still running. Phase 2 (Item Restore) started.
    
    Operation Id: b30e0e94-d4c9-4841-8f27-a106a15c0a20
    Operation Host: correo.binal.ac.pa
    Operation Log path: /opt/zimbra/log/zextras_ZxBackup_ExternalRestore_b30e0e94-d4c9-4841-8f27-a106a15c0a20.log
    
    Operation requested by: admin@binal.ac.pa
    
    ZeXtras Version: 1.8.12
    ZeXtras commit: d9c37ee146f9127226615a9272e1b60088cb8a35
    Zimbra version: 8.0.6_GA_5922 20131203103705 20131203-1040 FOSS
    
    
    Warning: the following admin accounts have been restored: , admin@binal.ac.pa 
    
    Warnings: 0
    Errors: 0
    
    From now on you can receive emails and use accounts, expect slowdowns (items will be added while the user is using his account).
    
    - ignored ldap attributes -
    zimbraDomainType, uid, mail, zimbraId, zimbraCreateTimestamp, zimbraDomainName, zimbraLastLogonTimestamp, zimbraMailAlias
    
    
    [zimbra@correo ~]$
    Her is an extract of the zextras logs
    Code:
    [root@correo ~]# tail /opt/zimbra/log/zextras_ZxBackup_ExternalRestore_b30e0e94-d4c9-4841-8f27-a106a15c0a20.log
    2014-02-22 23:21:40,208 INFO Adding item 11676 => 2659
    2014-02-22 23:21:40,219 DEBUG Restoring item 19262
    2014-02-22 23:21:40,636 INFO Adding item 19262 => 2660
    2014-02-22 23:21:40,649 DEBUG Restoring item 4095
    2014-02-22 23:21:41,13 INFO Adding item 4095 => 2661
    2014-02-22 23:21:41,24 DEBUG Restoring item 19202
    2014-02-22 23:21:41,248 INFO Adding item 19202 => 2662
    2014-02-22 23:21:41,250 DEBUG Restoring item 26976
    2014-02-22 23:21:41,585 INFO Adding item 26976 => 2663
    2014-02-22 23:21:41,595 DEBUG Restoring item 112418
    [root@correo ~]#
    And an extract of zimbra log.
    Code:
    [root@correo ~]# tail /opt/zimbra/log/mailbox.log -f
    2014-02-22 23:22:17,524 INFO  [ZxBackup Thread] [] mailop - Adding Message: id=2730, Message-ID=<BANLkTin6pSP8TYa8T2qsYrpEKdPW=xssyQ@mail.gmail.com>, parentId=-1, folderId=2, folderName=Inbox.
    2014-02-22 23:22:17,676 INFO  [ZxBackup Thread] [] extensions - Adding item 27103 => 2730
    2014-02-22 23:22:17,890 INFO  [ZxBackup Thread] [] mailop - Adding Message: id=2731, Message-ID=<4DF86B01.50206@gmx.net>, parentId=-1, folderId=2, folderName=Inbox.
    2014-02-22 23:22:18,054 INFO  [ZxBackup Thread] [] extensions - Adding item 27088 => 2731
    2014-02-22 23:22:18,058 INFO  [ZxBackup Thread] [] mailop - adding contact emiliobernales@live.com: id=2732, folderId=13, folderName=Emailed Contacts.
    2014-02-22 23:22:18,211 INFO  [ZxBackup Thread] [] extensions - Adding item 49717 => 2732
    2014-02-22 23:22:18,467 INFO  [ZxBackup Thread] [] mailop - Adding Message: id=2733, Message-ID=<7f8eab36-e49a-4e7a-aae0-17a9c14b82ed@correo.binal.ac.pa>, parentId=-1, folderId=5, folderName=Sent.
    2014-02-22 23:22:18,643 INFO  [ZxBackup Thread] [] extensions - Adding item 49716 => 2733
    2014-02-22 23:22:23,276 INFO  [ZxBackup Thread] [] mailop - Adding Message: id=2734, Message-ID=<a703caf6-5345-47e2-9303-d30555cf42b8@correo.binal.ac.pa>, parentId=-1, folderId=2, folderName=Inbox.
    2014-02-22 23:22:24,192 INFO  [ZxBackup Thread] [] extensions - Adding item 81452 => 2734
    2014-02-22 23:22:29,390 INFO  [ZxBackup Thread] [] mailop - Adding Message: id=2735, Message-ID=<e61acffa-1aa4-4e3e-84d8-3f40163f61f7@correo.binal.ac.pa>, parentId=-1, folderId=2, folderName=Inbox.
    2014-02-22 23:22:30,374 INFO  [ZxBackup Thread] [] extensions - Adding item 81453 => 2735
    2014-02-22 23:22:30,896 INFO  [ZxBackup Thread] [] mailop - Adding Message: id=2737, Message-ID=<8CBD312A91ED5E4C97EBC9E713AC01EA95FE0037C5@SI-MSEV01.US.SINET.SI.EDU>, parentId=-1, folderId=2, folderName=Inbox.
    2014-02-22 23:22:31,163 INFO  [ZxBackup Thread] [] extensions - Adding item 27117 => 2737
    2014-02-22 23:22:32,092 INFO  [ZxBackup Thread] [] mailop - Adding Message: id=2738, Message-ID=<B21B6AE3C55E48428D40F57026364E49@USUARIOPC>, parentId=-1, folderId=2, folderName=Inbox.
    2014-02-22 23:22:32,319 INFO  [ZxBackup Thread] [] extensions - Adding item 97003 => 2738
    2014-02-22 23:22:33,172 INFO  [ZxBackup Thread] [] mailop - Adding Message: id=2739, Message-ID=<8CBD312A91ED5E4C97EBC9E713AC01EA98D456BAF9@SI-MSEV01.US.SINET.SI.EDU>, parentId=-1, folderId=2, folderName=Inbox.
    2014-02-22 23:22:33,373 INFO  [ZxBackup Thread] [] extensions - Adding item 57441 => 2739
    2014-02-22 23:22:34,609 INFO  [MailboxPurge] [name=jbarahona@binal.ac.pa;mid=24;] purge - Purging messages.
    ^C
    I just wanted to know if its ok that is running this long for a 18GB datastore.

    Also, how can I check the "where" in percent the process is? (im thinking something like....restoring xx% of 100%)
    Or some other idea of where the process is at restoring?

    Thanks,

  2. #2
    ZeXtras Community Manager ZeXtras Employee Cine's Avatar
    Join Date
    Apr 2011
    Posts
    2,360
    Hello eaperezh,
    welcome to the forums!

    Import duration depends highly on your storage's I/O throughtput and performances, so I'd sugest to check the following:

    - Operation Status with `zxsuite backup getAllOperations` (an unwanted mailboxd restart might have interrupted the import).
    - I/O load with `iostat -xm 1` (let it run for some seconds and feel free to post the output here).
    - Network Load with `nload` (check this on both the Zimbra server and the NFS host, as the bottleneck is more likely to be on the latter).

    If the operation has been interrupted by a mailboxd restart, don't worry: running the operation again with the same options/parameters will skip any item that has already been imported...

    In order to check the progress of an operation, you can always use the following command:

    Code:
    zxsuite backup monitor {operationID}
    Have a nice day,
    Cine
    the ZeXtras Team
    Last edited by Cine; 02-24-2014 at 02:21 PM.

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •