Problem installing Migration Tool in test environment
Results 1 to 4 of 4

Thread: Problem installing Migration Tool in test environment

  1. #1
    Active Member
    Join Date
    Aug 2014
    Posts
    5

    Problem installing Migration Tool in test environment

    The problem I'm having may be due to attempting to install the Migration Tool into a Zimbra 7 system that is in the process of a "rolling upgrade" (mostly) as per Rolling Upgrades for ZCS - Zimbra :: Wiki . The installation on the 2nd and third server are taking a very LONG time, to the point where I had thought the installation was just completely hung.

    In a nutshell, our production system is currently running on 4 HP servers (not virtualized), running ZCS 7.2.2NE on SLES 11. The servers are 1 x ldap, 2 x mta, 1 x mailbox. This migration upgrade will eventually have Zimbra running v8.0.7NE on 3 virtualized Ubuntu 12.04.4LTS servers (2 x ldap/mta/mailbox, & 1 proxy). The following steps were attempted on a test system mirroring our production system, the only differences being the test system is completely virtual (though ZCS7 is running on SLES), and only a single Zimbra 7 mta.

    The Zimbra 7 master was upgraded to Zimbra 8, then the first multi-role Zimbra 8 server installed into the system. The ldap running on the Zimbra 8 multi-role server was designated as ldap master, and the Zimbra 7 ldap server removed from the system and decomissioned. The Zimbra 8 stand-alone proxy server was installed into the Zimbra system, then the 2nd multi-role Zimbra 8 server was installed as well, the ldap set as a replica.

    At this point, I began attempting to move users from the Zimbra 7 mailbox server to the new ZImbra 8 mailboxes, but on about 80% of the attempts, zmmailboxmove failed (zmmboxmove isn't supported with Zimbra 7 as the source), Zimbra "premium" support is VERY SLOW in responding, and searching for a solution was how I found the ZeXtras Migration Tool.

    At this time, I'm trying to install the migration tool into this "hybrid" test system, which consists of the Zimbra 7 mailbox server, Zimbra 7 mta, Zimbra 8 proxy, and 2 Zimbra 8 ldap/mta/mailbox servers.

    The first attempt was to just install the migration tool on the Zimbra 7 mailbox server, which resulted in what appeared to be errors in the Zimbra 7 admin console, as there were 2 "server icons" in red, labeled with the names of the Zimbra 8 servers where the migration tool wasn't installed.

    My next attempt was to install the migration tool on all 3 mailbox servers, one at a time. The migration tool installed without any problems on the Zimbra 7 server. However, the installation hangs during the installation on the second server (the Zimbra 8 multi-role server with the ldap master). Install.sh discovered the multiple mailbox servers, and it reported "Detected ZeXtras Migration Tool Zimlet version 1.8.17" that was installed when install.sh was run on the first server.

    However, it's been sitting at the following for about the last 20 minutes (I've deleted some blank lines from below):
    ________________________________________
    Beginning Core installation procedure ...

    **************************** Note ****************************
    In addition to the ZeXtras Migration Tool Zimlet a command line tool
    is also available, "zxmig" .
    Run it as the zimbra user in order to see the available options.

    ************************************************** **************
    Press ENTER to continue ...

    ************************ WARNING: ************************

    ZeXtras Migration Tool needs to bind on TCP port 8735 in order to operate,
    for inter-instance communication.
    Please verify no other service listens on that port and that
    it is properly filtered from public access by your firewall.

    ************************************************** **********

    ZeXtras Migration Tool Core will now be installed. Proceed? [Y] y

    The Zimbra Web Application must be restarted
    in order to perform the installation.

    Do you wish to stop the Zimbra Web Application (mailboxd)? [Y] y

    Stopping mailboxd...done.
    ZeXtras Core installation successfully completed.

    * Be warned that ZeXtras Migration Tool needs for the
    * related zimlet to be installed in order to operate.
    __________________________________________________ _

    While doing something else, the second server did eventually prompt me to continue, but as I mentioned, I've been waiting (now) more than 25 minutes. I did find a MONSTER command line in ps when searching for "zex:

    root@zim8server2:~# ps -ef | grep -i zex | grep -v grep
    root 28759 10979 4 14:49 pts/0 00:00:24 sed -i s# | <a target="_new" href="http://www.zextras.com">Enhanced by ZeXtras</a> |## /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_ar.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_da.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_de.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_en_AU.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_en_GB.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_en.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_es.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_fr.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_hi.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_hu.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_it.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_ja.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_ko.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_ms.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_nl.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_pl.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_pt_BR.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_pt.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_ro.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_ru.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_sv.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_th.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_tr.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_uk.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_zh_CN.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_zh_HK.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxMsg_zh_TW.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxTemplateMsg_ar.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/AjxTemplateMsg_ja.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/I18nMsg_ar.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/I18nMsg_da.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/I18nMsg_de.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/I18nMsg_en_AU.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/I18nMsg_en_GB.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/I18nMsg_es.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/I18nMsg_fr.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/I18nMsg_hi.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/I18nMsg_hu.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/I18nMsg_it.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/I18nMsg_ja.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/I18nMsg_ko.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/I18nMsg_ms.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/I18nMsg_nl.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/I18nMsg_pl.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/I18nMsg.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/I18nMsg_pt_BR.properties /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/I18nMsg_pt.properties /opt/zimbra/mailbo
    root@zim8server2:~#

    According to the mailbox.log, the installation waited about 30 minutes until started up again...


    Zimlet installation failed. Exiting.
    .......
    The zimlet installation has failed. That might be due to an incomplete startup
    of the Zimbra webapp. Please verify Zimbra is up and running, then retry
    the deployment of the zimlet with ./install.sh zimlet .
    .......
    root@zim8server2:~/zextras_migration_tool-1.8.17#


    I will make sure that Zimbra is fully functional, then retry installing the zimlet again as the error message suggested.

    Thanks!

    Mark
    Last edited by mhlevy; 08-13-2014 at 09:32 PM.

  2. #2
    CTO ZeXtras Employee d0s0n's Avatar
    Join Date
    Apr 2011
    Posts
    570
    Hi Mark,

    honestly we never tested our tool in a hybrid enviroment but I cannot immagine why zextras could cause a slowdown to mailboxd's reload, so we need to analyze you logs (expecially zimbra.log, mailbox.log and zmmailbox.out) during the installation.


    Don't worry about your "ps" output, it's due to our installCredits procedure of Zextras installer, that cannot be a problem bacause it's very very simple script:
    Code:
    installCredits() {
     sed -i 's#^\(^\([[:blank:]]*[[:alpha:]]\{1,\}lientLoginNotice.*\)\?[[:blank:]]\{1,\}<a target="_new" href="http://www.zimbra.com/forums">[^[:blank:]]\{1,\}</a>[[:blank:]]*\)$#\1 | <a target="_new" href="http://www.zextras.com">Enhanced by ZeXtras</a> |#' /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/* &>/dev/null
    }
    Maybe your test enviroment has some bottleneck or dns timeout issue that cause a slowdown, have you tried to restart your mailboxd service on these server before?

    In any case, you don't need to install zextras zimlet to use the tool, the 'zxmig' command will suffice (as well as you can install zextras suite or mig only on zimbra7 servers).

    PS: I suggest you to use zxbackup because it has many more options and it is free for 30 days.

    D0s0n
    ZeXtras Website # ZeXtras Wiki # ZeXtras Store

    Head of ZeXtras System Administrators

  3. #3
    Active Member
    Join Date
    Aug 2014
    Posts
    5

    Sorry, just a few more questions

    Thank you very much for the response, and the advice. I will try ZxBackup. Thank goodness for the snapshot feature of a virtual environment!

    I did look over the document on incremental migrations and I'm quite excited about it, though I do have a few questions. Our current system has a single mailbox server, and we're moving to a 2 mailbox server environment, and will be using a Zimbra proxy to "hide" the new 2 server architecture from our users. Will that cause any problems, or should we not install the proxy until after the migration has completed?

    How should the target Zimbra system be set up? Do we provision it using the same domain names, but as a separate Zimbra system, or should we go with the "hybird" model, starting with the Zimbra 7 system, upgrading the Zimbra 7 ldap master to Zimbra 8, then installing the Zimbra 8 mailbox servers, then use the ZxBackup to move the mailboxes to the new servers? I guess I'm confused here, because I haven't read anything about the initial configuration of the target Zimbra system, other than needing to have the ZxBackup installed, so I suppose there must be something I'm just missing.

    We've got a fairly complex system, where our mailbox servers host 10 active email domains, nearly 1500 users, and about 600GB in our message store. Thankfully, we do host our own dns, so we've got some flexibility there.

    Again, thanks very much for your response and your advice.

    Mark



    Quote Originally Posted by d0s0n View Post
    Hi Mark,

    honestly we never tested our tool in a hybrid enviroment but I cannot immagine why zextras could cause a slowdown to mailboxd's reload, so we need to analyze you logs (expecially zimbra.log, mailbox.log and zmmailbox.out) during the installation.


    Don't worry about your "ps" output, it's due to our installCredits procedure of Zextras installer, that cannot be a problem bacause it's very very simple script:
    Code:
    installCredits() {
     sed -i 's#^\(^\([[:blank:]]*[[:alpha:]]\{1,\}lientLoginNotice.*\)\?[[:blank:]]\{1,\}<a target="_new" href="http://www.zimbra.com/forums">[^[:blank:]]\{1,\}</a>[[:blank:]]*\)$#\1 | <a target="_new" href="http://www.zextras.com">Enhanced by ZeXtras</a> |#' /opt/zimbra/mailboxd/webapps/zimbra/WEB-INF/classes/messages/* &>/dev/null
    }
    Maybe your test enviroment has some bottleneck or dns timeout issue that cause a slowdown, have you tried to restart your mailboxd service on these server before?

    In any case, you don't need to install zextras zimlet to use the tool, the 'zxmig' command will suffice (as well as you can install zextras suite or mig only on zimbra7 servers).

    PS: I suggest you to use zxbackup because it has many more options and it is free for 30 days.

    D0s0n

  4. #4
    CTO ZeXtras Employee d0s0n's Avatar
    Join Date
    Apr 2011
    Posts
    570
    Hi Mark!

    Quote Originally Posted by mhlevy View Post
    Our current system has a single mailbox server, and we're moving to a 2 mailbox server environment, and will be using a Zimbra proxy to "hide" the new 2 server architecture from our users. Will that cause any problems, or should we not install the proxy until after the migration has completed?

    You can use the Zimbra proxy without any problem any time, there's no implication for zextras on it.

    Quote Originally Posted by mhlevy View Post
    How should the target Zimbra system be set up?
    Zextras suite doesn't move any server configuration so you have to configure as you prefer the new target server (even with different os, architecture or hostname).

    Quote Originally Posted by mhlevy View Post
    Do we provision it using the same domain names, but as a separate Zimbra system, or should we go with the "hybird" model, starting with the Zimbra 7 system, upgrading the Zimbra 7 ldap master to Zimbra 8, then installing the Zimbra 8 mailbox servers, then use the ZxBackup to move the mailboxes to the new servers? I guess I'm confused here, because I haven't read anything about the initial configuration of the target Zimbra system, other than needing to have the ZxBackup installed, so I suppose there must be something I'm just missing.
    The way you described is what the zimbra support will suggest you when they'll reply to your support ticket (and off course they having you to remove the zetxras suite) while our way is a mainly based on a totally new infrastructure to set up in which you'll import the data from the old infrastructure using the Zextras Suite (Zxbackup module).

    D0s0n
    ZeXtras Website # ZeXtras Wiki # ZeXtras Store

    Head of ZeXtras System Administrators

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •