Cannot create type=wp site after upgrade to 4.0.14


#1

After upgrade from 4.0.12 to 4.0.14, site create command of the form below creates ugly loop, requires SIGKILL:
sudo ee site create example.org --ssl=le --type=wp

Issue seems to be caused by this:
Error: No such object: services_global-db_1

Logs snippet:

[16-05-2019 18:20:16] ee.INFO: ::::::::::::::::::::::::ee invoked::::::::::::::::::::::::
[16-05-2019 18:20:16] ee.DEBUG: -----------------------
[16-05-2019 18:20:16] ee.DEBUG: COMMAND: cd /opt/easyengine/services && docker ps -q --no-trunc | grep $(docker-compose ps -q global-nginx-proxy)
[16-05-2019 18:20:17] ee.DEBUG: STDOUT: b4a4cbec3eafcdd10bfcdfc36cfb7aee1eafee7846206b71e7281f7884c15ec3
[16-05-2019 18:20:17] ee.DEBUG: RETURN CODE: 0
[16-05-2019 18:20:17] ee.DEBUG: -----------------------
[16-05-2019 18:20:17] ee.DEBUG: -----------------------
[16-05-2019 18:20:17] ee.DEBUG: COMMAND: docker ps > /dev/null
[16-05-2019 18:20:17] ee.DEBUG: RETURN CODE: 0
[16-05-2019 18:20:17] ee.DEBUG: -----------------------
[16-05-2019 18:20:17] ee.DEBUG: -----------------------
[16-05-2019 18:20:17] ee.DEBUG: COMMAND: command -v docker-compose > /dev/null
[16-05-2019 18:20:17] ee.DEBUG: RETURN CODE: 0
[16-05-2019 18:20:17] ee.DEBUG: -----------------------
[16-05-2019 18:20:17] ee.DEBUG: Using default global config: /opt/easyengine/config/config.yml
[16-05-2019 18:20:17] ee.DEBUG: No project config found
[16-05-2019 18:20:17] ee.DEBUG: argv: /usr/local/bin/ee site create palmasanimalwelfare.org --ssl=le --type=wp
[16-05-2019 18:20:17] ee.DEBUG: Running command: site
[16-05-2019 18:20:17] ee.DEBUG: Running command: site create
[16-05-2019 18:20:17] ee.INFO: ======================== site create start ========================
[16-05-2019 18:20:17] site_wp_command.DEBUG: args: ["example.org"]
[16-05-2019 18:20:17] site_wp_command.DEBUG: assoc_args: {"ssl":"le","php":"latest","dbcharset":"utf8mb4"}
[16-05-2019 18:20:17] ee.DEBUG: COMMAND: which docker
[16-05-2019 18:20:17] ee.DEBUG: RETURN CODE: 0
[16-05-2019 18:20:17] ee.DEBUG: -----------------------
[16-05-2019 18:20:17] ee.DEBUG: COMMAND: docker inspect -f '{{.State.Running}}' b4a4cbec3eafcdd10bfcdfc36cfb7aee1eafee7846206b71e7281f7884c15ec3
[16-05-2019 18:20:17] ee.DEBUG: STDOUT: true
[16-05-2019 18:20:17] ee.DEBUG: RETURN CODE: 0
[16-05-2019 18:20:17] ee.DEBUG: -----------------------
[16-05-2019 18:20:17] ee.DEBUG: -----------------------
[16-05-2019 18:20:17] ee.DEBUG: COMMAND: docker inspect --format '{{ (index (index .NetworkSettings.Ports "80/tcp") 0).HostPort }}' b4a4cbec3eafcdd10bfcdfc36cfb7aee1eafee7846206b71e7281f7884c15ec3
[16-05-2019 18:20:17] ee.DEBUG: STDOUT: 80
[16-05-2019 18:20:17] ee.DEBUG: RETURN CODE: 0
[16-05-2019 18:20:17] ee.DEBUG: -----------------------
[16-05-2019 18:20:17] ee.DEBUG: -----------------------
[16-05-2019 18:20:17] ee.DEBUG: COMMAND: docker inspect --format '{{ (index (index .NetworkSettings.Ports "443/tcp") 0).HostPort }}' b4a4cbec3eafcdd10bfcdfc36cfb7aee1eafee7846206b71e7281f7884c15ec3
[16-05-2019 18:20:17] ee.DEBUG: STDOUT: 443
[16-05-2019 18:20:17] ee.DEBUG: RETURN CODE: 0
[16-05-2019 18:20:17] ee.DEBUG: -----------------------
[16-05-2019 18:20:17] ee.DEBUG: -----------------------
[16-05-2019 18:20:17] ee.DEBUG: COMMAND: docker network inspect ee-global-backend-network
[16-05-2019 18:20:17] ee.DEBUG: STDOUT: [     {         "Name": "ee-global-backend-network",         "Id": "7e4269d8adc0a33a28dd79c7469a2cdfbbe6df2837bc1af00277f32a1070bff8",         "Created": "2018-11-26T19:43:42.249747972Z",         "Scope": "local",         "Driver": "bridge",         "EnableIPv6": false,         "IPAM": {             "Driver": "default",             "Options": {},             "Config": [                 {                     "Subnet": "172.18.0.0/16",                     "Gateway": "172.18.0.1"                 }             ]         },         "Internal": false,         "Attachable": false,         "Ingress": false,         "ConfigFrom": {             "Network": ""         },         "ConfigOnly": false,         "Containers": {             "0dcaaf6f627e921943a3e04c634773751b995087b09e71058d341ba81e6978b3": {                 "Name": "lodestone-llccom_php_1_d36539f18221",                 "EndpointID": "383318a94e47ded361a7301e3a7bbcc6370e8c5407c6fb354ede2fc4f0c38e76",                 "MacAddress": "02:42:ac:12:00:03",                 "IPv4Address": "172.18.0.3/16",                 "IPv6Address": ""             },             "6fc4d7f5c1852cbe186bb9c06a9cfc2d43dd29a5f793709b8171c8880d82bf4b": {                 "Name": "prcryptoio_php_1_fd812044274a",                 "EndpointID": "60b20a00a81f661e9519d1f95b1033e8af3c7598942a60d27950b3f1830fc131",                 "MacAddress": "02:42:ac:12:00:06",                 "IPv4Address": "172.18.0.6/16",                 "IPv6Address": ""             },             "824f812fcb7a62c3dfc8545ced998b5b683721cfd593ceefe961c69207891701": {                 "Name": "lodestone-labscom_php_1_a61c97b65c28",                 "EndpointID": "52119e2bb773c7c959c74de3e3e19df12ff81bd6d9b1f32bc2cb1ccdb0c2075c",                 "MacAddress": "02:42:ac:12:00:02",                 "IPv4Address": "172.18.0.2/16",                 "IPv6Address": ""             },             "9a5c7c7a166c19e901dda535565de3225fecfebcc89019366354edae1fc86f49": {                 "Name": "coffeemakesitbettercom_php_1_1f2792224d24",                 "EndpointID": "d4565d4585539f12477e1b9f0b61bab2d8769c33941d97b38a01b7d60c9ad85e",                 "MacAddress": "02:42:ac:12:00:09",                 "IPv4Address": "172.18.0.9/16",                 "IPv6Address": ""             },             "9f68291ca8d872b923fa7dd358d1e9971b7af350d358b8e8b8ed02ed7ecd48fd": {                 "Name": "jentheredonethatcom_php_1_c98bcdca1d29",                 "EndpointID": "b4daab5e21a89723e8dd0f849b3f6714274a28dbe9d1398325ad51038aff9919",                 "MacAddress": "02:42:ac:12:00:04",                 "IPv4Address": "172.18.0.4/16",                 "IPv6Address": ""             },             "cae9e23826100b24eec88cb6f8829159ed591a334a67b9ce3c02d7f7649017c0": {                 "Name": "growingprcom_php_1_76e7f081e266",                 "EndpointID": "74c649d8571794b9ad666282998d28d10430121958bffa356e38c3a4285a94af",                 "MacAddress": "02:42:ac:12:00:07",                 "IPv4Address": "172.18.0.7/16",                 "IPv6Address": ""             },             "d51a2ec69f8f13dada96876eee8442e231daa93805ae8ed60a40d8f3b66b83b6": {                 "Name": "services_global-db_1_893bcfef0a11",                 "EndpointID": "6929e652f3a3a8fcc128b9cbb5203a7a6f33acdb08ec5b66c8cf84cc5f6f34c3",                 "MacAddress": "02:42:ac:12:00:05",                 "IPv4Address": "172.18.0.5/16",                 "IPv6Address": ""             },             "f5d920f243ef832f828fbbe3d761aeb5a8c88bfed980edddb6f15fe292db8e39": {                 "Name": "2morrowsdresscom_php_1_787bf83593e4",                 "EndpointID": "184fcac8d972bf759fbf2a2ac601faa49fc37a68a0a851400efa7aa24cbf2aa5",                 "MacAddress": "02:42:ac:12:00:08",                 "IPv4Address": "172.18.0.8/16",                 "IPv6Address": ""             }         },         "Options": {},         "Labels": {             "org.label-schema.vendor": "EasyEngine"         }     } ]
[16-05-2019 18:20:17] ee.DEBUG: RETURN CODE: 0
[16-05-2019 18:20:17] ee.DEBUG: -----------------------
[16-05-2019 18:20:17] ee.DEBUG: -----------------------
[16-05-2019 18:20:17] ee.DEBUG: COMMAND: docker network inspect ee-global-frontend-network
[16-05-2019 18:20:17] ee.DEBUG: STDOUT: [     {         "Name": "ee-global-frontend-network",         "Id": "9ec940af3d5b33f6c61bf1f93314d03612082612f4d7895234918b1f4444f59d",         "Created": "2018-11-26T19:43:42.421443565Z",         "Scope": "local",         "Driver": "bridge",         "EnableIPv6": false,         "IPAM": {             "Driver": "default",             "Options": {},             "Config": [                 {                     "Subnet": "172.19.0.0/16",                     "Gateway": "172.19.0.1"                 }             ]         },         "Internal": false,         "Attachable": false,         "Ingress": false,         "ConfigFrom": {             "Network": ""         },         "ConfigOnly": false,         "Containers": {             "1809d16b1f9805646aa4cd7d99ddc9bb6580b0822e38fd5983463547139cde41": {                 "Name": "growingprcom_nginx_1_5eeb922fcc7d",                 "EndpointID": "5480e79c500eccad0847382c88a6eac7f6b06148c4bce76b829b97580699b9c5",                 "MacAddress": "02:42:ac:13:00:07",                 "IPv4Address": "172.19.0.7/16",                 "IPv6Address": ""             },             "2863e4289ff5e25cfd65beeeda2ffa6b6eaf66c8667e1da819afb22f958e15e2": {                 "Name": "prcryptoio_nginx_1_5d0aa72042d3",                 "EndpointID": "b2b8ca7b789a24ec004938a2b48122a502e8c4393f17ba6ff596f47bfc3c4fe6",                 "MacAddress": "02:42:ac:13:00:04",                 "IPv4Address": "172.19.0.4/16",                 "IPv6Address": ""             },             "7cae083d65fed68742d27db063bb0b57a83aa9b3201d2cbd9347f8c0f19e5a78": {                 "Name": "lodestone-labscom_nginx_1_2193ccaed983",                 "EndpointID": "cadbfb6d1a87c5d24b6f8786fadeef9ee2f65e089bb37eae413d0b88854ce2d3",                 "MacAddress": "02:42:ac:13:00:02",                 "IPv4Address": "172.19.0.2/16",                 "IPv6Address": ""             },             "94fe92d0e3430f3c6e1913aaeea5389b688d6fd9c189dfd592701744e918436d": {                 "Name": "coffeemakesitbettercom_nginx_1_778f0816df71",                 "EndpointID": "30a3b39e6a819304ce826712319fbec00434753a7e449a8dd8577482a6ff3327",                 "MacAddress": "02:42:ac:13:00:08",                 "IPv4Address": "172.19.0.8/16",                 "IPv6Address": ""             },             "b4a4cbec3eafcdd10bfcdfc36cfb7aee1eafee7846206b71e7281f7884c15ec3": {                 "Name": "services_global-nginx-proxy_1_f405f39eb1d2",                 "EndpointID": "cfdadd1f97ec3723f4cb038282a4114c7007345afceee0f5bb4b72d17e4743f6",                 "MacAddress": "02:42:ac:13:00:05",                 "IPv4Address": "172.19.0.5/16",                 "IPv6Address": ""             },             "bc25b27a655e0923607238eaef84e8508927f19c8152f28d48e27e69d3c5b0fc": {                 "Name": "lodestone-llccom_nginx_1_decab3068b2b",                 "EndpointID": "dce38beaef6941ca08f05a3f1335bbd3e7d1922fe1879a6f85a3442671623997",                 "MacAddress": "02:42:ac:13:00:06",                 "IPv4Address": "172.19.0.6/16",                 "IPv6Address": ""             },             "cdb1d16ea329f18cddc715e464412922dea2d2d888315cf121c867ad60008fed": {                 "Name": "jentheredonethatcom_nginx_1_938771d4f3aa",                 "EndpointID": "8da1892b2c211c030f05c1289f634c99c0cb3f7ac0c90393b0ebb2bd9734be87",                 "MacAddress": "02:42:ac:13:00:03",                 "IPv4Address": "172.19.0.3/16",                 "IPv6Address": ""             },             "f485a6e7cdd2330882a1547d1f21629fa7b55074741318fd57abffed8d64c06b": {                 "Name": "2morrowsdresscom_nginx_1_1d84097bee74",                 "EndpointID": "0f0b7a27ae40df50e25456a537bc473abfe4011400329efcbe50c6f5f89cabee",                 "MacAddress": "02:42:ac:13:00:09",                 "IPv4Address": "172.19.0.9/16",                 "IPv6Address": ""             }         },         "Options": {},         "Labels": {             "org.label-schema.vendor": "EasyEngine"         }     } ]
[16-05-2019 18:20:17] ee.DEBUG: RETURN CODE: 0
[16-05-2019 18:20:17] ee.DEBUG: -----------------------
[16-05-2019 18:20:17] ee.DEBUG: COMMAND: which docker
[16-05-2019 18:20:17] ee.DEBUG: RETURN CODE: 0
[16-05-2019 18:20:17] ee.DEBUG: -----------------------
[16-05-2019 18:20:17] ee.DEBUG: COMMAND: docker inspect -f '{{.State.Running}}' services_global-db_1
[16-05-2019 18:20:17] ee.DEBUG: STDOUT:
[16-05-2019 18:20:17] ee.DEBUG: STDERR: Error: No such object: services_global-db_1
[16-05-2019 18:20:17] ee.DEBUG: RETURN CODE: 1
[16-05-2019 18:20:17] ee.DEBUG: -----------------------
[16-05-2019 18:20:17] ee.DEBUG: COMMAND: which docker
[16-05-2019 18:20:17] ee.DEBUG: RETURN CODE: 0
[16-05-2019 18:20:17] ee.DEBUG: -----------------------
[16-05-2019 18:20:17] ee.DEBUG: COMMAND: docker inspect -f '{{.State.Running}}' services_global-db_1
[16-05-2019 18:20:17] ee.DEBUG: STDOUT:
[16-05-2019 18:20:17] ee.DEBUG: STDERR: Error: No such object: services_global-db_1
[16-05-2019 18:20:17] ee.DEBUG: RETURN CODE: 1
[16-05-2019 18:20:17] ee.DEBUG: -----------------------
[16-05-2019 18:20:17] ee.DEBUG: -----------------------
[16-05-2019 18:20:17] ee.DEBUG: COMMAND: docker-compose up -d global-db
[16-05-2019 18:20:18] ee.DEBUG: STDERR: services_global-db_1_893bcfef0a11 is up-to-date
[16-05-2019 18:20:18] ee.DEBUG: RETURN CODE: 0
[16-05-2019 18:20:18] ee.DEBUG: -----------------------
[16-05-2019 18:20:18] ee.DEBUG: -----------------------
[16-05-2019 18:20:18] ee.DEBUG: COMMAND: docker cp /tmp/db_exec services_global-db_1:/db_exec
[16-05-2019 18:20:18] ee.DEBUG: STDERR: Error: No such container:path: services_global-db_1:/
[16-05-2019 18:20:18] ee.DEBUG: RETURN CODE: 1
[16-05-2019 18:20:18] ee.DEBUG: -----------------------
[16-05-2019 18:20:18] ee.DEBUG: -----------------------
[16-05-2019 18:20:18] ee.DEBUG: COMMAND: docker exec services_global-db_1 sh db_exec
[16-05-2019 18:20:18] ee.DEBUG: STDERR: Error: No such container: services_global-db_1
[16-05-2019 18:20:18] ee.DEBUG: RETURN CODE: 1
[16-05-2019 18:20:18] ee.DEBUG: -----------------------
[16-05-2019 18:20:19] ee.DEBUG: -----------------------
[16-05-2019 18:20:19] ee.DEBUG: COMMAND: docker exec services_global-db_1 sh db_exec
[16-05-2019 18:20:19] ee.DEBUG: STDERR: Error: No such container: services_global-db_1
[16-05-2019 18:20:19] ee.DEBUG: RETURN CODE: 1
[16-05-2019 18:20:19] ee.DEBUG: -----------------------
[16-05-2019 18:20:20] ee.DEBUG: -----------------------
[16-05-2019 18:20:20] ee.DEBUG: COMMAND: docker exec services_global-db_1 sh db_exec
[16-05-2019 18:20:20] ee.DEBUG: STDERR: Error: No such container: services_global-db_1
[16-05-2019 18:20:20] ee.DEBUG: RETURN CODE: 1
[16-05-2019 18:20:20] ee.DEBUG: -----------------------
[16-05-2019 18:20:21] ee.DEBUG: -----------------------
[16-05-2019 18:20:21] ee.DEBUG: COMMAND: docker exec services_global-db_1 sh db_exec
[16-05-2019 18:20:21] ee.DEBUG: STDERR: Error: No such container: services_global-db_1
[16-05-2019 18:20:21] ee.DEBUG: RETURN CODE: 1
[16-05-2019 18:20:21] ee.DEBUG: -----------------------
[16-05-2019 18:20:22] ee.DEBUG: -----------------------
[16-05-2019 18:20:22] ee.DEBUG: COMMAND: docker exec services_global-db_1 sh db_exec
[16-05-2019 18:20:22] ee.DEBUG: STDERR: Error: No such container: services_global-db_1
[16-05-2019 18:20:22] ee.DEBUG: RETURN CODE: 1
[16-05-2019 18:20:22] ee.DEBUG: -----------------------
[16-05-2019 18:20:23] ee.DEBUG: -----------------------
[16-05-2019 18:20:23] ee.DEBUG: COMMAND: docker exec services_global-db_1 sh db_exec
[16-05-2019 18:20:23] ee.DEBUG: STDERR: Error: No such container: services_global-db_1
[16-05-2019 18:20:23] ee.DEBUG: RETURN CODE: 1
[16-05-2019 18:20:23] ee.DEBUG: -----------------------
[16-05-2019 18:20:24] ee.DEBUG: -----------------------
[16-05-2019 18:20:24] ee.DEBUG: COMMAND: docker exec services_global-db_1 sh db_exec
[16-05-2019 18:20:24] ee.DEBUG: STDERR: Error: No such container: services_global-db_1
[16-05-2019 18:20:24] ee.DEBUG: RETURN CODE: 1
[16-05-2019 18:20:24] ee.DEBUG: -----------------------
[16-05-2019 18:20:25] ee.DEBUG: -----------------------
[16-05-2019 18:20:25] ee.DEBUG: COMMAND: docker exec services_global-db_1 sh db_exec
[16-05-2019 18:20:25] ee.DEBUG: STDERR: Error: No such container: services_global-db_1
[16-05-2019 18:20:25] ee.DEBUG: RETURN CODE: 1
[16-05-2019 18:20:25] ee.DEBUG: -----------------------
etc...
+-------------------+----------------------------------------------------------+
| OS                | Linux 4.9.0-8-amd64 #1 SMP Debian 4.9.130-2 (2018-10-27) |
|                   |  x86_64                                                  |
| Shell             | /bin/bash                                                |
| PHP binary        | /usr/bin/php7.2                                          |
| PHP version       | 7.2.12-1+0~20181112102304.11+stretch~1.gbp55f215         |
| php.ini used      | /etc/php/7.2/cli/php.ini                                 |
| EE root dir       | phar://ee.phar                                           |
| EE vendor dir     | phar://ee.phar/vendor                                    |
| EE phar path      | /home/user                                             |
| EE packages dir   |                                                          |
| EE global config  | /opt/easyengine/config/config.yml                        |
| EE project config |                                                          |
| EE version        | 4.0.14                                                   |
+-------------------+----------------------------------------------------------+

#2

It appears that during the upgrade, a service was renamed.

Can I simply rename back to services_global-db_1?

$ sudo docker ps -a | grep services_global
b4a4cbec3eaf        easyengine/nginx-proxy:v4.0.3   "/app/docker-entrypo…"   21 hours ago        Up 21 hours         0.0.0.0:80->80/tcp, 0.0.0.0:443->443/tcp   services_global-nginx-proxy_1_f405f39eb1d2
d51a2ec69f8f        easyengine/mariadb:v4.0.0       "docker-entrypoint.s…"   4 months ago        Up 2 days           3306/tcp                                   **services_global-db_1_893bcfef0a11**


#3

@rahul286

Is this forum monitored by EE developers, or is my waiting for a response a fool’s errand? I’m happy to wait, but want to manage expectations.


#4

We do monitor but for critical issues only. Unfortunately, we do not have enough resources to provide free support to a large community like this.

We have set expectation clearly by adding the disclaimer on every page:

This is community support portal for user-to-user support only. If you have any questions/suggestion for EasyEngine, use this community support forum.

I understand your frustration, but we are helpless too.


#5

@rpost partial logs are not helpful in debugging, please send the entire logfile to mail id: ee@rtcamp.com so that the root cause and origin of this issue can be looked into.

Also, send the output of:
docker-compose --version

It seems highly likely that you are using an older version of docker-compose, which had this bug of adding extra characters at the end of containers. If the version you get matched the affected version given in article please follow the steps in this handbook to fix it.