1801-1850 of 10000 results (81ms)
2023-03-13 ยง
17:11 <bd808@deploy2002> helmfile [codfw] DONE helmfile.d/services/developer-portal: apply [production]
17:11 <mvernon@cumin1001> START - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies rolling restart_daemons on A:codfw and (A:swift-fe or A:swift-fe-canary or A:swift-fe-codfw or A:swift-fe-eqiad) [production]
17:11 <bd808@deploy2002> helmfile [codfw] START helmfile.d/services/developer-portal: apply [production]
17:10 <Emperor> roll-restart of codfw eqiad frontends [production]
17:10 <bd808@deploy2002> helmfile [eqiad] DONE helmfile.d/services/developer-portal: apply [production]
17:10 <bd808@deploy2002> helmfile [eqiad] START helmfile.d/services/developer-portal: apply [production]
17:10 <bd808@deploy2002> helmfile [staging] DONE helmfile.d/services/developer-portal: apply [production]
17:09 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2116', diff saved to https://phabricator.wikimedia.org/P45788 and previous config saved to /var/cache/conftool/dbconfig/20230313-170955-marostegui.json [production]
17:09 <bd808@deploy2002> helmfile [staging] START helmfile.d/services/developer-portal: apply [production]
17:08 <dancy@deploy2002> Installation of scap version "4.46.0" completed for 553 hosts [production]
17:07 <dancy@deploy2002> Installing scap version "4.46.0" for 553 hosts [production]
17:04 <bd808> Ran cache.purge_openstack_users() for Striker following deploy of e1f7491 (T331674) [production]
17:04 <dancy@deploy2002> Installing scap version "4.46.0" for 553 hosts [production]
16:54 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2116 (T329260)', diff saved to https://phabricator.wikimedia.org/P45787 and previous config saved to /var/cache/conftool/dbconfig/20230313-165449-marostegui.json [production]
16:47 <jayme@deploy2002> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
16:44 <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db2116 (T329260)', diff saved to https://phabricator.wikimedia.org/P45785 and previous config saved to /var/cache/conftool/dbconfig/20230313-164410-marostegui.json [production]
16:44 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2116.codfw.wmnet with reason: Maintenance [production]
16:43 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db2116.codfw.wmnet with reason: Maintenance [production]
16:43 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2103 (T329260)', diff saved to https://phabricator.wikimedia.org/P45784 and previous config saved to /var/cache/conftool/dbconfig/20230313-164349-marostegui.json [production]
16:36 <jayme@deploy2002> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
16:28 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2103', diff saved to https://phabricator.wikimedia.org/P45783 and previous config saved to /var/cache/conftool/dbconfig/20230313-162843-marostegui.json [production]
16:20 <moritzm> imported tideways 5.0.4-2+wmf1+buster1+icu67u1 T329491 [production]
16:18 <dancy@deploy2002> Finished scap: testing (duration: 06m 53s) [production]
16:17 <bd808@deploy2002> helmfile [codfw] DONE helmfile.d/services/developer-portal: apply [production]
16:17 <bd808@deploy2002> helmfile [codfw] START helmfile.d/services/developer-portal: apply [production]
16:17 <bd808@deploy2002> helmfile [eqiad] DONE helmfile.d/services/developer-portal: apply [production]
16:16 <bd808@deploy2002> helmfile [eqiad] START helmfile.d/services/developer-portal: apply [production]
16:16 <bd808@deploy2002> helmfile [staging] DONE helmfile.d/services/developer-portal: apply [production]
16:16 <bd808@deploy2002> helmfile [staging] START helmfile.d/services/developer-portal: apply [production]
16:13 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2103', diff saved to https://phabricator.wikimedia.org/P45782 and previous config saved to /var/cache/conftool/dbconfig/20230313-161337-marostegui.json [production]
16:11 <dancy@deploy2002> Started scap: testing [production]
16:06 <jdrewniak@deploy2002> Synchronized portals: Wikimedia Portals Update: [[gerrit:897915| Bumping portals to master (T128546)]] (duration: 06m 15s) [production]
16:00 <moritzm> imported xdebug 3.0.3+2.9.8+2.8.1+2.5.5-0+deb11u1+wmf1+buster1+icu67u1 T329491 [production]
16:00 <jdrewniak@deploy2002> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:897915| Bumping portals to master (T128546)]] (duration: 06m 43s) [production]
15:58 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2103 (T329260)', diff saved to https://phabricator.wikimedia.org/P45781 and previous config saved to /var/cache/conftool/dbconfig/20230313-155830-marostegui.json [production]
15:46 <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db2103 (T329260)', diff saved to https://phabricator.wikimedia.org/P45780 and previous config saved to /var/cache/conftool/dbconfig/20230313-154641-marostegui.json [production]
15:46 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2103.codfw.wmnet with reason: Maintenance [production]
15:46 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db2103.codfw.wmnet with reason: Maintenance [production]
15:38 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2102.codfw.wmnet with reason: Maintenance [production]
15:37 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db2102.codfw.wmnet with reason: Maintenance [production]
15:35 <moritzm> imported php-yaml 2.2.1+2.1.0+2.0.4+1.3.2-2+wmf1~buster1+icu67u1 T329491 [production]
15:31 <dancy@deploy2002> Finished scap: testing T329857 (duration: 10m 08s) [production]
15:29 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2097.codfw.wmnet with reason: Maintenance [production]
15:29 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db2097.codfw.wmnet with reason: Maintenance [production]
15:25 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2118.codfw.wmnet with reason: Maintenance [production]
15:24 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db2118.codfw.wmnet with reason: Maintenance [production]
15:21 <dancy@deploy2002> Started scap: testing T329857 [production]
15:06 <hnowlan@deploy2002> helmfile [staging] DONE helmfile.d/services/thumbor: sync [production]
15:05 <hnowlan@deploy2002> helmfile [staging] START helmfile.d/services/thumbor: sync [production]
15:05 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2182 (T329260)', diff saved to https://phabricator.wikimedia.org/P45779 and previous config saved to /var/cache/conftool/dbconfig/20230313-150523-marostegui.json [production]