2101-2150 of 10000 results (28ms)
2020-09-28 ยง
13:46 <elukey@puppetmaster1001> conftool action : set/pooled=no; selector: name=aqs1006.eqiad.wmnet [production]
13:45 <XioNoX> downtiming all eqiad row D hosts - T196487 [production]
13:42 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
13:38 <godog> roll restart object-replicator on ms-be2* for higher concurrency - T261633 [production]
13:35 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:32 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
13:25 <volans@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:20 <volans@cumin1001> START - Cookbook sre.dns.netbox [production]
13:19 <moritzm> reimaging sretest1001 to validate puppetised sources.list with a new installation T158562 [production]
13:03 <akosiaris@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
12:57 <akosiaris@cumin1001> START - Cookbook sre.hosts.decommission [production]
12:37 <jayme@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'zotero' for release 'production' . [production]
12:31 <jayme@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'zotero' for release 'production' . [production]
12:29 <Urbanecm> [urbanecm@mwmaint2001 ~]$ mwscript resetUserEmail.php --wiki=arbcom_ruwiki 'Adamant.pwn' 'adamant.pwn@hotmail.com' # T262812 [production]
12:28 <Urbanecm> [urbanecm@mwmaint2001 ~]$ mwscript createAndPromote.php --wiki=arbcom_ruwiki --bureaucrat --sysop 'Adamant.pwn' <PASSWORD REDACTED> # T262812 [production]
12:26 <Urbanecm> arbcom_ruwiki is created (T262812) [production]
12:26 <urbanecm@deploy1001> Synchronized wmf-config/interwiki.php: Update interwiki cache (duration: 01m 48s) [production]
12:24 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Creating arbcom_ruwiki (T262812) (duration: 00m 56s) [production]
12:22 <urbanecm@deploy1001> Synchronized static/images/project-logos/: Creating arbcom_ruwiki (T262812) (duration: 00m 56s) [production]
12:21 <urbanecm@deploy1001> rebuilt and synchronized wikiversions files: Creating arbcom_ruwiki (T262812) [production]
12:20 <urbanecm@deploy1001> Synchronized dblists: Creating arbcom_ruwiki (T262812) (duration: 00m 57s) [production]
12:19 <urbanecm@deploy1001> Synchronized wmf-config/db-codfw.php: Creating arbcom_ruwiki (T262812) (duration: 00m 57s) [production]
12:17 <urbanecm@deploy1001> Synchronized wmf-config/db-eqiad.php: Creating arbcom_ruwiki (T262812) (duration: 00m 56s) [production]
12:00 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:59 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:59 <kormat@cumin1001> dbctl commit (dc=all): 'db1114 depooling: prep for rack switch upgrade T196487', diff saved to https://phabricator.wikimedia.org/P12815 and previous config saved to /var/cache/conftool/dbconfig/20200928-115904-kormat.json [production]
11:43 <urbanecm@deploy1001> Synchronized wmf-config/CommonSettings.php: 483beb2452caead8c44dfb8e608812778033fba0: ContentTranslation: Do not use wikishared DB for testwiki (T263417; follow-up af09303a4a155681b198ac70468494c2155868df also included in this sync) (duration: 00m 56s) [production]
11:34 <Urbanecm> EU B&C window done [production]
11:34 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 61eac95ef62aef682039761e0f02188437cb15fb: Creation of patroller group on arz.wikipedia (T262218) (duration: 00m 57s) [production]
11:20 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 483beb2452caead8c44dfb8e608812778033fba0: ContentTranslation: Do not use wikishared DB for testwiki (T263417; follow-up af09303a4a155681b198ac70468494c2155868df also included in this sync) (duration: 00m 57s) [production]
10:45 <jdrewniak@deploy1001> Synchronized portals: Wikimedia Portals Update: [[gerrit:630561| Bumping portals to master (T128546)]] (duration: 00m 57s) [production]
10:44 <jdrewniak@deploy1001> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:630561| Bumping portals to master (T128546)]] (duration: 00m 58s) [production]
10:37 <jayme@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'zotero' for release 'staging' . [production]
10:35 <hnowlan@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
10:35 <hnowlan@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
10:33 <hnowlan@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
10:32 <hnowlan@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
10:32 <hnowlan@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
10:32 <hnowlan@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
10:29 <hnowlan@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
10:29 <hnowlan@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
10:25 <hnowlan@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
10:25 <hnowlan@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
10:23 <hnowlan@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
09:48 <hnowlan@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
09:48 <hnowlan@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
09:48 <ema> upload@codfw: rolling varnish upgrade to 6.0.6-1wm1 T263557 [production]
09:29 <ema> text@codfw: rolling varnish upgrade to 6.0.6-1wm1 T263557 [production]
09:17 <_joe_> changing the restbase public TLS certs to include restbase-async.discovery.wmnet [production]
09:17 <XioNoX> restart bird on dns2001 - T262372 [production]