301-350 of 10000 results (20ms)
2020-09-28 ยง
15:25 <hashar> Restarting CI Jenkins for plugins uninstallation T260565 [production]
15:15 <hnowlan@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . [production]
15:15 <hnowlan@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'api-gateway' for release 'production' . [production]
15:13 <hnowlan@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'api-gateway' for release 'production' . [production]
15:13 <hnowlan@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . [production]
15:12 <cdanis@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'production' . [production]
15:12 <cdanis@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'canary' . [production]
15:08 <hnowlan@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . [production]
15:08 <hnowlan@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'api-gateway' for release 'production' . [production]
15:03 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:01 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:00 <elukey@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:59 <elukey@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:49 <moritzm> installing glib-networking security updates [production]
14:44 <hnowlan@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . [production]
14:44 <hnowlan@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'production' . [production]
14:40 <elukey@puppetmaster1001> conftool action : set/pooled=yes; selector: name=aqs1006.eqiad.wmnet [production]
14:33 <XioNoX> repool eqiad [production]
14:27 <hnowlan@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . [production]
14:27 <hnowlan@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'production' . [production]
14:05 <moritzm> uploaded libdbi-perl 1.631-3+wmf1 for jessie-wikimedia T259102 [production]
13:58 <XioNoX> asw2-d-eqiad# run request system power-off member 4 [production]
13:51 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:46 <elukey@puppetmaster1001> conftool action : set/pooled=no; selector: name=aqs1006.eqiad.wmnet [production]
13:45 <XioNoX> downtiming all eqiad row D hosts - T196487 [production]
13:42 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
13:38 <godog> roll restart object-replicator on ms-be2* for higher concurrency - T261633 [production]
13:35 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:32 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
13:25 <volans@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:20 <volans@cumin1001> START - Cookbook sre.dns.netbox [production]
13:19 <moritzm> reimaging sretest1001 to validate puppetised sources.list with a new installation T158562 [production]
13:03 <akosiaris@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
12:57 <akosiaris@cumin1001> START - Cookbook sre.hosts.decommission [production]
12:37 <jayme@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'zotero' for release 'production' . [production]
12:31 <jayme@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'zotero' for release 'production' . [production]
12:29 <Urbanecm> [urbanecm@mwmaint2001 ~]$ mwscript resetUserEmail.php --wiki=arbcom_ruwiki 'Adamant.pwn' 'adamant.pwn@hotmail.com' # T262812 [production]
12:28 <Urbanecm> [urbanecm@mwmaint2001 ~]$ mwscript createAndPromote.php --wiki=arbcom_ruwiki --bureaucrat --sysop 'Adamant.pwn' <PASSWORD REDACTED> # T262812 [production]
12:26 <Urbanecm> arbcom_ruwiki is created (T262812) [production]
12:26 <urbanecm@deploy1001> Synchronized wmf-config/interwiki.php: Update interwiki cache (duration: 01m 48s) [production]
12:24 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Creating arbcom_ruwiki (T262812) (duration: 00m 56s) [production]
12:22 <urbanecm@deploy1001> Synchronized static/images/project-logos/: Creating arbcom_ruwiki (T262812) (duration: 00m 56s) [production]
12:21 <urbanecm@deploy1001> rebuilt and synchronized wikiversions files: Creating arbcom_ruwiki (T262812) [production]
12:20 <urbanecm@deploy1001> Synchronized dblists: Creating arbcom_ruwiki (T262812) (duration: 00m 57s) [production]
12:19 <urbanecm@deploy1001> Synchronized wmf-config/db-codfw.php: Creating arbcom_ruwiki (T262812) (duration: 00m 57s) [production]
12:17 <urbanecm@deploy1001> Synchronized wmf-config/db-eqiad.php: Creating arbcom_ruwiki (T262812) (duration: 00m 56s) [production]
12:00 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:59 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:59 <kormat@cumin1001> dbctl commit (dc=all): 'db1114 depooling: prep for rack switch upgrade T196487', diff saved to https://phabricator.wikimedia.org/P12815 and previous config saved to /var/cache/conftool/dbconfig/20200928-115904-kormat.json [production]
11:43 <urbanecm@deploy1001> Synchronized wmf-config/CommonSettings.php: 483beb2452caead8c44dfb8e608812778033fba0: ContentTranslation: Do not use wikishared DB for testwiki (T263417; follow-up af09303a4a155681b198ac70468494c2155868df also included in this sync) (duration: 00m 56s) [production]