3251-3300 of 10000 results (31ms)
2020-10-06 ยง
14:15 <jayme> installed envoyproxy 1.15.1-2 on mwdebug1001 [production]
14:08 <marostegui> Reboot db1076 for kernel upgrade T264755 [production]
14:04 <jayme@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'citoid' for release 'production' . [production]
14:03 <marostegui> Power cycle db1076 T264755 [production]
13:58 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1076 ', diff saved to https://phabricator.wikimedia.org/P12934 and previous config saved to /var/cache/conftool/dbconfig/20201006-135810-marostegui.json [production]
13:41 <kormat@cumin1001> dbctl commit (dc=all): 'db2137:3314 depooling: schema change T259831', diff saved to https://phabricator.wikimedia.org/P12932 and previous config saved to /var/cache/conftool/dbconfig/20201006-134149-kormat.json [production]
13:41 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:41 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
13:40 <kormat@cumin1001> dbctl commit (dc=all): 'Remove db2119 from dump/vslow, add to all other contributions/logpager/recentchanges*/watchlist temporarily T259831', diff saved to https://phabricator.wikimedia.org/P12931 and previous config saved to /var/cache/conftool/dbconfig/20201006-134020-kormat.json [production]
13:40 <jayme@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'citoid' for release 'staging' . [production]
13:14 <jayme> pushed docker-registry.discovery.wmnet/envoy:1.15.1-2 - T264157 [production]
13:04 <marostegui> Change innodb_change_buffering = inserts on db2075 db2089 db2099 db2111 db2128 T263443 [production]
12:55 <godog> swift codfw-prod: bump weight for ms-be2057 - T261633 [production]
12:20 <elukey> update HDFS Namenode GC/Heap settings on an-master100[1,2] [production]
12:13 <jayme> imported envoyproxy_1.15.1-2 to buster-wikimedia and stretch-wikimedia [production]
12:08 <jbond42> deploy puppetlabs-stdlib 5.2 [production]
11:50 <ayounsi@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
11:42 <ayounsi@cumin1001> START - Cookbook sre.dns.netbox [production]
11:39 <ayounsi@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
11:35 <ayounsi@cumin1001> START - Cookbook sre.dns.netbox [production]
11:34 <Urbanecm> EU B&C window done [production]
11:34 <Urbanecm> urbanecm@mwmaint2001:~$ mwscript namespaceDupes.php --wiki=arbcom_ruwiki --fix # T264430 # P12930 [production]
11:32 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 07c19f97c79ec20d6b1657e589acfc242dd53b09: arbcom_ruwiki: Set AK as alias for NS_PROJECT (T264430) (duration: 00m 58s) [production]
11:31 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 7e4e81129b8697c394ec329dd2b3c784e607a4d1: arbcom_ruwiki: Change favicon to File:Arbcom-ru_favicon.svg from commons (T264430) (duration: 00m 58s) [production]
11:30 <urbanecm@deploy1001> Synchronized static/favicon/arbcom_ruwiki.ico: 7e4e81129b8697c394ec329dd2b3c784e607a4d1: arbcom_ruwiki: Change favicon to File:Arbcom-ru_favicon.svg from commons (T264430) (duration: 00m 58s) [production]
11:20 <XioNoX> push L3 prep work to cloudsw1-c8-eqiad [production]
11:19 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 7b1a4fad0f55c626e42961489062115d5f97ed6c: ruewiki: Add rollbacker, grantable and revokable by sysops (T264147) (duration: 00m 58s) [production]
11:15 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 5cc7027ba8d0ddee5c9898b80afe850603bf870e: Allow bureaucrats to remove sysop permissions on Commons (T261481) (duration: 00m 58s) [production]
11:07 <hnowlan@deploy1001> Finished deploy [restbase/deploy@4ad65b0]: Redeploying restbase2009 (duration: 03m 14s) [production]
11:07 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 5f9721b3300c8e733d331bcbc754d31d9493f8ba: GrowthExperiments: Change Help Page URL for kowiki (T254364) (duration: 01m 00s) [production]
11:04 <hnowlan@deploy1001> Started deploy [restbase/deploy@4ad65b0]: Redeploying restbase2009 [production]
11:02 <hnowlan@deploy1001> Finished deploy [restbase/deploy@4ad65b0]: Redeploying restbase2009 (duration: 00m 12s) [production]
11:02 <hnowlan@deploy1001> Started deploy [restbase/deploy@4ad65b0]: Redeploying restbase2009 [production]
11:01 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:01 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:48 <effie> set mw2279.codfw.wmnet as inactive T264698 [production]
10:47 <jiji@cumin1001> conftool action : set/pooled=inactive; selector: name=mw2279.codfw.wmnet [production]
10:45 <hnowlan@deploy1001> Finished deploy [restbase/deploy@4ad65b0]: Deploying restbase to new hosts (duration: 01m 19s) [production]
10:44 <hnowlan@deploy1001> Started deploy [restbase/deploy@4ad65b0]: Deploying restbase to new hosts [production]
10:43 <hnowlan@deploy1001> Finished deploy [restbase/deploy@4ad65b0]: Deploying restbase to new hosts (duration: 01m 19s) [production]
10:41 <hnowlan@deploy1001> Started deploy [restbase/deploy@4ad65b0]: Deploying restbase to new hosts [production]
10:37 <hnowlan@deploy1001> Finished deploy [restbase/deploy@4ad65b0]: Redeploying to depooled restbase2009 (duration: 00m 15s) [production]
10:37 <hnowlan@deploy1001> Started deploy [restbase/deploy@4ad65b0]: Redeploying to depooled restbase2009 [production]
10:36 <volans@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
10:33 <hnowlan@deploy1001> Finished deploy [restbase/deploy@4ad65b0]: (no justification provided) (duration: 03m 01s) [production]
10:31 <volans@cumin1001> START - Cookbook sre.dns.netbox [production]
10:30 <hnowlan@deploy1001> Started deploy [restbase/deploy@4ad65b0]: (no justification provided) [production]
10:01 <marostegui> Restart mysql on dbstore1004 to pick up new buffer pool sizes [production]
09:59 <effie> enable puppet on mc20* [production]
09:41 <effie> enable puppet on mc10* [production]