4851-4900 of 10000 results (71ms)
2019-09-10 §
04:23 <marostegui> Start topology changes on s8, connect everything under db1109 - T230762 [production]
04:22 <marostegui@cumin1001> dbctl commit (dc=all): 'Set db1109 with weight 0 and depool it from API T230762', diff saved to https://phabricator.wikimedia.org/P9068 and previous config saved to /var/cache/conftool/dbconfig/20190910-042243-marostegui.json [production]
04:18 <marostegui> Start s8 (wikidata) pre switchover steps T230762 [production]
00:59 <krinkle@deploy1001> Finished deploy [performance/navtiming@f2a0863]: (no justification provided) (duration: 00m 05s) [production]
00:59 <krinkle@deploy1001> Started deploy [performance/navtiming@f2a0863]: (no justification provided) [production]
00:57 <Krinkle> krinkle@deploy1001: Deploy performance/navtiming f2a0863b9e4774140463a79d08051814c0d21116 - T226539 [production]
00:41 <urandom> decommissioning Cassandra, restbase-dev1005-a -- T224554 [production]
2019-09-09 §
23:44 <catrope@deploy1001> Synchronized php-1.34.0-wmf.21/skins/MinervaNeue/: T232260 (duration: 00m 57s) [production]
22:28 <ejegg> updated payments-wiki from 51d9ed79b6 to 15baf7f58b [production]
20:50 <urandom> bootstrapping Cassandra, restbase-dev1004-b -- T224554 [production]
19:48 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@533d541]: Update mobileapps to 01971d9 (duration: 05m 45s) [production]
19:42 <mholloway-shell@deploy1001> Started deploy [mobileapps/deploy@533d541]: Update mobileapps to 01971d9 [production]
19:41 <mdholloway> mobileapps deployment failed repooling canary (scb2001); retrying [production]
19:40 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@533d541]: Update mobileapps to 01971d9 (duration: 02m 59s) [production]
19:37 <XioNoX> fix eqsin CF tunnel missconfig [production]
19:37 <mholloway-shell@deploy1001> Started deploy [mobileapps/deploy@533d541]: Update mobileapps to 01971d9 [production]
17:56 <andrewbogott> disabling puppet on labpuppetmaster1001 as part of T171188 [production]
17:55 <XioNoX> push cloudflare tunnel config to cr1-eqsin [production]
16:50 <papaul> replacing Fan kit and power supplies on cr1-codfw [production]
14:22 <urandom> bootstrapping Cassandra, restbase-dev1004-a -- T224554 [production]
13:51 <vgutierrez> upgrading ats to 8.0.5-1wm6 on cp5001 - T232298 [production]
13:39 <vgutierrez> uploaded trafficserver 8.0.5-1wm6 to apt.wikimedia.org (stretch) - T232298 [production]
13:31 <moritzm> installing facter update from buster 10.1 point release (T222356) [production]
13:15 <moritzm> upgrading labweb/wikitech to PHP 7.2.22 T230024 [production]
13:02 <Urbanecm> Patch is deployed, deploy1001 should be clear [production]
13:01 <moritzm> upgrading remaining mediawiki app servers (mw1266-mw1275) to PHP 7.2.22 T230024 [production]
12:55 <urbanecm@deploy1001> Synchronized php-1.34.0-wmf.21/extensions/WikibaseMediaInfo/: ubn patch T231276 (duration: 00m 58s) [production]
12:51 <urbanecm@deploy1001> Synchronized php-1.34.0-wmf.21/extensions/Wikibase: ubn patch T231276 (duration: 01m 03s) [production]
12:48 <moritzm> upgrading remaining job runners to PHP 7.2.22 T230024 [production]
12:44 <Urbanecm> EU SWAT wmf patch ongoing, testing with mwdebug1002 [production]
12:41 <ema> lvs1015 (primary): restart pybal to add service restbase-ssl T210411 [production]
12:36 <ema> lvs2003 (primary): restart pybal to add service restbase-ssl T210411 [production]
12:32 <ema@puppetmaster1001> conftool action : set/pooled=yes; selector: service=restbase-ssl,dc=eqiad [production]
12:30 <ema@puppetmaster1001> conftool action : set/pooled=yes; selector: service=restbase-ssl,dc=codfw [production]
12:29 <elukey> restart archiva again to debug download artifact issue [production]
12:24 <ema@puppetmaster1001> conftool action : set/pooled=yes; selector: service=restbase-ssl,name=restbase2009.codfw.wmnet [production]
12:24 <ema@puppetmaster1001> conftool action : set/pooled=yes; selector: service=restbase-ssl,name=restbase1022.eqiad.wmnet [production]
12:11 <Urbanecm> Undeployed patch in wmf branch, will resolve soon [production]
12:01 <moritzm> installing ldap-corp1001 T231015 [production]
11:32 <Urbanecm> Dry run for all wikis (T231137) [production]
11:26 <moritzm> installing ldap-corp2001 T231015 [production]
10:39 <jdrewniak@deploy1001> Synchronized portals: Wikimedia Portals Update: [[gerrit:535145| Bumping portals to master (T128546)]] (duration: 00m 53s) [production]
10:38 <jdrewniak@deploy1001> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:535145| Bumping portals to master (T128546)]] (duration: 00m 54s) [production]
10:22 <effie> jiji@deploy1001:~$ scap sync-file wmf-config/CommonSettings.php "Push PHP7 traffic to 33.3% - T219150" [production]
09:48 <moritzm> updated stretch netinst image to 9.11 T232308 [production]
09:42 <eileen> civicrm revision changed from d1d65f37ea to 516eeb54b5, config revision is 5a6a9c6c03 [production]
09:40 <moritzm> updated buster netinst image to 10.1 T232310 [production]
09:28 <ema> lvs1016, lvs2006 (secondaries): restart pybal to add service restbase-ssl T210411 [production]
09:02 <elukey> restart archiva on archiva1001 - stuck and not serving requests (no trace about why in the logs) [production]
08:55 <eileen> civicrm revision is d1d65f37ea, config revision is 5a6a9c6c03 [production]