801-850 of 10000 results (44ms)
2019-10-21 ยง
13:46 <Urbanecm> Deploy sec patch for T104807 [production]
13:26 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2084:3314 and db2091:3312 for table compression', diff saved to https://phabricator.wikimedia.org/P9412 and previous config saved to /var/cache/conftool/dbconfig/20191021-132633-marostegui.json [production]
13:24 <marostegui@cumin1001> dbctl commit (dc=all): 'Change weights 1/2 to 100/200 on s2 codfw - T231018', diff saved to https://phabricator.wikimedia.org/P9411 and previous config saved to /var/cache/conftool/dbconfig/20191021-132440-marostegui.json [production]
13:21 <marostegui@cumin1001> dbctl commit (dc=all): 'Change weights 1/2 to 100/200 on s2 eqiad - T231018', diff saved to https://phabricator.wikimedia.org/P9410 and previous config saved to /var/cache/conftool/dbconfig/20191021-132145-marostegui.json [production]
13:07 <ema> lvs1015: restart pybal to add new service wdqs-ssl T210411 [production]
13:04 <marostegui> Deploy schema change on db1122 (s2 primary master) - T233135 T234066 [production]
13:04 <ema> lvs2003: restart pybal to add new service wdqs-ssl T210411 [production]
13:03 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1090:3312 after schema change and remove db1129 from vslow and dump as it was was there temporarily', diff saved to https://phabricator.wikimedia.org/P9409 and previous config saved to /var/cache/conftool/dbconfig/20191021-130355-marostegui.json [production]
13:02 <ema> lvs1016: restart pybal to add new service wdqs-ssl T210411 [production]
13:00 <ema@puppetmaster1001> conftool action : set/pooled=yes; selector: service=wdqs-ssl [production]
12:58 <ema> lvs2006: restart pybal to add new service wdqs-ssl T210411 [production]
12:38 <hashar> Started zuul-merger on contint2001 [production]
12:32 <hashar> Stopped zuul-merger on contint2001 [production]
12:31 <hashar> Started zuul-merger on contint1001 [production]
12:16 <hashar> Stopped zuul-merger on contint1001 [production]
12:02 <Urbanecm> EU SWAT finally done [production]
12:01 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: e8d70c1: Partial cleanup of InitialiseSettings (T231178) (duration: 01m 00s) [production]
12:00 <Urbanecm> I'm going to do one last sync for EU SWAT [production]
11:57 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 12e3549: Create Portal namespace for sawikisource (T235343) (duration: 00m 59s) [production]
11:55 <urbanecm@deploy1001> sync-file aborted: SWAT: 12e3549: Create Portal namespace for sawikisource (duration: 00m 01s) [production]
11:54 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 3b1350b: wgCopyUploadDomains: Add iip.bu.uni.wroc.pl there (T235904) (duration: 00m 59s) [production]
11:49 <Urbanecm> Reopen EU SWAT [production]
11:42 <awight> EU SWAT complete [production]
11:42 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings-labs.php: SWAT: [[gerrit:544855|Put reference previews back into beta mode on beta cluster (T233813)]] (duration: 01m 00s) [production]
11:38 <kartik@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit|543764|Enable ContentTranslation out of Beta in Malayalam/Bengali/Mongolian WPs (T233008, T233009, T234317)]] (duration: 01m 00s) [production]
11:34 <moritzm> installing Java security updates on restbase-dev1004 [production]
11:30 <mobrovac@deploy1001> Synchronized php-1.35.0-wmf.2/tests/phpunit/includes/Storage/SqlBlobStoreTest.php: SqlBlobStore HOT FIX: remove caching from getBlobBatch; file 3/3 - T235188 (duration: 01m 00s) [production]
11:28 <mobrovac@deploy1001> Synchronized php-1.35.0-wmf.2/includes/libs/objectcache/wancache/WANObjectCache.php: SqlBlobStore HOT FIX: remove caching from getBlobBatch; file 2/3 - T235188 (duration: 00m 59s) [production]
11:25 <mobrovac@deploy1001> Synchronized php-1.35.0-wmf.2/includes/Storage/SqlBlobStore.php: SqlBlobStore HOT FIX: remove caching from getBlobBatch; file 1/3 - T235188 (duration: 01m 00s) [production]
11:15 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
11:14 <jbond@cumin1001> START - Cookbook sre.hosts.decommission [production]
10:39 <jdrewniak@deploy1001> Synchronized portals: Wikimedia Portals Update: [[gerrit:544853| Bumping portals to master (T128546)]] (duration: 01m 00s) [production]
10:38 <jdrewniak@deploy1001> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:544853| Bumping portals to master (T128546)]] (duration: 01m 00s) [production]
10:19 <hashar> contint1001 / contint2001 : marking integration/config zuul merger repo readonly: sudo chown -R root:root /srv/zuul/git/integration/config [production]
10:13 <hashar> CI in trouble due to a huge number of changes [production]
10:08 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:06 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
09:51 <Amir1> maintenance script is done [production]
09:35 <moritzm> removing PHP 7.0 from deployment servers [production]
09:20 <Amir1> start of foreachwikiindblist wikidataclient extensions/Wikibase/lib/maintenance/populateSitesTable.php --force-protocol https (T234774) [production]
09:18 <moritzm> installing php7.0 security updates [production]
09:11 <moritzm> installing subversion updates on Stretch (fixes compatibility with security fix for Apache update) [production]
09:07 <moritzm> installing jackson-databind security updates [production]
09:01 <moritzm> installing openjpeg2 security updates [production]
08:52 <godog> roll-restart logstash to apply https://gerrit.wikimedia.org/r/c/operations/puppet/+/544209 [production]
08:34 <Urbanecm> Deploy security patch (T234862) [production]
08:34 <vgutierrez> Switch from nginx to ats-tls on cp2022 - T231627 [production]
08:30 <ema> pool cp4029 with ATS backend T227432 [production]
08:20 <vgutierrez> Switch from nginx to ats-tls on cp2020 - T231627 [production]
08:09 <vgutierrez> Switch from nginx to ats-tls on cp2018 - T231627 [production]