3201-3250 of 10000 results (76ms)
2019-11-12 §
14:16 <Jeff_Green> authdns-update to deploy fundraising-read.wmnet service cname adjustment [production]
14:01 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Revert "Set all of wikidata for write both for term store" (duration: 00m 52s) [production]
12:57 <godog> refresh kibana field list [production]
12:46 <gehel> repool wdqs1004 [production]
12:37 <Amir1> ladsgroup@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/rebuildPropertyTerms.php --wiki=wikidatawiki --batch-size 100 (T237984) [production]
12:19 <onimisionipe> restarting blazegraph on wdqs1005 [production]
12:11 <effie> Reimage mwdebug1002 - T214734 [production]
11:47 <Amir1> EU SWAT is done [production]
11:47 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.4/extensions/Wikibase: Wikibase term store error reduction, [[gerrit:550441|Do not catch DBError in ReplicaMasterAwareRecordIdsAcquirer.]] (T236466) (duration: 00m 56s) [production]
11:44 <effie> Upgrade wtp* to 7.2.24-1 with elegance and restart php-fpm - T237239 [production]
11:20 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:548584|Set all of wikidata for write both for term store (T225055)]] (duration: 00m 52s) [production]
11:05 <urbanecm@deploy1001> Synchronized wmf-config/CommonSettings.php: SECURITY: Dont allow Wikimedia sysops to see who had 2FA disabled (duration: 00m 53s) [production]
10:44 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1083', diff saved to https://phabricator.wikimedia.org/P9599 and previous config saved to /var/cache/conftool/dbconfig/20191112-104400-marostegui.json [production]
10:36 <marostegui@cumin1001> dbctl commit (dc=all): 'More traffic to db1083', diff saved to https://phabricator.wikimedia.org/P9598 and previous config saved to /var/cache/conftool/dbconfig/20191112-103641-marostegui.json [production]
10:35 <onimisionipe> resetting cronfile on wdqs hosts [production]
10:33 <marostegui> Drop labtestwiki database from m5 master db1133 - T236010 [production]
10:30 <marostegui> Deploy schema change on dbstore1003:3315 [production]
10:06 <ema> repool cp3065, nothing interesting in kern.log and SEL T238032 [production]
09:52 <marostegui@cumin1001> dbctl commit (dc=all): 'More traffic to db1083', diff saved to https://phabricator.wikimedia.org/P9596 and previous config saved to /var/cache/conftool/dbconfig/20191112-095221-marostegui.json [production]
09:42 <marostegui> Remove privileges for labtestwiki on m5 - T236010 [production]
09:27 <gehel> restarting blazegraph on wdqs1004 [production]
09:17 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1083', diff saved to https://phabricator.wikimedia.org/P9595 and previous config saved to /var/cache/conftool/dbconfig/20191112-091706-marostegui.json [production]
09:11 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1083 for mariadb upgrade to 10.1.39 - T234800', diff saved to https://phabricator.wikimedia.org/P9594 and previous config saved to /var/cache/conftool/dbconfig/20191112-091158-marostegui.json [production]
09:11 <marostegui> Upgrade mariadb to 10.1.39 on db1083 (candidate master for s1) [production]
08:56 <moritzm> restarting archiva to pick up Java security updates [production]
08:44 <volker-e@deploy1001> Finished deploy [design/style-guide@3de6820]: Deploy design/style-guide: (duration: 00m 06s) [production]
08:44 <volker-e@deploy1001> Started deploy [design/style-guide@3de6820]: Deploy design/style-guide: [production]
08:37 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1083', diff saved to https://phabricator.wikimedia.org/P9593 and previous config saved to /var/cache/conftool/dbconfig/20191112-083720-marostegui.json [production]
08:37 <gehel> depool wdqs1004 to investigate update lag [production]
08:35 <moritzm> installing poppler security updates [production]
08:24 <volker-e@deploy1001> Finished deploy [design/style-guide@b926b95]: Deploy design/style-guide: (duration: 00m 07s) [production]
08:24 <volker-e@deploy1001> Started deploy [design/style-guide@b926b95]: Deploy design/style-guide: [production]
08:15 <moritzm> installing curl security updates [production]
08:13 <marostegui@cumin1001> dbctl commit (dc=all): 'Increase traffic to db1083', diff saved to https://phabricator.wikimedia.org/P9592 and previous config saved to /var/cache/conftool/dbconfig/20191112-081322-marostegui.json [production]
07:40 <marostegui@cumin1001> dbctl commit (dc=all): 'Increase traffic to db1083', diff saved to https://phabricator.wikimedia.org/P9591 and previous config saved to /var/cache/conftool/dbconfig/20191112-074006-marostegui.json [production]
07:36 <elukey> remove /etc/logrotate.d/wdqs_autodeployment_log from wdqs1009 (not in puppet anymore and causing cronspam) [production]
07:28 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1083 after kernel upgrade', diff saved to https://phabricator.wikimedia.org/P9590 and previous config saved to /var/cache/conftool/dbconfig/20191112-072823-marostegui.json [production]
07:10 <marostegui> Upgrade kernel on db1083 (s1 candidate master) [production]
07:04 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1083 for kernel upgrade - T234800', diff saved to https://phabricator.wikimedia.org/P9589 and previous config saved to /var/cache/conftool/dbconfig/20191112-070436-marostegui.json [production]
06:58 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
06:57 <marostegui@cumin1001> START - Cookbook sre.hosts.decommission [production]
06:44 <marostegui> Change triggers on s5 db2094 - T234704 [production]
06:40 <marostegui> Deploy schema change on s5 codfw with replication, this will generate lag on s5 codfw T233135 T234066 [production]
06:21 <marostegui> Compress db2087:3316, db2087:3317 T235599 [production]
06:20 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2087:3316, db2087:3317 for compression - T235599', diff saved to https://phabricator.wikimedia.org/P9588 and previous config saved to /var/cache/conftool/dbconfig/20191112-061959-marostegui.json [production]
03:41 <vgutierrez> restart wdqs-blazegraph on wdqs1004 [production]
2019-11-11 §
22:51 <ema@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp3065.esams.wmnet [production]
22:49 <ema> power-cycle cp3065, currently down [production]
19:36 <XioNoX> disable ALGs on mr1-esams [production]
18:20 <onimisionipe@deploy1001> Finished deploy [wdqs/wdqs@222b1c2]: New WDQS build - 0.3.6-SNAPSHOT (duration: 00m 57s) [production]