901-950 of 10000 results (25ms)
2020-10-13 §
15:02 <godog> bounce logstash on logstash1007, GC death [production]
14:41 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:39 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:18 <urbanecm@deploy1001> Synchronized wmf-config/CommonSettings.php: 5b28fd685b9cb8d8e93650b5d02bc41b81d0883c: Add setmentor to wgAvailableRights (duration: 00m 59s) [production]
13:42 <jayme@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'push-notifications' for release 'main' . [production]
13:40 <jayme@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'push-notifications' for release 'main' . [production]
13:15 <Urbanecm> [urbanecm@mwmaint2001 ~]$ mwscript namespaceDupes.php --wiki=trwiki --add-prefix=BROKEN --fix # T265336 [production]
13:08 <moritzm> imported php-mailparse, php-mongodb, php-msgpack to component/icu63 T264991 [production]
12:50 <Urbanecm> urbanecm@mwmaint2001:~$ mwscript namespaceDupes.php --wiki=trwiki --add-prefix=FIXME --fix # T265336 [production]
12:49 <Urbanecm> End of `urbanecm@mwmaint2001:~$ mwscript namespaceDupes.php --wiki=trwiki --fix` # T265336 [production]
12:49 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool es2026 for on-site maintenance T263837 ', diff saved to https://phabricator.wikimedia.org/P12975 and previous config saved to /var/cache/conftool/dbconfig/20201013-124940-marostegui.json [production]
12:20 <moritzm> imported dh-php, php-acpu, php-imagick to component/icu63 T264991 [production]
11:22 <moritzm> imported php-defaults, php-excimer, php-luasandbox, php-geoip to component/icu63 T264991 [production]
11:16 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 90028b4c3c1cd4407e0834d603ccb8b256f2498e: Add suppressredirect right to reviewers on bnwiki (T265169) (duration: 00m 58s) [production]
11:14 <Urbanecm> Start of `urbanecm@mwmaint2001:~$ mwscript namespaceDupes.php --wiki=trwiki --fix # T265336` [production]
11:13 <volans> installed spicerack_0.0.43-1+deb10u1_amd64.deb on cumin2001 , need to wait a long-rnning cookbook to end to upgrade both hosts [production]
11:09 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: e61fcebe7315f73d1fb4d531da37d2c1253115ee: Add namespace aliases for Turkish Wikipedia (T265336) (duration: 00m 59s) [production]
10:47 <jayme> no-change rolling restart of push-notifications in codfw - T265258 [production]
10:29 <volans> upgrading spicerack on cumin2001 to 0.0.44 [production]
10:19 <ema> cp3050: clear varnishkafka-webrequest's vut->sighup via stap T264074 [production]
10:09 <ema> cp3050: *reload* varnishkafka-webrequest T264074 [production]
10:04 <volans> uploaded spicerack_0.0.44 to apt.wikimedia.org buster-wikimedia [production]
09:55 <ema> cp3054: systemctl restart varnishkafka-webrequest.service T264074 [production]
09:51 <ema> cp3052: systemctl restart varnishkafka-webrequest.service T264074 [production]
09:38 <kormat> running schema change against s1 in eqiad T259831 [production]
09:38 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:38 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:32 <ema> cp3050: set grouping by request (vut->g_arg = 2) on varnishkafka-webrequest T264074 [production]
08:40 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
08:40 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
08:13 <klausman@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
08:11 <klausman@cumin1001> START - Cookbook sre.hosts.downtime [production]
07:55 <filippo@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
07:55 <filippo@cumin1001> START - Cookbook sre.hosts.downtime [production]
07:43 <kormat> running schema change against s3 in eqiad T259831 [production]
07:43 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
07:43 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
07:37 <moritzm> installing ruby security updates on stretch [production]
07:02 <moritzm> installing PHP 7.0 security updates [production]
06:39 <moritzm> Installing httpcomponents-client security updates for Stretch [production]
05:35 <marostegui> Set global innodb_change_buffering = inserts; on pc2009 T263443 [production]
2020-10-12 §
17:03 <jayme> fixed /var/lock/ permission (1777) on ms-be2036 - T265208 [production]
15:41 <godog> roll-restart logstash5 in codfw [production]
14:44 <_joe_> freed 1.5 GB of space on ms-be2036 by running "apt-get clean" [production]
14:05 <moritzm> uploaded php7.2 7.2.31-1+0~20200514.41+debian9~1.gbpe2a56b+wmf1+icu63 to component/icu63 T264991 [production]
12:39 <moritzm> installing rails security updates on Stretch [production]
12:26 <moritzm> installing spice security updates on Buster [production]
11:38 <Urbanecm> EU B&C done [production]
11:32 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: fff2532424f84970962f7de1e35d4250b83cb3da: [testwiki, test2wiki] Allow bureaucrats to grant import rights (duration: 00m 58s) [production]
11:28 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 4966e8a6b8ae4e6d5623dd35e65ed8fcf3338bc1: Enable wgCheckUserLogLogins at all wikis but few large wikis (T253802) (duration: 00m 58s) [production]