1151-1200 of 10000 results (26ms)
2020-10-13 §
10:09 <ema> cp3050: *reload* varnishkafka-webrequest T264074 [production]
10:04 <volans> uploaded spicerack_0.0.44 to apt.wikimedia.org buster-wikimedia [production]
09:55 <ema> cp3054: systemctl restart varnishkafka-webrequest.service T264074 [production]
09:51 <ema> cp3052: systemctl restart varnishkafka-webrequest.service T264074 [production]
09:38 <kormat> running schema change against s1 in eqiad T259831 [production]
09:38 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:38 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:32 <ema> cp3050: set grouping by request (vut->g_arg = 2) on varnishkafka-webrequest T264074 [production]
08:40 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
08:40 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
08:13 <klausman@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
08:11 <klausman@cumin1001> START - Cookbook sre.hosts.downtime [production]
07:55 <filippo@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
07:55 <filippo@cumin1001> START - Cookbook sre.hosts.downtime [production]
07:43 <kormat> running schema change against s3 in eqiad T259831 [production]
07:43 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
07:43 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
07:37 <moritzm> installing ruby security updates on stretch [production]
07:02 <moritzm> installing PHP 7.0 security updates [production]
06:39 <moritzm> Installing httpcomponents-client security updates for Stretch [production]
05:35 <marostegui> Set global innodb_change_buffering = inserts; on pc2009 T263443 [production]
2020-10-12 §
17:03 <jayme> fixed /var/lock/ permission (1777) on ms-be2036 - T265208 [production]
15:41 <godog> roll-restart logstash5 in codfw [production]
14:44 <_joe_> freed 1.5 GB of space on ms-be2036 by running "apt-get clean" [production]
14:05 <moritzm> uploaded php7.2 7.2.31-1+0~20200514.41+debian9~1.gbpe2a56b+wmf1+icu63 to component/icu63 T264991 [production]
12:39 <moritzm> installing rails security updates on Stretch [production]
12:26 <moritzm> installing spice security updates on Buster [production]
11:38 <Urbanecm> EU B&C done [production]
11:32 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: fff2532424f84970962f7de1e35d4250b83cb3da: [testwiki, test2wiki] Allow bureaucrats to grant import rights (duration: 00m 58s) [production]
11:28 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 4966e8a6b8ae4e6d5623dd35e65ed8fcf3338bc1: Enable wgCheckUserLogLogins at all wikis but few large wikis (T253802) (duration: 00m 58s) [production]
11:27 <hnowlan@cumin1001> END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) [production]
11:18 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:631809|Require autoconfirmed status to edit Wikidata Properties (T254280)]] (duration: 01m 00s) [production]
10:26 <hnowlan@cumin1001> START - Cookbook sre.cassandra.roll-restart [production]
10:26 <hnowlan> roll-restarting restbase201[345678] for cert refresh [production]
08:50 <moritzm> uploaded libxml2 2.9.4+dfsg1-2.2+deb9u3+wmf1 to component/icu63 T264991 [production]
07:54 <godog> reboot ms-be2036 - T265208 [production]
07:53 <filippo@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
07:53 <filippo@cumin1001> START - Cookbook sre.hosts.downtime [production]
07:53 <filippo@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
07:53 <filippo@cumin1001> START - Cookbook sre.hosts.downtime [production]
2020-10-10 §
01:32 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:633281|Enable session-ip log channel everywhere (T264799)]] (duration: 00m 59s) [production]
00:54 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:633277|Enable session-ip log channel on all but enwiki (T264799)]] (duration: 01m 01s) [production]
00:18 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:633276|Enable session-ip log channel on eswiki (T264799)]] (duration: 00m 55s) [production]
00:13 <mutante> built prometheus-nutcracker-exporter for buster and imported on apt1001 (0.2+nmu1) [production]
2020-10-09 §
23:44 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:633274|Enable session-ip log channel on Wikidata (T264799)]] (duration: 00m 59s) [production]
23:25 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:633272|Enable session-ip log channel on Commons (T264799)]] (duration: 00m 59s) [production]
23:13 <mutante> maps2010 is down since almost 3 days - unhandled crit alert but nothing in SAL and only related ticket says resolved - powercycling it - boots normal but doesn't have a prod role (T260271) [production]
23:07 <mutante> maps2010 is down since almost 3 days - unhandled crit alert but nothing in SAL or tickets [production]
23:06 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
23:06 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]