351-400 of 10000 results (26ms)
2020-07-30 ยง
20:23 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:23 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:09 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
20:09 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:08 <mutante> [wtp2012:~] $ sudo rm -rf /srv/deployment/parsoid/deploy-cache [production]
19:56 <bstorm> Reimported the maj_articles_recents table on the replica and started replication again T257273 [tools.totoazero]
19:41 <mutante> wikistats-dancing-goat - cron service was broken for unknown reason - systemctl start cron - brought it back [wikistats]
19:24 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=wtp2011.codfw.wmnet [production]
19:14 <mforns> finished refinery deploy (for v0.0.132) [analytics]
19:13 <brennen@deploy1001> rebuilt and synchronized wikiversions files: Revert group2 wikis to 1.36.0-wmf.1 [production]
19:10 <brennen@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.36.0-wmf.2 [production]
19:01 <mforns@deploy1001> Finished deploy [analytics/refinery@adb0d09]: Regular analytics weekly train [analytics/refinery@adb0d09b6584a7a26143623cf6173ae8983423e3] (duration: 10m 41s) [production]
18:58 <mutante> imported twig (php-twig) into APT repo [production]
18:50 <mforns@deploy1001> Started deploy [analytics/refinery@adb0d09]: Regular analytics weekly train [analytics/refinery@adb0d09b6584a7a26143623cf6173ae8983423e3] [production]
18:48 <mforns> starting refinery deploy (for v0.0.132) [analytics]
18:34 <Urbanecm> Morning B&C done [production]
18:32 <urbanecm@deploy1001> Synchronized php-1.36.0-wmf.2/extensions/Kartographer/modules/box/Map.js: aa3dbd54f8e422a511e55b5efba6b5f48253dbe7: Disable panning and zooming until ready (T257872) (duration: 01m 06s) [production]
18:27 <mforns> deployed refinery-source v0.0.132 [analytics]
18:24 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 617516: Add import sources for yuewiktionary | https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/617516; 617518: Fix definition of yuewiktionary import sources | https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/617518 # T258913 (duration: 01m 06s) [production]
18:08 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
18:08 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
18:06 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 14ef2ec2956fd8f66be7efb3c5978ac0eda7ce97: sysop_itwiki: Set favicon to Wikimedia_logo_blue.svg (T259243; 2/2) (duration: 01m 06s) [production]
18:04 <urbanecm@deploy1001> Synchronized static/favicon/wmf-blue.ico: 14ef2ec2956fd8f66be7efb3c5978ac0eda7ce97: sysop_itwiki: Set favicon to Wikimedia_logo_blue.svg (T259243; 1/2) (duration: 01m 06s) [production]
17:04 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@d3ab874]: airflow: refinery_drop_hive_partitions: Fix kerberos token passing (duration: 00m 55s) [production]
17:03 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@d3ab874]: airflow: refinery_drop_hive_partitions: Fix kerberos token passing [production]
16:53 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:53 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:53 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:53 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:44 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
16:44 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:44 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
16:44 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:41 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
16:41 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:41 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:40 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
16:40 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:38 <bstorm> removing the *.paws.wmflabs.org SNI name because it won't be used and it might trigger a re-issue of certs T255249 [paws]
16:38 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
16:28 <andrewbogott> added new xlarge ceph-hosted worker nodes: tools-k8s-worker-61, 62, 63, 64, 65, 66. T258663 [tools]
16:19 <bd808> Marked integration-agent-docker-1005 as online after reboot [releng]
16:12 <bd808> Rebooting integration-agent-docker-1005 [releng]
15:53 <bd808> Marked integration-agent-docker-1005 offline in Jenkins to poke at a Puppet failure related to Docker upgrade there [releng]
15:39 <bstorm> upgrading acme-chief to 0.27-1 [paws]
14:30 <moritzm> installing squid security updates [production]
14:04 <volans@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:50 <volans@cumin1001> START - Cookbook sre.dns.netbox [production]
13:47 <vgutierrez> upgrade acme-chief to version 0.27 - T255249 [production]
13:47 <vgutierrez> upload acme-chief 0.27 to apt.wm.o (buster) - T255249 [production]