2201-2250 of 10000 results (60ms)
2019-06-07 §
09:16 <mobrovac@deploy1001> scap-helm mathoid upgrade production stable/mathoid -f mathoid-values.yaml [namespace: mathoid, clusters: eqiad,codfw] [production]
09:00 <marostegui> Upgrade x1 codfw hosts in preparation for its failover T220170 [production]
08:46 <elukey> start the reboot of the Analytics Hadoop's worker nodes for kernel+openjdk upgrades [production]
08:24 <marostegui> Upgrade s2 codfw to 10.1.39 in preparation for its codfw failover - T221533 [production]
08:19 <XioNoX> remove BGP session to AS55658 on cr1-eqsin (left the IXP) [production]
08:12 <vgutierrez> upgrading certbot in wikitech-static [production]
07:29 <marostegui> Drop unused temporary test tables on db1111 and db1112 [production]
05:40 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Move db2051 from s4 to s2T221533 (duration: 00m 49s) [production]
00:00 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: Remove unused preference T47877-buster (duration: 00m 47s) [production]
00:00 <bstorm_> T224850 repooled labsdb1009 after completing view updates [production]
2019-06-06 §
23:57 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: Specify the fluidsynth paths for TMH MIDI conversion T135597 (duration: 00m 47s) [production]
23:56 <jforrester@deploy1001> Synchronized wmf-config/Wikibase.php: Remove T225183 (duration: 00m 48s) [production]
23:03 <jeh> T224850 depooled labsdb1009 [production]
22:42 <bstorm_> T224850 repooled labsdb1011 [production]
21:01 <bstorm_> T224850 depooled labsdb1011 [production]
20:58 <jforrester@deploy1001> Synchronized wmf-config/reverse-proxy.php: Stop setting wgSquidServersNoPurge, MW now uses wgCdnServersNoPurge (duration: 00m 47s) [production]
20:57 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Stop setting wgSquidMaxage, MW now uses wgCdnMaxAge (duration: 00m 46s) [production]
20:55 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: Stop setting wgUseSquid or using wgSquidServersNoPurge, duplicate existing values (duration: 00m 48s) [production]
20:49 <jforrester@deploy1001> Synchronized wmf-config/Wikibase.php: Drop backwards-compatibility for dataSquidMaxage (duration: 00m 48s) [production]
19:47 <herron> performing rolling reboot of eqiad logstash hw for MDS security updates [production]
18:58 <jbond42> reimage sarin to stretch [production]
18:39 <jbond42> mw1249 - sudo systemctl restart php7.2-fpm.service [production]
18:38 <papaul> shutting down backup2001 for 10G nic troubleshooting [production]
18:24 <bstorm_> T224850 repooled labsdb1010 after completing view run [production]
18:04 <jijiki> Continuing rolling restarts of php-fpm in eqiad [production]
17:30 <elukey> restart mcrouter on mw2271 (codfw proxy) to pick up new config changes [production]
15:56 <bstorm_> T224850 depooled labsdb1010 for view updates [production]
15:28 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:28 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
15:06 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:05 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
15:05 <moritzm> rolling reboot of sessionstore hosts in eqiad for kernel security update [production]
15:02 <_joe_> rolling restart of php-fpm on {appservers,api} in eqiad, in groups of 4, staggered by 10 minutes, to pick up the new opcache settings [production]
14:57 <bstorm_> T224850 update views on labsdb1012 [production]
14:43 <moritzm> updating qemu packages on ganeti hosts to deploy support for md_clear/MDS for Ganeti instances [production]
14:43 <elukey> restart mcrouter on mw2255 (codfw proxy) to pick up new config changes [production]
14:22 <dcausse@deploy1001> Synchronized wmf-config/CirrusSearch-common.php: fix logspam (duration: 00m 48s) [production]
14:18 <gehel@cumin1001> END (PASS) - Cookbook sre.wdqs.restart-wdqs (exit_code=0) [production]
13:54 <dcausse@deploy1001> Synchronized wmf-config/CirrusSearch-production.php: fix logspam (duration: 00m 47s) [production]
13:44 <moritzm> rolling reboot of sessionstore hosts in codfw for kernel security update [production]
13:44 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:44 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
13:36 <gehel@cumin1001> START - Cookbook sre.wdqs.restart-wdqs [production]
13:35 <zfilipin@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.34.0-wmf.8 [production]
13:35 <gehel@cumin1001> END (FAIL) - Cookbook sre.wdqs.restart-wdqs (exit_code=99) [production]
13:35 <gehel@cumin1001> START - Cookbook sre.wdqs.restart-wdqs [production]
13:34 <gehel@cumin1001> END (PASS) - Cookbook sre.wdqs.restart-wdqs (exit_code=0) [production]
13:33 <gehel@cumin1001> START - Cookbook sre.wdqs.restart-wdqs [production]
13:32 <gehel@cumin1001> END (PASS) - Cookbook sre.wdqs.restart-wdqs (exit_code=0) [production]
13:31 <gehel@cumin1001> START - Cookbook sre.wdqs.restart-wdqs [production]