2251-2300 of 10000 results (60ms)
2018-12-20 §
12:48 <kartik@deploy1001> Finished deploy [cxserver/deploy@16f65cb]: Update cxserver to 803baa4 (T210581, T211889, T144467, T209473) (duration: 04m 42s) [production]
12:47 <moritzm> installing libxcursor security updates [production]
12:43 <kartik@deploy1001> Started deploy [cxserver/deploy@16f65cb]: Update cxserver to 803baa4 (T210581, T211889, T144467, T209473) [production]
12:31 <moritzm> installing fuse updates from stretch point release [production]
12:09 <jdrewniak@deploy1001> Synchronized portals: Wikimedia Portals Update: [[gerrit:478659| Bumping portals to master (T128546, T202497)]] (duration: 00m 52s) [production]
12:08 <jdrewniak@deploy1001> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:478659| Bumping portals to master (T128546, T202497)]] (duration: 00m 53s) [production]
12:02 <moritzm> draining restbase1016 for eventual reboot for kernel security update [production]
11:46 <moritzm> draining restbase1015 for eventual reboot for kernel security update [production]
11:34 <moritzm> powercycling restbase1014, similar EFI ASSERT error to T212305 [production]
11:34 <moritzm> powercycling restbase1014, similar EFI ASSEER error to T212305 [production]
11:21 <moritzm> draining restbase1014 for eventual reboot for kernel security update [production]
10:59 <banyek> executing schema change on db1068 (s4 master) - T85757 [production]
10:58 <banyek@deploy1001> Synchronized wmf-config/db-eqiad.php: repool db1121 after schema change - T85757 (duration: 00m 52s) [production]
10:53 <banyek> repooling db1121 after schema change T85757 [production]
10:45 <moritzm> draining restbase1013 for eventual reboot for kernel security update [production]
10:44 <banyek> stopping replication on db1121 - T85757 [production]
10:40 <banyek@deploy1001> Synchronized wmf-config/db-eqiad.php: depool db1121 for schema change - T85757 (duration: 00m 52s) [production]
10:35 <banyek> depooling db1121 for schema change T85757 [production]
10:33 <banyek> executing schema change on dbstore1002 - T85757 [production]
10:22 <banyek> executing schema change on db1102 - T85757 [production]
10:20 <banyek@deploy1001> Synchronized wmf-config/db-eqiad.php: repool db1081 after schema change - T85757 (duration: 00m 51s) [production]
10:19 <moritzm> draining restbase1012 for eventual reboot for kernel security update [production]
10:15 <banyek> repooling db1081 after schema change T85757 [production]
10:10 <banyek@deploy1001> Synchronized wmf-config/db-eqiad.php: depool db1081 for schema change - T85757 (duration: 00m 51s) [production]
10:05 <banyek> depooling db1081 for schema change T85757 [production]
10:00 <banyek@deploy1001> Synchronized wmf-config/db-eqiad.php: repool db1103:3314 after schema change - T85757 (duration: 00m 52s) [production]
09:56 <banyek> repooling db1103:3314 after schema change T85757 [production]
09:49 <banyek@deploy1001> Synchronized wmf-config/db-eqiad.php: depool db1103:3314 for schema change - T85757 (duration: 00m 51s) [production]
09:46 <banyek> depooling db1103:3314 for schema change T85757 [production]
09:45 <banyek@deploy1001> Synchronized wmf-config/db-eqiad.php: repool db1097:3314 after schema change - T85757 (duration: 00m 51s) [production]
09:41 <legoktm@deploy1001> Synchronized php-1.33.0-wmf.8/includes/: T199540 (duration: 01m 06s) [production]
09:40 <legoktm@deploy1001> Synchronized php-1.33.0-wmf.9/includes/: T199540 (duration: 01m 14s) [production]
09:39 <banyek> repooling db1097:3314 after schema change T85757 [production]
09:35 <gilles@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T187299 Increase ruwiki navtiming rate + frwiki survey rate (duration: 00m 52s) [production]
09:29 <banyek@deploy1001> Synchronized wmf-config/db-eqiad.php: depool db1097:3314 for schema change - T85757 (duration: 00m 52s) [production]
09:23 <banyek> depooling db1097:3314 for schema change T85757 [production]
08:05 <elukey> roll restart of druid middlemanagers on druid* to pick up new port settings [production]
07:17 <marostegui> Re-start codfw s4 backup as the previous one failed [production]
07:11 <elukey> restart pdfrender on scb1002 [production]
07:10 <elukey> restart rsyslog on lithium - in:imtcp stuck in recvfrom ms-be2047.codfw.wmnet - T199406 [production]
06:35 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Repool db2057 T212277 (duration: 00m 57s) [production]
01:41 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@c7977a7]: Update mobileapps to 42c011e (duration: 04m 08s) [production]
01:37 <mholloway-shell@deploy1001> Started deploy [mobileapps/deploy@c7977a7]: Update mobileapps to 42c011e [production]
01:09 <eileen_> civicrm revision changed from 9d727e4708 to b33dcd3c94, config revision is 0f94a475b7 [production]
00:09 <maxsem@deploy1001> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/479911/ (duration: 00m 53s) [production]
2018-12-19 §
23:24 <mutante> syncing facts from puppetmaster1001 to compiler1001/compiler1002 [production]
23:21 <eileen_> civicrm revision changed from d5c3d5fd17 to 9d727e4708, config revision is 0f94a475b7 [production]
23:05 <krinkle@deploy1001> Finished deploy [performance/navtiming@64e3f63]: (no justification provided) (duration: 00m 05s) [production]
23:05 <krinkle@deploy1001> Started deploy [performance/navtiming@64e3f63]: (no justification provided) [production]
22:15 <mutante> scb1003: systemctl restart pdfrender [production]