601-650 of 10000 results (40ms)
2017-05-05 ยง
15:30 <jynus> running schema change on puppet.fact_values (m1) [production]
15:28 <marostegui> Deploy alter table on wikidatawiki.wb_terms - db2045 - https://phabricator.wikimedia.org/T162539 https://phabricator.wikimedia.org/T163548 [production]
15:28 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2052, depool db2045 - T162539 T163548 (duration: 00m 41s) [production]
15:18 <elukey> increase nginx error log verbosity on mw2146 as test for T163674 (correct task) [production]
15:13 <elukey> increase nginx error log verbosity on mw2146 as test for T164586 [production]
15:04 <bblack> nginx upgrading to 1.11.10-1+wmf1 on cache_upload [production]
14:59 <bblack> nginx upgrading to 1.11.10-1+wmf1 on cache_text [production]
14:41 <bblack> restarting all maps+misc varnish frontends for mem sizing update (spread over the next ~1.5h) [production]
14:30 <bblack> restarting varnish frontend on cp4010 (text) for mem size update [production]
13:45 <moritzm> installing remaining freetype security updates [production]
13:40 <akosiaris@tin> Finished deploy [librenms/librenms@c0aa3ca]: Deploy WMF specific pages to librenms (duration: 00m 03s) [production]
13:39 <akosiaris@tin> Started deploy [librenms/librenms@c0aa3ca]: Deploy WMF specific pages to librenms [production]
13:28 <urandom> T163292: bootstrapping Cassandra on restbase1008-c [production]
13:25 <chasemp> labstore1005/1004 'dpkg -i /home/jmm/*deb' for rpcbind fix (these are new security packages from mortizm) [production]
12:34 <akosiaris@tin> Finished deploy [librenms/librenms@9fa1391]: (no justification provided) (duration: 00m 07s) [production]
12:34 <akosiaris@tin> Started deploy [librenms/librenms@9fa1391]: (no justification provided) [production]
12:16 <elukey> reboot kafka1018 for kernel upgrades [production]
11:30 <akosiaris@tin> Finished deploy [librenms/librenms@b25a5e9]: (no justification provided) (duration: 00m 03s) [production]
11:30 <akosiaris@tin> Started deploy [librenms/librenms@b25a5e9]: (no justification provided) [production]
11:29 <moritzm> installing openjdk-8 security updates/cassandra restarts on restbase staging clusters [production]
11:26 <akosiaris@tin> Finished deploy [librenms/librenms@b25a5e9]: (no justification provided) (duration: 00m 02s) [production]
11:26 <akosiaris@tin> Started deploy [librenms/librenms@b25a5e9]: (no justification provided) [production]
11:17 <akosiaris@tin> Finished deploy [librenms/librenms@b25a5e9]: (no justification provided) (duration: 00m 02s) [production]
11:17 <akosiaris@tin> Started deploy [librenms/librenms@b25a5e9]: (no justification provided) [production]
11:09 <akosiaris@tin> Finished deploy [librenms/librenms@b25a5e9]: (no justification provided) (duration: 00m 14s) [production]
11:08 <akosiaris@tin> Started deploy [librenms/librenms@b25a5e9]: (no justification provided) [production]
11:02 <akosiaris@tin> Finished deploy [librenms/librenms@b25a5e9]: (no justification provided) (duration: 00m 23s) [production]
11:02 <akosiaris@tin> Started deploy [librenms/librenms@b25a5e9]: (no justification provided) [production]
11:01 <akosiaris@tin> Finished deploy [librenms/librenms@b25a5e9]: (no justification provided) (duration: 00m 01s) [production]
11:01 <akosiaris@tin> Started deploy [librenms/librenms@b25a5e9]: (no justification provided) [production]
11:01 <akosiaris@tin> Finished deploy [librenms/librenms@b25a5e9]: (no justification provided) (duration: 00m 02s) [production]
11:00 <akosiaris@tin> Started deploy [librenms/librenms@b25a5e9]: (no justification provided) [production]
11:00 <akosiaris@tin> Finished deploy [librenms/librenms@b25a5e9]: (no justification provided) (duration: 00m 03s) [production]
11:00 <akosiaris@tin> Started deploy [librenms/librenms@b25a5e9]: (no justification provided) [production]
10:58 <akosiaris@tin> Finished deploy [librenms/librenms@b25a5e9]: (no justification provided) (duration: 00m 02s) [production]
10:58 <akosiaris@tin> Started deploy [librenms/librenms@b25a5e9]: (no justification provided) [production]
10:57 <akosiaris@tin> Finished deploy [librenms/librenms@b25a5e9]: (no justification provided) (duration: 00m 13s) [production]
10:57 <akosiaris@tin> Started deploy [librenms/librenms@b25a5e9]: (no justification provided) [production]
09:00 <elukey> re-arm keyholder on mira (new scap key added for librenms) [production]
08:48 <elukey> re-arming keyholder on naos [production]
08:46 <godog> swift codfw-prod: ms-be2001 - ms-be2012 weight 700 - T162785 [production]
07:49 <marostegui> Deploy alter table on wikidatawiki.wb_terms - dbstore1002 - https://phabricator.wikimedia.org/T162539 https://phabricator.wikimedia.org/T163548 [production]
07:11 <marostegui> Deploy alter table on wikidatawiki.wb_terms - dbstore2001 - https://phabricator.wikimedia.org/T162539 https://phabricator.wikimedia.org/T163548 [production]
06:45 <ema> starting cache_upload upgrades to varnish 4.1.6-1wm1 [production]
05:55 <marostegui> Deploy alter table on wikidatawiki.wb_terms - db2052 - T162539 T163548 [production]
05:55 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2059, depool db2052 - T162539 T163548 (duration: 00m 40s) [production]
04:21 <mutante> scheduled long downtime for mailman I/O stats on fermium - until we find better ways to deal with the normal spikes causing alerts [production]
02:38 <l10nupdate@tin> ResourceLoader cache refresh completed at Fri May 5 02:38:35 UTC 2017 (duration 5m 14s) [production]
02:33 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.21) (duration: 08m 29s) [production]
01:26 <urandom> T163292: starting bootstrap of restbase1018-b [production]