3851-3900 of 10000 results (43ms)
2017-05-08 §
06:31 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Decommission db1024 - T162699 (duration: 00m 39s) [production]
06:30 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Decommission db1024 - T162699 (duration: 00m 39s) [production]
06:18 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2045, depool db2038 - T162539 T163548 (duration: 00m 40s) [production]
05:09 <Amir1> start of cleaning up ores_classification rows for two hours (T159753) [production]
02:27 <l10nupdate@tin> ResourceLoader cache refresh completed at Mon May 8 02:27:37 UTC 2017 (duration 5m 58s) [production]
02:21 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.21) (duration: 08m 25s) [production]
2017-05-07 §
21:09 <elukey> depooled cp4016.ulsfo.wmnet (sudo -i depool from localhost) due to issues with vhtcpd (segfaults in dmesg). [production]
17:20 <andrewbogott> clearing out broken instances in the nova fullstack queue and restarting the tests. [production]
17:12 <andrewbogott> rebooting labservices1002 in hopes of getting its IO unstuck [production]
16:52 <andrewbogott> switching primary designate server from labservices1002 to labservices1001 [production]
16:07 <andrewbogott> restarted designate-central on labservices1002 due to many log messages like 'Deadlock detected. Retrying...' [production]
16:05 <andrewbogott> restarted pdns and pdns-recursor on labcontrol1002 [production]
09:08 <ema> cp4018: restart vhtcpd and varnish services; repool [production]
08:43 <elukey> depooled cp4018.ulsfo.wmnet (sudo -i depool from localhost) due to issues with HTCP) [production]
02:27 <l10nupdate@tin> ResourceLoader cache refresh completed at Sun May 7 02:27:14 UTC 2017 (duration 5m 59s) [production]
02:21 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.21) (duration: 07m 49s) [production]
2017-05-06 §
02:30 <l10nupdate@tin> ResourceLoader cache refresh completed at Sat May 6 02:30:10 UTC 2017 (duration 6m 2s) [production]
02:24 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.21) (duration: 07m 38s) [production]
2017-05-05 §
20:21 <demon@tin> Synchronized scap/scap.cfg: no-op (duration: 00m 39s) [production]
18:54 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool db1070 after maintenance (duration: 00m 40s) [production]
18:21 <mutante> ocg1002 - apt-get clean'ed for disk space [production]
16:09 <jynus> shutting down db1070 for hw maintenance T160392 [production]
16:06 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool db1070 for hw maintenance (duration: 00m 39s) [production]
15:30 <jynus> running schema change on puppet.fact_values (m1) [production]
15:28 <marostegui> Deploy alter table on wikidatawiki.wb_terms - db2045 - https://phabricator.wikimedia.org/T162539 https://phabricator.wikimedia.org/T163548 [production]
15:28 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2052, depool db2045 - T162539 T163548 (duration: 00m 41s) [production]
15:18 <elukey> increase nginx error log verbosity on mw2146 as test for T163674 (correct task) [production]
15:13 <elukey> increase nginx error log verbosity on mw2146 as test for T164586 [production]
15:04 <bblack> nginx upgrading to 1.11.10-1+wmf1 on cache_upload [production]
14:59 <bblack> nginx upgrading to 1.11.10-1+wmf1 on cache_text [production]
14:41 <bblack> restarting all maps+misc varnish frontends for mem sizing update (spread over the next ~1.5h) [production]
14:30 <bblack> restarting varnish frontend on cp4010 (text) for mem size update [production]
13:45 <moritzm> installing remaining freetype security updates [production]
13:40 <akosiaris@tin> Finished deploy [librenms/librenms@c0aa3ca]: Deploy WMF specific pages to librenms (duration: 00m 03s) [production]
13:39 <akosiaris@tin> Started deploy [librenms/librenms@c0aa3ca]: Deploy WMF specific pages to librenms [production]
13:28 <urandom> T163292: bootstrapping Cassandra on restbase1008-c [production]
13:25 <chasemp> labstore1005/1004 'dpkg -i /home/jmm/*deb' for rpcbind fix (these are new security packages from mortizm) [production]
12:34 <akosiaris@tin> Finished deploy [librenms/librenms@9fa1391]: (no justification provided) (duration: 00m 07s) [production]
12:34 <akosiaris@tin> Started deploy [librenms/librenms@9fa1391]: (no justification provided) [production]
12:16 <elukey> reboot kafka1018 for kernel upgrades [production]
11:30 <akosiaris@tin> Finished deploy [librenms/librenms@b25a5e9]: (no justification provided) (duration: 00m 03s) [production]
11:30 <akosiaris@tin> Started deploy [librenms/librenms@b25a5e9]: (no justification provided) [production]
11:29 <moritzm> installing openjdk-8 security updates/cassandra restarts on restbase staging clusters [production]
11:26 <akosiaris@tin> Finished deploy [librenms/librenms@b25a5e9]: (no justification provided) (duration: 00m 02s) [production]
11:26 <akosiaris@tin> Started deploy [librenms/librenms@b25a5e9]: (no justification provided) [production]
11:17 <akosiaris@tin> Finished deploy [librenms/librenms@b25a5e9]: (no justification provided) (duration: 00m 02s) [production]
11:17 <akosiaris@tin> Started deploy [librenms/librenms@b25a5e9]: (no justification provided) [production]
11:09 <akosiaris@tin> Finished deploy [librenms/librenms@b25a5e9]: (no justification provided) (duration: 00m 14s) [production]
11:08 <akosiaris@tin> Started deploy [librenms/librenms@b25a5e9]: (no justification provided) [production]
11:02 <akosiaris@tin> Finished deploy [librenms/librenms@b25a5e9]: (no justification provided) (duration: 00m 23s) [production]