51-100 of 10000 results (31ms)
2017-02-02 ยง
21:50 <gehel> reimaging relforge1002.eqiad.wmnet [production]
20:35 <mutante> carbon - disabling puppet (to stop it from re-adding second IPv6 address causing issues with ferm rules) [production]
20:17 <twentyafterfour@tin> rebuilt wikiversions.php and synchronized wikiversions files: group2 wikis to 1.29.0-wmf.9 [production]
20:14 <twentyafterfour> rolling back to wmf.9 due to T156996 [production]
20:10 <twentyafterfour@tin> rebuilt wikiversions.php and synchronized wikiversions files: all wikis to 1.29.0-wmf.10 [production]
20:04 <twentyafterfour> deploying MediaWiki 1.29.0-wmf.10 to all wikis [production]
19:29 <tgr> reset wikimedia 2FA for jdlrobson [production]
19:24 <tgr> reset wikitech 2FA for jdlrobson [production]
19:13 <hashar> Gracefully restarting Jenkins [production]
19:09 <ejegg> updated fundraising tools from 931c8cf1db720723f90307f6a417184bd8c03bfc to 8a65e38807397d91a78f94cfb8013552d75d9772 [production]
19:03 <ejegg> re-enabled thank you mail job [production]
18:59 <ejegg> disabled thank you mail job [production]
18:04 <bsitzmann@tin> Finished deploy [mobileapps/deploy@09101f7]: try previous deploy again (at least on canary) (duration: 00m 51s) [production]
18:03 <bsitzmann@tin> Started deploy [mobileapps/deploy@09101f7]: try previous deploy again (at least on canary) [production]
18:01 <bearND> ^ reverted previous deploy due to incorrect links in the news endpoint [production]
18:00 <bsitzmann@tin> Finished deploy [mobileapps/deploy@09101f7]: (no justification provided) (duration: 01m 56s) [production]
17:58 <bsitzmann@tin> Started deploy [mobileapps/deploy@09101f7]: (no justification provided) [production]
17:56 <jynus> upgrade & restart of db2059 T111654 [production]
17:43 <jynus> upgrade & restart of db2052 T111654 [production]
17:32 <mobrovac> restbase deploy end of 634faea2 [production]
17:08 <mobrovac> restbase deploying 634faea2 [production]
16:56 <reedy@tin> Synchronized php-1.29.0-wmf.10/extensions/ConfirmEdit/maintenance/GenerateFancyCaptchas.php: Fix inclusion path (duration: 00m 41s) [production]
16:24 <elukey> reboot mc2019->mc2025 to see if they come up cleanly (currently codfw replicas of eqiad redis shards) [production]
16:13 <elukey> rebooting mc202[6789] (not serving any traffic) to see if they come up cleanly [production]
16:00 <elukey> rebooting mc203[01234] (not serving any traffic) to see if they come up cleanly [production]
15:43 <moritzm> upgrading firejail on remaining app servers [production]
15:35 <moritzm> upgrading firejail on wtp1001 [production]
15:15 <moritzm> upgrading firejail on eqiad imagescalers [production]
15:11 <elukey> rebooting mc203[56] (not taking any traffic) to test if they come up cleanly [production]
15:01 <elukey> Replace Redis/Memcached shards mc200[4567] with mc202[2345] [production]
14:51 <godog> manually fail sdc on graphite1001 - T157022 [production]
14:23 <addshore> EU SWAT really finished [production]
14:23 <addshore@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT [[gerrit:334997|Create Wikiprojekti namespace on Finnish Wikipedia]] T156621 (duration: 00m 41s) [production]
14:14 <addshore> EU SWAT finished [production]
14:14 <addshore@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT [[gerrit:335481|Add Wikinews languages (en, pt, ca, fr, de, it) as import sources on eswikinews]] T156737 (duration: 00m 40s) [production]
14:10 <addshore@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT [[gerrit:324489|Enable ElectronPdfService extension on dewiki]] T150942 (duration: 00m 41s) [production]
12:53 <gehel> starting reimage to jessie of elasticsearch relforge - T151326 [production]
11:59 <joal@tin> Finished deploy [analytics/refinery@bc4b4ed]: (no justification provided) (duration: 01m 14s) [production]
11:58 <joal@tin> Started deploy [analytics/refinery@bc4b4ed]: (no justification provided) [production]
11:40 <elukey> Swap mc2002 with mc2020, mc2003 with mc2021 (Redis codfw replicas) - T155755 [production]
11:35 <joal@tin> Finished deploy [analytics/refinery@bc4b4ed]: (no justification provided) (duration: 03m 03s) [production]
11:32 <joal@tin> Started deploy [analytics/refinery@bc4b4ed]: (no justification provided) [production]
10:53 <elukey> Swap mc2001 with mc2019 (Redis codfw replicas) - T155755 [production]
10:34 <moritzm> restarted hadoop-mapreduce-historyserver on analytics1001 [production]
10:23 <moritzm> rolling restart of nginx tls terminators running on mw* application servers in eqiad to pick up openssl 1.1 update [production]
09:54 <moritzm> rolling restart of logstash cluster to pick up openjdk/NSS security updates [production]
09:19 <jynus> deploying schema change to page_assessments_projects on enwikivoyage T156305 [production]
09:18 <moritzm> uograding remaining canary servers to new HHVM packages [production]
09:17 <marostegui> Remove dbstore1001:/srv/tmp/db1063.tar.gz after it has been transferred to db1095:/srv/tmp/db1063.tar.gz to get more disk space [production]
08:57 <jynus> deploying schema change to page_assessments_projects on enwiki T156305 [production]