2017-02-02
ยง
|
23:51 |
<twentyafterfour> |
1.29.0-wmf.10 appears to be stable. Train deployment complete. |
[production] |
23:38 |
<twentyafterfour@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: all wikis to 1.29.0-wmf.10 |
[production] |
23:33 |
<twentyafterfour@tin> |
Synchronized php-1.29.0-wmf.10/includes/cache/MessageCache.php: deploy I5b84b1ae4a9c7b710ee452c61d7d9d6076ec9e6a refs T156996 (duration: 00m 45s) |
[production] |
23:11 |
<greg-g> |
Gerrit: we'll be flushing session caches momentarily, sorry for the inconvenience |
[production] |
21:50 |
<gehel> |
reimaging relforge1002.eqiad.wmnet |
[production] |
20:35 |
<mutante> |
carbon - disabling puppet (to stop it from re-adding second IPv6 address causing issues with ferm rules) |
[production] |
20:17 |
<twentyafterfour@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group2 wikis to 1.29.0-wmf.9 |
[production] |
20:14 |
<twentyafterfour> |
rolling back to wmf.9 due to T156996 |
[production] |
20:10 |
<twentyafterfour@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: all wikis to 1.29.0-wmf.10 |
[production] |
20:04 |
<twentyafterfour> |
deploying MediaWiki 1.29.0-wmf.10 to all wikis |
[production] |
19:29 |
<tgr> |
reset wikimedia 2FA for jdlrobson |
[production] |
19:24 |
<tgr> |
reset wikitech 2FA for jdlrobson |
[production] |
19:13 |
<hashar> |
Gracefully restarting Jenkins |
[production] |
19:09 |
<ejegg> |
updated fundraising tools from 931c8cf1db720723f90307f6a417184bd8c03bfc to 8a65e38807397d91a78f94cfb8013552d75d9772 |
[production] |
19:03 |
<ejegg> |
re-enabled thank you mail job |
[production] |
18:59 |
<ejegg> |
disabled thank you mail job |
[production] |
18:04 |
<bsitzmann@tin> |
Finished deploy [mobileapps/deploy@09101f7]: try previous deploy again (at least on canary) (duration: 00m 51s) |
[production] |
18:03 |
<bsitzmann@tin> |
Started deploy [mobileapps/deploy@09101f7]: try previous deploy again (at least on canary) |
[production] |
18:01 |
<bearND> |
^ reverted previous deploy due to incorrect links in the news endpoint |
[production] |
18:00 |
<bsitzmann@tin> |
Finished deploy [mobileapps/deploy@09101f7]: (no justification provided) (duration: 01m 56s) |
[production] |
17:58 |
<bsitzmann@tin> |
Started deploy [mobileapps/deploy@09101f7]: (no justification provided) |
[production] |
17:56 |
<jynus> |
upgrade & restart of db2059 T111654 |
[production] |
17:43 |
<jynus> |
upgrade & restart of db2052 T111654 |
[production] |
17:32 |
<mobrovac> |
restbase deploy end of 634faea2 |
[production] |
17:08 |
<mobrovac> |
restbase deploying 634faea2 |
[production] |
16:56 |
<reedy@tin> |
Synchronized php-1.29.0-wmf.10/extensions/ConfirmEdit/maintenance/GenerateFancyCaptchas.php: Fix inclusion path (duration: 00m 41s) |
[production] |
16:24 |
<elukey> |
reboot mc2019->mc2025 to see if they come up cleanly (currently codfw replicas of eqiad redis shards) |
[production] |
16:13 |
<elukey> |
rebooting mc202[6789] (not serving any traffic) to see if they come up cleanly |
[production] |
16:00 |
<elukey> |
rebooting mc203[01234] (not serving any traffic) to see if they come up cleanly |
[production] |
15:43 |
<moritzm> |
upgrading firejail on remaining app servers |
[production] |
15:35 |
<moritzm> |
upgrading firejail on wtp1001 |
[production] |
15:15 |
<moritzm> |
upgrading firejail on eqiad imagescalers |
[production] |
15:11 |
<elukey> |
rebooting mc203[56] (not taking any traffic) to test if they come up cleanly |
[production] |
15:01 |
<elukey> |
Replace Redis/Memcached shards mc200[4567] with mc202[2345] |
[production] |
14:51 |
<godog> |
manually fail sdc on graphite1001 - T157022 |
[production] |
14:23 |
<addshore> |
EU SWAT really finished |
[production] |
14:23 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT [[gerrit:334997|Create Wikiprojekti namespace on Finnish Wikipedia]] T156621 (duration: 00m 41s) |
[production] |
14:14 |
<addshore> |
EU SWAT finished |
[production] |
14:14 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT [[gerrit:335481|Add Wikinews languages (en, pt, ca, fr, de, it) as import sources on eswikinews]] T156737 (duration: 00m 40s) |
[production] |
14:10 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT [[gerrit:324489|Enable ElectronPdfService extension on dewiki]] T150942 (duration: 00m 41s) |
[production] |
12:53 |
<gehel> |
starting reimage to jessie of elasticsearch relforge - T151326 |
[production] |
11:59 |
<joal@tin> |
Finished deploy [analytics/refinery@bc4b4ed]: (no justification provided) (duration: 01m 14s) |
[production] |
11:58 |
<joal@tin> |
Started deploy [analytics/refinery@bc4b4ed]: (no justification provided) |
[production] |
11:40 |
<elukey> |
Swap mc2002 with mc2020, mc2003 with mc2021 (Redis codfw replicas) - T155755 |
[production] |
11:35 |
<joal@tin> |
Finished deploy [analytics/refinery@bc4b4ed]: (no justification provided) (duration: 03m 03s) |
[production] |
11:32 |
<joal@tin> |
Started deploy [analytics/refinery@bc4b4ed]: (no justification provided) |
[production] |
10:53 |
<elukey> |
Swap mc2001 with mc2019 (Redis codfw replicas) - T155755 |
[production] |
10:34 |
<moritzm> |
restarted hadoop-mapreduce-historyserver on analytics1001 |
[production] |
10:23 |
<moritzm> |
rolling restart of nginx tls terminators running on mw* application servers in eqiad to pick up openssl 1.1 update |
[production] |
09:54 |
<moritzm> |
rolling restart of logstash cluster to pick up openjdk/NSS security updates |
[production] |