2018-12-07
§
|
15:36 |
<moritzm> |
rebooting sarin/neodymium |
[production] |
14:52 |
<urandom> |
decommissioning cassandra-a, restbase2002 -- T210843 |
[production] |
14:21 |
<godog> |
more weight to new ms-be codfw hosts - T209395 |
[production] |
13:37 |
<moritzm> |
rolling reboot of scb in codfw (along with nodejs update) |
[production] |
12:18 |
<moritzm> |
installing nodejs security updates on stat/notebook |
[production] |
12:05 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@44e0955]: Fix: Encode recommendation api title (duration: 21m 11s) |
[production] |
11:43 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@44e0955]: Fix: Encode recommendation api title |
[production] |
11:42 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@9e4af13]: Fix: Encode recommendation api title (duration: 00m 21s) |
[production] |
11:42 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@9e4af13]: Fix: Encode recommendation api title |
[production] |
11:41 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@9e4af13]: Fix: Encode recommendation api title (duration: 18m 58s) |
[production] |
11:22 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@9e4af13]: Fix: Encode recommendation api title |
[production] |
11:20 |
<moritzm> |
rolling upgrade of nginx on swift frontends |
[production] |
11:19 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@31c44e8]: Fix: Encode recommendation api title (duration: 03m 49s) |
[production] |
11:15 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@31c44e8]: Fix: Encode recommendation api title |
[production] |
11:09 |
<mobrovac@deploy1001> |
Finished deploy [citoid/deploy@269c9c7]: Add an explicit check for Zotero (duration: 06m 19s) |
[production] |
11:03 |
<mobrovac@deploy1001> |
Started deploy [citoid/deploy@269c9c7]: Add an explicit check for Zotero |
[production] |
10:58 |
<mobrovac@deploy1001> |
Finished deploy [citoid/deploy@6b36331]: Add an explicit check for Zotero (duration: 02m 42s) |
[production] |
10:55 |
<mobrovac@deploy1001> |
Started deploy [citoid/deploy@6b36331]: Add an explicit check for Zotero |
[production] |
09:40 |
<banyek> |
importing back linkwatcher_linklog into database s51230__linkwatcher on host labsdb1004.eqiad.wmnet. - T211210 |
[production] |
09:34 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Fully repool db1096:3315, db1096:3316 after kernel and mysql upgrade (duration: 00m 46s) |
[production] |
09:10 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1096:3315, db1096:3316 after kernel and mysql upgrade (duration: 00m 46s) |
[production] |
08:39 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1096:3315, db1096:3316 after kernel and mysql upgrade (duration: 00m 46s) |
[production] |
08:21 |
<marostegui> |
Stop MySQL on db1096:3315,3316 for kernel and mysql upgrade |
[production] |
08:21 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1096:3315, db1096:3316 for kernel and mysql upgrade (duration: 00m 46s) |
[production] |
08:15 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Fully repool db1084 (duration: 00m 47s) |
[production] |
07:59 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Increase traffic for db1084 (duration: 00m 46s) |
[production] |
07:50 |
<godog> |
decommissioning cassandra-c, restbase2001 -- T210843 |
[production] |
07:42 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Increase traffic for db1084 (duration: 00m 46s) |
[production] |
07:23 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1084 (duration: 00m 46s) |
[production] |
07:11 |
<marostegui> |
Stop MySQL on db1084 for mysql and kernel upgrade |
[production] |
07:05 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1084 (duration: 00m 49s) |
[production] |
00:47 |
<XioNoX> |
done troubleshoting bird bfd on dns2001/cr1-codfw |
[production] |
00:10 |
<ebernhardson@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: [[gerrit:478103|turn off wbsearchentities ab test]] T209402 (duration: 00m 47s) |
[production] |
2018-12-06
§
|
23:47 |
<ppchelko@deploy1001> |
Finished deploy [recommendation-api/deploy@299b268]: Add 'morelike' article recommendations API T201192 (duration: 02m 06s) |
[production] |
23:47 |
<XioNoX> |
troubleshoot bird bfd on dns2001/cr1-codfw |
[production] |
23:45 |
<ppchelko@deploy1001> |
Started deploy [recommendation-api/deploy@299b268]: Add 'morelike' article recommendations API T201192 |
[production] |
23:21 |
<ppchelko@deploy1001> |
Finished deploy [restbase/deploy@be8f0c0]: Add 'morelike' recommendation public API specification T201192 (duration: 22m 46s) |
[production] |
22:58 |
<ppchelko@deploy1001> |
Started deploy [restbase/deploy@be8f0c0]: Add 'morelike' recommendation public API specification T201192 |
[production] |
22:12 |
<urandom> |
decommissioning cassandra-b, restbase2001 -- T210843 |
[production] |
21:39 |
<gtirloni> |
reimaging cloudvirt1019 with jessie T196507 |
[production] |
21:33 |
<ppchelko@deploy1001> |
Finished deploy [changeprop/deploy@f675fcc]: Added performer to the revision-scores event (duration: 01m 15s) |
[production] |
21:32 |
<ppchelko@deploy1001> |
Started deploy [changeprop/deploy@f675fcc]: Added performer to the revision-scores event |
[production] |
21:07 |
<smalyshev@deploy1001> |
Finished deploy [wdqs/wdqs@cbe4551]: Install new Updater with INSERT DATA (duration: 09m 18s) |
[production] |
21:00 |
<XioNoX> |
remove 2 esams avoid path + 4 prefered/selected transits - T194542 |
[production] |
20:58 |
<smalyshev@deploy1001> |
Started deploy [wdqs/wdqs@cbe4551]: Install new Updater with INSERT DATA |
[production] |
20:51 |
<XioNoX> |
remove 2 eqiad avoid path - T194542 |
[production] |
20:48 |
<gtirloni> |
reimaging cloudvirt1019 with stretch T196507 |
[production] |
20:45 |
<XioNoX> |
remove codfw/eqdfw avoid path - T194542 |
[production] |
19:32 |
<gehel> |
shutting down elasticsearch on elastic2001-2024 (third time is a charm) - T211023 |
[production] |
18:21 |
<mholloway-shell@deploy1001> |
Finished deploy [mobileapps/deploy@1dba3cd]: Internally promisify page processing steps (T202642) (duration: 03m 54s) |
[production] |