2018-05-02
§
|
13:58 |
<gilles> |
End of mid-day EU SWAT |
[production] |
13:49 |
<ottomata> |
beginning upgrade of kafka-jumbo brokers from 1.0.0 -> 1.1.0 : T193495 |
[production] |
13:47 |
<vgutierrez> |
Update puppet compiler facts |
[production] |
13:40 |
<vgutierrez> |
Repool lvs2001 - T191897 |
[production] |
13:37 |
<gilles@tin> |
Synchronized wmf-config/InitialiseSettings.php: T187299 Add performance perception QuickSurvey definition (duration: 01m 17s) |
[production] |
13:29 |
<elukey> |
upgrade zookeeper to 3.4.9 on druid100[4-6] (wikistats 2 backend) - T164008 |
[production] |
13:20 |
<elukey> |
restart druid broker on druid100[1-3] to enable the 'druid.sql.enable' feature |
[production] |
13:15 |
<gilles> |
T193225 mwscript namespaceDupes.php --wiki=euwikisource --fix |
[production] |
13:13 |
<gilles@tin> |
Synchronized wmf-config/InitialiseSettings.php: T193225 Add Author namespace on eu.wikisource (duration: 01m 20s) |
[production] |
13:05 |
<gilles> |
Starting mid-day EU SWAT |
[production] |
13:01 |
<moritzm> |
re-attempting to reimage mw1250, mw1254, mw1255 (app servers) to stretch, those ran into a timeout earlier which is now fixed in the reimage script |
[production] |
12:48 |
<moritzm> |
reimaging mw1340, mw1341, mw1342 (API servers) to stretch |
[production] |
12:17 |
<vgutierrez> |
Depool and reimage lvs2001 as stretch - T191897 |
[production] |
11:41 |
<vgutierrez> |
Repool lvs2002 - T191897 |
[production] |
11:12 |
<jynus> |
stopping db1064 for cloning to db1121 (will create temporary lag on commons wikireplicas) |
[production] |
11:02 |
<kartik@tin> |
Finished deploy [cxserver/deploy@0aa3532]: Update cxserver to a20bf75 (duration: 06m 01s) |
[production] |
10:56 |
<kartik@tin> |
Started deploy [cxserver/deploy@0aa3532]: Update cxserver to a20bf75 |
[production] |
10:48 |
<moritzm> |
reimaging mw2200 to stretch |
[production] |
10:30 |
<moritzm> |
installing openjdk-8 security updates on stat hosts |
[production] |
10:25 |
<vgutierrez> |
Depool and reimage lvs2002 as stretch - T191897 |
[production] |
10:21 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1064 (duration: 01m 17s) |
[production] |
10:17 |
<vgutierrez> |
Repool lvs2003 - T191897 |
[production] |
09:10 |
<vgutierrez> |
Depool lvs2003 and reimage as stretch - T191897 |
[production] |
08:54 |
<moritzm> |
reimaging mw1250, mw1254, mw1255 (app servers) to stretch |
[production] |
08:36 |
<moritzm> |
reimaging mw1228, mw1229, mw1230 to stretch (those were logged to SAL before, but failed with IPMI issues before) |
[production] |
08:22 |
<ema> |
varnish 5.1.3-1wm8 uploaded to apt.w.o T192368 |
[production] |
08:11 |
<elukey> |
upgrading Druid to 0.10 on druid100[4-6] (wikistats 2 backend) - T164008 |
[production] |
07:42 |
<elukey> |
remove openjdk-7 related packages from druid100[1-3] after zookeeper upgrade |
[production] |
07:36 |
<gehel> |
elasticsearch eqiad rolling restart for plugin update and NUMA config - T191543 / T191236 |
[production] |
07:31 |
<elukey> |
upgrade zookeeper on druid100[1-3] to 3.4.9 - T164008 |
[production] |
07:27 |
<jynus> |
restart db1098 for upgrade and validation |
[production] |
02:44 |
<l10nupdate@tin> |
scap sync-l10n completed (1.32.0-wmf.1) (duration: 07m 11s) |
[production] |
00:17 |
<ebernhardson> |
start reindex for commonswiki, eqiad elasticsearch, commonswiki_general appears to have failed previous reindex |
[production] |
2018-05-01
§
|
22:29 |
<ejegg> |
updated CiviCRM from 46883844a3 to 401344fb30 |
[production] |
22:19 |
<andrewbogott> |
rebooting labnet1002 for T193579 |
[production] |
22:04 |
<krinkle@tin> |
Synchronized php-1.32.0-wmf.1/extensions/EducationProgram/resources/: I7ca59823ffbf2 (duration: 01m 16s) |
[production] |
22:01 |
<awight@tin> |
Finished deploy [ores/deploy@bf182e2]: Rollback ores1001 to master (duration: 01m 13s) |
[production] |
22:00 |
<awight@tin> |
Started deploy [ores/deploy@bf182e2]: Rollback ores1001 to master |
[production] |
21:57 |
<krinkle@tin> |
Synchronized php-1.32.0-wmf.1/includes/libs/rdbms/: Iba663c58224af9 (duration: 01m 19s) |
[production] |
21:54 |
<awight@tin> |
Finished deploy [ores/deploy@52347e0]: Test LFS deployment for ORES; T180627 (duration: 03m 21s) |
[production] |
21:50 |
<awight@tin> |
Started deploy [ores/deploy@52347e0]: Test LFS deployment for ORES; T180627 |
[production] |
21:48 |
<awight@tin> |
Finished deploy [ores/deploy@4601497]: Test LFS deployment for ORES; T180627 (duration: 00m 26s) |
[production] |
21:48 |
<awight@tin> |
Started deploy [ores/deploy@4601497]: Test LFS deployment for ORES; T180627 |
[production] |
21:48 |
<awight@tin> |
Started deploy [ores/deploy@4601497]: Test LFS deployment for ORES; T180627 |
[production] |
21:44 |
<demon@tin> |
Finished scap: group0 to wmf.2 (duration: 68m 18s) |
[production] |
21:42 |
<XioNoX> |
re-enabling eqsin-codfw link |
[production] |
21:23 |
<urandom> |
restbase: begin culling leaked revisions, enwiki_T_mobile__ng_{lead,remaining} - T192689 |
[production] |
20:43 |
<urandom> |
restbase: begin culling leaked revisions, commons_T_mobile__ng_remaining - T192689 |
[production] |
20:35 |
<demon@tin> |
Started scap: group0 to wmf.2 |
[production] |
20:35 |
<ebernhar|lunch> |
update stale apifeatureusage-search-svc-eqiad-wmnet template in eqiad elasticsearch and delete unused apifeatureusage template |
[production] |