2017-08-10
ยง
|
19:30 |
<mobrovac@tin> |
Started deploy [cassandra/logstash-logback-encoder@d085ffa] (aqs): first Scap3 deployment - T116340 |
[production] |
19:30 |
<mobrovac@tin> |
Finished deploy [cassandra/logstash-logback-encoder@d085ffa]: first Scap3 deployment - T116340 (duration: 00m 34s) |
[production] |
19:29 |
<mobrovac@tin> |
Started deploy [cassandra/logstash-logback-encoder@d085ffa]: first Scap3 deployment - T116340 |
[production] |
19:28 |
<mobrovac@tin> |
Finished deploy [cassandra/logstash-logback-encoder@d085ffa] (staging): first Scap3 deployment (rest of the nodes) - T116340 (duration: 00m 12s) |
[production] |
19:28 |
<mobrovac@tin> |
Started deploy [cassandra/logstash-logback-encoder@d085ffa] (staging): first Scap3 deployment (rest of the nodes) - T116340 |
[production] |
19:27 |
<twentyafterfour@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: All wikis (except wikidata) to 1.30.0-wmf.13 refs T170631 |
[production] |
19:16 |
<godog> |
restart cassandra instances on xenon to test logstash-logback-encoder deploy |
[production] |
19:13 |
<mobrovac@tin> |
Finished deploy [cassandra/logstash-logback-encoder@d085ffa] (staging): first Scap3 deployment - T116340 (duration: 00m 03s) |
[production] |
19:13 |
<mobrovac@tin> |
Started deploy [cassandra/logstash-logback-encoder@d085ffa] (staging): first Scap3 deployment - T116340 |
[production] |
18:56 |
<Reedy> |
created newsletter tables on testwiki |
[production] |
18:55 |
<reedy@tin> |
Synchronized php-1.30.0-wmf.13/extensions/Newsletter/: sql file updates (duration: 00m 52s) |
[production] |
18:53 |
<reedy@tin> |
Synchronized php-1.30.0-wmf.13/extensions/WikimediaMaintenance/createExtensionTables.php: newsletter (duration: 00m 52s) |
[production] |
18:21 |
<demon@tin> |
Synchronized wmf-config/InitialiseSettings.php: Fix commons/commonswiki snafu (duration: 00m 52s) |
[production] |
17:53 |
<kartik@tin> |
Finished deploy [cxserver/deploy@f43ef96]: (no justification provided) (duration: 00m 44s) |
[production] |
17:52 |
<kartik@tin> |
Started deploy [cxserver/deploy@f43ef96]: (no justification provided) |
[production] |
17:42 |
<kartik@tin> |
Finished deploy [cxserver/deploy@1065ffe]: Update cxserver to 686f4f3 (duration: 00m 40s) |
[production] |
17:42 |
<kartik@tin> |
Started deploy [cxserver/deploy@1065ffe]: Update cxserver to 686f4f3 |
[production] |
16:23 |
<ema> |
cp1072: restart varnish backend |
[production] |
15:48 |
<XioNoX> |
troubleshoting interface errors between pfw3-codfw and fasw-codfw |
[production] |
15:09 |
<marostegui> |
Stop replication on db2046 to fix duplicate entries - T151029 |
[production] |
15:05 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Depool db2046 - T151029 (duration: 00m 50s) |
[production] |
15:03 |
<marostegui> |
Poweroff es2013 for maintenance - T172265 |
[production] |
14:45 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Pool db2075 - T170662 (duration: 00m 51s) |
[production] |
14:32 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2045 - T151029 (duration: 00m 51s) |
[production] |
14:11 |
<elukey> |
restart kafka1012 temporary with some logs to TRACE to debug T172681 |
[production] |
14:06 |
<ejegg|away> |
updated civicrm from 200abc23209d608ec54955d40e0845dd975c7a29 to 4aa177b779cd26d915a153637bc367435c4bc28e |
[production] |
13:43 |
<marostegui> |
Compress cebwiki on db1095 - T153058 |
[production] |
13:32 |
<zeljkof> |
EU SWAT finished |
[production] |
13:26 |
<zfilipin@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:370991|Set $wgArticleCountMethod to any on srwikisource (T172974)]] (duration: 00m 53s) |
[production] |
13:18 |
<zeljkof> |
EU SWAT, part two |
[production] |
13:17 |
<marostegui> |
Drop m3 databases from dbstore1002 - T156758 |
[production] |
13:16 |
<zeljkof> |
EU SWAT finished |
[production] |
13:15 |
<zfilipin@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:370815|Enable NewUserMessage on knwiki (T172894)]] (duration: 00m 52s) |
[production] |
12:56 |
<marostegui> |
Stop MySQL on db2045 to upgrade socket location - T148507 |
[production] |
12:07 |
<elukey> |
restored varnishakafka on cp3032 |
[production] |
11:17 |
<elukey> |
disabled puppet on cp3032 and restarted varnishkafka with debug logging |
[production] |
09:58 |
<jynus> |
continuing cloning of dbstore2002 to dbstore2001 |
[production] |
09:30 |
<gehel> |
repooling wdqs2001, long after data reload completed |
[production] |
09:30 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=wdqs2001.codfw.wmnet |
[production] |
09:27 |
<gehel@tin> |
Finished deploy [wdqs/wdqs@c186e3e]: (no justification provided) (duration: 01m 31s) |
[production] |
09:25 |
<gehel@tin> |
Started deploy [wdqs/wdqs@c186e3e]: (no justification provided) |
[production] |
09:17 |
<jynus> |
disabling lag notification on all s4 replicas |
[production] |
08:59 |
<elukey> |
update librdkafka1 to 0.9.4.1 on eventlog1001 |
[production] |
08:15 |
<elukey> |
add 50G to carbon lv on graphite1003 and 100G on graphite2002 |
[production] |
07:32 |
<jynus> |
enabling semisymc master replication on db1068 |
[production] |
07:29 |
<jynus> |
disabling semisync slave replication on all SSD hosts on s4 |
[production] |
06:45 |
<elukey> |
powercycle mw2256 - T163346 |
[production] |
06:38 |
<elukey> |
restart pdfrender on scb1004 |
[production] |
06:04 |
<Dereckson> |
Removed 2FA for GoldRingChip account (T172878) |
[production] |
03:23 |
<bblack> |
cp1008, restbase-dev100[456] have puppet disabled, manual "rm /etc/ssh/userkeys/dzahn" |
[production] |