6401-6450 of 10000 results (61ms)
2017-08-10 §
18:56 <Reedy> created newsletter tables on testwiki [production]
18:55 <reedy@tin> Synchronized php-1.30.0-wmf.13/extensions/Newsletter/: sql file updates (duration: 00m 52s) [production]
18:53 <reedy@tin> Synchronized php-1.30.0-wmf.13/extensions/WikimediaMaintenance/createExtensionTables.php: newsletter (duration: 00m 52s) [production]
18:21 <demon@tin> Synchronized wmf-config/InitialiseSettings.php: Fix commons/commonswiki snafu (duration: 00m 52s) [production]
17:53 <kartik@tin> Finished deploy [cxserver/deploy@f43ef96]: (no justification provided) (duration: 00m 44s) [production]
17:52 <kartik@tin> Started deploy [cxserver/deploy@f43ef96]: (no justification provided) [production]
17:42 <kartik@tin> Finished deploy [cxserver/deploy@1065ffe]: Update cxserver to 686f4f3 (duration: 00m 40s) [production]
17:42 <kartik@tin> Started deploy [cxserver/deploy@1065ffe]: Update cxserver to 686f4f3 [production]
16:23 <ema> cp1072: restart varnish backend [production]
15:48 <XioNoX> troubleshoting interface errors between pfw3-codfw and fasw-codfw [production]
15:09 <marostegui> Stop replication on db2046 to fix duplicate entries - T151029 [production]
15:05 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2046 - T151029 (duration: 00m 50s) [production]
15:03 <marostegui> Poweroff es2013 for maintenance - T172265 [production]
14:45 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Pool db2075 - T170662 (duration: 00m 51s) [production]
14:32 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2045 - T151029 (duration: 00m 51s) [production]
14:11 <elukey> restart kafka1012 temporary with some logs to TRACE to debug T172681 [production]
14:06 <ejegg|away> updated civicrm from 200abc23209d608ec54955d40e0845dd975c7a29 to 4aa177b779cd26d915a153637bc367435c4bc28e [production]
13:43 <marostegui> Compress cebwiki on db1095 - T153058 [production]
13:32 <zeljkof> EU SWAT finished [production]
13:26 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:370991|Set $wgArticleCountMethod to any on srwikisource (T172974)]] (duration: 00m 53s) [production]
13:18 <zeljkof> EU SWAT, part two [production]
13:17 <marostegui> Drop m3 databases from dbstore1002 - T156758 [production]
13:16 <zeljkof> EU SWAT finished [production]
13:15 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:370815|Enable NewUserMessage on knwiki (T172894)]] (duration: 00m 52s) [production]
12:56 <marostegui> Stop MySQL on db2045 to upgrade socket location - T148507 [production]
12:07 <elukey> restored varnishakafka on cp3032 [production]
11:17 <elukey> disabled puppet on cp3032 and restarted varnishkafka with debug logging [production]
09:58 <jynus> continuing cloning of dbstore2002 to dbstore2001 [production]
09:30 <gehel> repooling wdqs2001, long after data reload completed [production]
09:30 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=wdqs2001.codfw.wmnet [production]
09:27 <gehel@tin> Finished deploy [wdqs/wdqs@c186e3e]: (no justification provided) (duration: 01m 31s) [production]
09:25 <gehel@tin> Started deploy [wdqs/wdqs@c186e3e]: (no justification provided) [production]
09:17 <jynus> disabling lag notification on all s4 replicas [production]
08:59 <elukey> update librdkafka1 to 0.9.4.1 on eventlog1001 [production]
08:15 <elukey> add 50G to carbon lv on graphite1003 and 100G on graphite2002 [production]
07:32 <jynus> enabling semisymc master replication on db1068 [production]
07:29 <jynus> disabling semisync slave replication on all SSD hosts on s4 [production]
06:45 <elukey> powercycle mw2256 - T163346 [production]
06:38 <elukey> restart pdfrender on scb1004 [production]
06:04 <Dereckson> Removed 2FA for GoldRingChip account (T172878) [production]
03:23 <bblack> cp1008, restbase-dev100[456] have puppet disabled, manual "rm /etc/ssh/userkeys/dzahn" [production]
03:20 <bblack> batched cumin puppet agent run on all hosts (not forced) [production]
02:28 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.11) (duration: 09m 12s) [production]
2017-08-09 §
22:06 <maxsem@tin> Synchronized wmf-config/InitialiseSettings.php: Get baaack you broken CodeMirror! (duration: 00m 51s) [production]
21:20 <maxsem@tin> Synchronized wmf-config/InitialiseSettings.php: Deploy CodeMirror https://gerrit.wikimedia.org/r/#/c/370943/ (duration: 00m 50s) [production]
21:11 <maxsem@tin> Synchronized php-1.30.0-wmf.12/extensions/CodeMirror: https://gerrit.wikimedia.org/r/#/c/370904/ (duration: 00m 51s) [production]
21:05 <ppchelko@tin> Finished deploy [restbase/deploy@f97beeb]: Rollback on canary (duration: 07m 30s) [production]
21:01 <godog> add 100G to carbon lv on graphite1003 and graphite2002 [production]
20:58 <ppchelko@tin> Started deploy [restbase/deploy@f97beeb]: Rollback on canary [production]
20:54 <ppchelko@tin> Finished deploy [restbase/deploy@f97beeb]: Temporary fallback to the new storage buckets before truncation. All tables created, finish deploy (duration: 07m 12s) [production]