7551-7600 of 10000 results (101ms)
2019-04-07 §
01:06 <bstorm_> cleared E state from 6 queues [tools]
00:30 <Krinkle> Reloading Zuul to deploy https://gerrit.wikimedia.org/r/501793 [releng]
2019-04-06 §
10:09 <gilles> Purging ruwiki namespaces > 0 [production]
02:17 <legoktm> rebuilding npm-php image again https://gerrit.wikimedia.org/r/501848 [releng]
01:52 <legoktm> rebuilding npm-php image https://gerrit.wikimedia.org/r/501847 [releng]
01:10 <legoktm> deploying https://gerrit.wikimedia.org/r/501786 https://gerrit.wikimedia.org/r/501714 https://gerrit.wikimedia.org/r/501707 https://gerrit.wikimedia.org/r/501782 https://gerrit.wikimedia.org/r/501709 https://gerrit.wikimedia.org/r/500111 https://gerrit.wikimedia.org/r/500106 https://gerrit.wikimedia.org/r/500127 https://gerrit.wikimedia.org/r/500119 [releng]
00:53 <Krinkle> Reloading Zuul to deploy https://gerrit.wikimedia.org/r/501813 [releng]
2019-04-05 §
23:53 <Krinkle> Beta cluster puppetmaster is stalled behind origin/production as of 24 hours ago (57 patches behind) due to a local merge conflict [releng]
23:10 <thcipriani> revert some recent problematic gerrit acl changes [production]
22:46 <chaomodus> restarted pdfrender on scb1002 T174916 [production]
22:24 <Krinkle> Reloading Zuul to deploy https://gerrit.wikimedia.org/r/501789 [releng]
22:02 <legoktm> rebuilding mediawiki-phan docker image https://gerrit.wikimedia.org/r/501794 [releng]
21:45 <hashar> thcipriani restarted Gerrit. CI works again # T220243 [production]
21:37 <thcipriani> restarting gerrit [production]
21:29 <hashar> CI / Zuul is no more processing events / T220243 [production]
20:11 <thcipriani> updating docker-pkg files on contint1001 for https://gerrit.wikimedia.org/r/501465 [releng]
18:48 <zhuyifei1999_> checked out FETCH_HEAD on quarry-web-01 T209226 [quarry]
18:43 <zhuyifei1999_> applied 0001-SECURITY-escape-CSV-injections.patch on quarry-web-01 and restarted uwsgi T209226 [quarry]
17:29 <thcipriani> gerrit back on 2.15.11 [production]
17:27 <thcipriani> restart gerrit [production]
17:26 <thcipriani@deploy1001> Finished deploy [gerrit/gerrit@a4e66d4]: Gerrit to back to 2.15.11 on cobalt (restart incoming) (duration: 00m 11s) [production]
17:26 <thcipriani@deploy1001> Started deploy [gerrit/gerrit@a4e66d4]: Gerrit to back to 2.15.11 on cobalt (restart incoming) [production]
17:25 <thcipriani@deploy1001> Finished deploy [gerrit/gerrit@a4e66d4]: Gerrit to back to 2.15.11 (on gerrit2001 only) (duration: 00m 10s) [production]
17:25 <thcipriani@deploy1001> Started deploy [gerrit/gerrit@a4e66d4]: Gerrit to back to 2.15.11 (on gerrit2001 only) [production]
17:19 <krinkle@deploy1001> Synchronized php-1.33.0-wmf.23/includes/diff/TextSlotDiffRenderer.php: Ia326c67de28a4e / T220217 (duration: 01m 02s) [production]
17:12 <krinkle@deploy1001> Synchronized php-1.33.0-wmf.24/includes/diff/TextSlotDiffRenderer.php: Ia326c67de28a4e / T220217 (duration: 01m 00s) [production]
16:03 <Amir1> update campaign set active = false where id = 50; [wikilabels]
16:02 <Amir1> update campaign set active = false where id = 18; [wikilabels]
16:02 <krinkle@deploy1001> Synchronized php-1.33.0-wmf.24/includes/jobqueue/jobs/RefreshLinksJob.php: Ib1ac31365f9c / T220037 (duration: 00m 59s) [production]
16:01 <Amir1> update campaign set active = false where wiki= 'eswikiquote'; [wikilabels]
16:00 <Amir1> u_wikilabels=> update campaign set active = false where wiki= 'dewiki'; [wikilabels]
15:58 <ejegg> re-enabled recurring donations queue consumer [production]
15:57 <krinkle@deploy1001> Synchronized php-1.33.0-wmf.24/extensions/NavigationTiming/: I6b23be850d35c7d19 / T220156 (duration: 01m 00s) [production]
15:51 <krinkle@deploy1001> Synchronized php-1.33.0-wmf.24/extensions/GlobalBlocking/includes/specials/: I5843cd181ca7d (duration: 01m 02s) [production]
15:44 <bstorm_> cleared E state from two exec queues [tools]
15:08 <ejegg> upgraded fundraising CiviCRM from 3c55850631 to 83478013a8 [production]
15:01 <ejegg> disabled recurring donation queue consumer [production]
14:55 <papaul> powering down restbase2019 and 2020 for relocation [production]
13:53 <gehel@cumin2001> END (FAIL) - Cookbook sre.elasticsearch.rolling-reboot (exit_code=99) [production]
13:45 <akosiaris> repool eqiad for all kubernetes services T217426 [production]
13:45 <akosiaris> ρepool eqiad for all kubernetes services T217426 [production]
13:45 <akosiaris@puppetmaster1001> conftool action : set/pooled=true; selector: name=eqiad,dnsdisc=citoid [production]
13:45 <akosiaris@puppetmaster1001> conftool action : set/pooled=true; selector: name=eqiad,dnsdisc=cxserver [production]
13:45 <akosiaris@puppetmaster1001> conftool action : set/pooled=true; selector: name=eqiad,dnsdisc=mathoid [production]
13:44 <akosiaris@puppetmaster1001> conftool action : set/pooled=true; selector: name=eqiad,dnsdisc=blubberoid [production]
13:44 <akosiaris@puppetmaster1001> conftool action : set/pooled=true; selector: name=eqiad,dnsdisc=zotero [production]
13:41 <arturo> T220203 reimage labtestnet2002 as spare in stretch [production]
13:36 <arturo> T220101 disable active icinga checks for cloudcontrol2002-dev [production]
13:35 <gehel@cumin1001> END (PASS) - Cookbook sre.elasticsearch.force-shard-allocation (exit_code=0) [production]
13:35 <gehel@cumin1001> START - Cookbook sre.elasticsearch.force-shard-allocation [production]