1101-1150 of 10000 results (24ms)
2020-04-21 §
15:32 <hashar> Restarting Gerrit T250820 T246973 [production]
15:26 <hashar> CI / Zuul does not get any events for some reason :/ [production]
14:59 <volans@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:59 <volans@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:51 <hashar> contint2001: manually dropping /var/lib/docker (we now use /srv/docker ) [production]
14:48 <jbond42> restart haproxy on dns-auth [production]
14:48 <hashar> restarting docker on contint2001 [production]
14:47 <volker-e@deploy1001> Finished deploy [design/style-guide@d101234]: Deploy design/style-guide: (duration: 00m 09s) [production]
14:47 <volker-e@deploy1001> Started deploy [design/style-guide@d101234]: Deploy design/style-guide: [production]
14:45 <jbond42> puppet enabled again [production]
14:40 <moritzm> restarting apache on miscweb [production]
14:37 <moritzm> restarting apache on netbox1001 [production]
14:36 <jbond42> disable puppet fleet wide to restart puppemaster [production]
14:28 <moritzm> installing OpenSSL security updates [production]
14:17 <vgutierrez> rolling upgrade of ats to version 8.0.7-1wm1 [production]
14:16 <moritzm> installing OpenSSL updates on caches [production]
14:08 <hashar> contint1001: rm /var/log/apache2/doc_* # service has been moved to doc1001.eqiad.wmnet [production]
13:43 <vgutierrez> upload trafficserver 8.0.7-1wm1 to apt.wm.o (buster) [production]
13:11 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
13:10 <marostegui@cumin1001> START - Cookbook sre.hosts.decommission [production]
11:15 <mutante> recreating cert for contint/integration to add integration.mediawiki.org in addition to integration.wikimedia.org [production]
11:06 <mutante> https://integration.wikimedia.org now also using TLS between ATS and contint1001 using envoy (T210411) [production]
10:49 <_joe_> mwdebug1001:~# iptables -A INPUT -s 10.64.32.208 -m statistic --mode random --probability 0.1 -j DROP (T240684) [production]
08:52 <ema> purged: rolling restart with 4 frontend workers [production]
07:54 <ema> cp3050: restart purged with 4 frontend workers [production]
07:47 <kormat> dropping old data and optimizing tables on pc1010 and pc2010 T247787 [production]
07:26 <ema> cp4032: restart ats-tls and ats-be [production]
07:06 <ema> cp4026: restart ats-tls and ats-be [production]
06:30 <marostegui> Rename flagged* tables on mediawikiwiki on db1075 - T248298 [production]
06:24 <XioNoX> restore eqsin/ulsfo OSPF metric - T250653 [production]
05:46 <marostegui> Deploy schema change on s6 codfw master [production]
05:34 <marostegui> Add db1095:3312, db1095:3320 to tendril - T250602 [production]
05:32 <moritzm> installing git security updates [production]
05:19 <marostegui> Deploy schema change on s2 codfw - T250055 [production]
05:09 <vgutierrez> rolling restart of ats-tls to enable SSL_OP_PRIORITIZE_CHACHA [production]
2020-04-20 §
23:29 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Update project wordmarks and icons (T249047) (duration: 01m 01s) [production]
23:27 <catrope@deploy1001> Synchronized static/images/mobile/: Update project wordmarks and icons (T249047) (duration: 01m 02s) [production]
23:14 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Add media.api.aucklandmuseum.com to $wgCopyUploadsDomains (T250646) (duration: 01m 08s) [production]
21:11 <mepps> update civicrm from 1224b080c1 to e8a0b5395d [production]
20:32 <ejegg|food> updated fundraising python tools from a93eec292d to c96813eda4 [production]
20:14 <halfak@deploy1001> Finished deploy [ores/deploy@514f94a]: T250536 (duration: 14m 06s) [production]
20:00 <halfak@deploy1001> Started deploy [ores/deploy@514f94a]: T250536 [production]
19:53 <addshore> pool wdqs1006 again (caught up) [production]
19:53 <cdanis@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=wdqs,name=eqiad [production]
19:45 <jforrester@deploy1001> Synchronized wmf-config/PoolCounterSettings.php: Revert CirrusSearch-MoreLike pool conter numbers now rebuild is done (duration: 01m 01s) [production]
19:43 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: cirrus: Move more_like from codfw back to eqiad, rebuild complete (duration: 01m 03s) [production]
19:40 <rzl> mcrouter certs renewed on puppetmaster1001; puppet re-enabled on mcrouter hosts and will update certs naturally over the next 30m T248093 [production]
18:39 <rzl> disabling puppet on all mcrouter hosts for cert renewal T248093 [production]
18:38 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T248418 [testwiki] Force videojs-only mode for TimedMediaHandler (duration: 01m 01s) [production]
18:36 <jforrester@deploy1001> Synchronized php-1.35.0-wmf.28/extensions/MassMessage/includes/SpecialEditMassMessageList.php: T250710 Follow-up 95c772864: Fix RevisionRecord calls that differ from Revision (duration: 01m 02s) [production]