1201-1250 of 10000 results (70ms)
2019-09-16 §
10:51 <vgutierrez@puppetmaster1001> conftool action : set/pooled=no; selector: name=ncredir2002.codfw.wmnet [production]
10:50 <jdrewniak@deploy1001> Synchronized portals: Wikimedia Portals Update: [[gerrit:537060| Bumping portals to master (T128546)]] (duration: 01m 03s) [production]
10:49 <jdrewniak@deploy1001> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:537060| Bumping portals to master (T128546)]] (duration: 01m 04s) [production]
10:45 <vgutierrez> Enabling OCSP prefetched responses for the non-canonical redirect service - T232988 [production]
10:29 <_joe_> installing a patched php-memcached on mw1347 T232613 [production]
10:16 <vgutierrez> upgrade acme-chief production servers to acme-chief 0.21 - T219765 [production]
10:16 <moritzm> upload libtrapperkeeper-webserver-jetty9-clojure 1.7.0-2+wmf1 to buster-wikimedia [production]
10:05 <vgutierrez> restarting acmechief servers to get latest kernel upgrades [production]
10:04 <elukey> disable puppet on an-coord1001 and manually forcing python3 for camus - T204735 [analytics]
09:26 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:24 <elukey@cumin1001> START - Cookbook sre.hosts.downtime [production]
08:57 <vgutierrez> replacing nginx with ATS in cp3034 (upload cluster) - T231433 [production]
08:56 <mobrovac@deploy1001> Synchronized wmf-config/CommonSettings.php: Beta: enable the Parsoid extension - T231569 (duration: 01m 01s) [production]
08:50 <marostegui> Apply grants for dbproxy1021 on db1133 (m5 master) with replication - T202367 [production]
08:16 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
08:14 <elukey@cumin1001> START - Cookbook sre.hosts.downtime [production]
08:11 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
08:09 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime [production]
07:38 <moritzm> installing faad2 security updates [production]
07:25 <joal> Delete matomo error with URL http://Wikipedia/screen/Explore [analytics]
07:15 <moritzm> repooling restbase2009 [production]
06:48 <marostegui> Stop MySQL on db1114 to upgrade it to 10.3 [production]
06:03 <marostegui> Stop MySQL on db2054 for decommissioning T232969 [production]
06:01 <marostegui> Remove db2054 from tendril and zarcillo T232969 [production]
05:59 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Remove db2054 from config T232969 (duration: 01m 03s) [production]
05:58 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Remove db2054 from config T232969 (duration: 01m 05s) [production]
02:35 <Zppix> removing MacFan4000 as a maintainer due to inactivity and lack of accountability. [tools.zppixbot]
02:07 <Zppix> upgrade python to 3.5.3 and sopel to 6.9.9 (after some frustration) [tools.zppixbot]
2019-09-15 §
17:13 <Zppix> cd /etc/puppet/modules/icinga2; git pull on puppet-paladox. puppet agent -tv on gerrit-mysql to deploy [[gerrit:536775]] T232921 [git]
16:51 <Krinkle> Fixed a dozen abuse filtes, listed at https://phabricator.wikimedia.org/T156096#5494060. The trailing pipe character was removed from filters that had it which is no longer supported in a future version of AbuseFilter. [production]
14:35 <_joe_> test: setting opcache.interned_strings_buffer to 0 on mw1348 for T232613 [production]
2019-09-14 §
23:42 <onimisionipe> force shard allocation (dewiki_content_1566659363[4]) on eqiad cluster [production]
20:45 <Krenair> shifted deployment-cache-upload05 to using unified cert from acme-chief [releng]
04:39 <effie> Depool and reload mw1286 [production]
01:14 <ejegg> updated fundraising python tools from 1e405864d7 to e1b81688c6 [production]
00:29 <ejegg> updated payments-wiki from 1f556670cf to fc82318180 [production]
2019-09-13 §
23:44 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
23:42 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
23:40 <Krinkle> deployment-deploy01: cleaning disk: rm /var/cache/hhvm/cli.hhbc.sq3 [releng]
23:06 <gehel> re-enable puppet on maps - T232817 [production]
21:52 <halfak> switched ores-lb-03 to point to ores-web-04/05/06 [ores]
21:17 <andrewbogott> moving ores-redis-02 to cloudvirt1030 [ores]
21:06 <halfak> restarting redis services on ores-redis-02 [ores]
20:53 <halfak> ran 'sudo service celery-ores-worker restart' on celery-worker-02 [ores]
20:23 <chaomodus> restarting netbox1001.wikimedia.org [production]
20:00 <twentyafterfour> hotfixing T232600 due to severity of the bug and relative safety of the fix (if this breaks, yell at James_F who twisted my arm and made me do it) [production]
19:54 <urandom> bootstrapping Cassandra, restbase2009-c -- T224553 [production]
17:24 <urandom> bootstrapping Cassandra, restbase2009-b -- T224553 [production]
16:57 <joal> Reset ua-parser/uap-java wmf branch to up-to-date master using push force [analytics]
16:19 <James_F> Zuul: Add initial jobs for mediawiki/tools/api-testing T230340 [releng]