2019-04-29
§
|
13:56 |
<jbond42> |
rolling security updates for imagemagick |
[production] |
13:45 |
<fsero> |
DNS: creating docker-registry.svc.(eqiad|codfw).wmnet RRs |
[production] |
13:17 |
<jbond42> |
rolling security updates for libpng |
[production] |
12:46 |
<godog> |
resume rollout rsyslog 8.1901.0-1 to jessie hosts - T219764 |
[production] |
12:07 |
<jynus> |
stop dbstore2002:s3 and dbstore2001:s5 for cloning to db2098/99 T220572 |
[production] |
11:56 |
<kart_> |
EU-Midday SWAT done. Thanks. |
[production] |
11:56 |
<kartik@deploy1001> |
Synchronized php-1.34.0-wmf.1/extensions/ContentTranslation: SWAT: [[gerrit|506971|Change the way we calculate total unmodified MT (T221930)]] (duration: 00m 56s) |
[production] |
11:30 |
<kartik@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit|505765|Add namespace "Aldono" at eo.wiktionary (T221525)]] (duration: 00m 54s) |
[production] |
11:21 |
<kartik@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit|506939| (T222018)]] (duration: 00m 53s) |
[production] |
11:14 |
<kartik@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit|506860|Allow admins to add or remove patroller group at enwikivoyage (T222008)]] (duration: 00m 55s) |
[production] |
09:27 |
<joal@deploy1001> |
Finished deploy [analytics/refinery@53a4eee]: Test of deploy-user change (analytics -> analytics-deploy) - bis (duration: 28m 19s) |
[production] |
09:13 |
<jynus> |
stop dbstore2002:s4 for cloning to db2099 T220572 |
[production] |
08:59 |
<joal@deploy1001> |
Started deploy [analytics/refinery@53a4eee]: Test of deploy-user change (analytics -> analytics-deploy) - bis |
[production] |
08:39 |
<godog> |
begin migration of bast4002 to prometheus v2 - T187987 |
[production] |
08:38 |
<joal@deploy1001> |
Finished deploy [analytics/refinery@53a4eee]: Test of deploy-user change (analytics -> analytics-deploy) (duration: 15m 38s) |
[production] |
08:33 |
<elukey> |
restart keyholder on deploy1001 + rearm keys |
[production] |
08:28 |
<elukey> |
restart keyholder-proxy on deploy1001 (attempt to see if new analytics scap settings got applied) |
[production] |
08:25 |
<oblivian@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Enable unicode overrides table for php 7.2 T219279 (duration: 00m 53s) |
[production] |
08:25 |
<jynus> |
stop dbstore2001:s2 for cloning to db2098 T220572 |
[production] |
08:23 |
<oblivian@deploy1001> |
Synchronized wmf-config/Php72ToUpper.php: Adding unicode overrides table for php 7.2 T219279 (duration: 00m 54s) |
[production] |
08:23 |
<joal@deploy1001> |
Started deploy [analytics/refinery@53a4eee]: Test of deploy-user change (analytics -> analytics-deploy) |
[production] |
07:58 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Move db2045 from s8 to x1 T219493 (duration: 00m 55s) |
[production] |
07:47 |
<marostegui> |
Stop mysql on db2034 (lag will happen on x1 codfw) - T219493 |
[production] |
07:44 |
<marostegui> |
Stop replication on db2034 (x1 master) for maintenance - T219493 |
[production] |
07:13 |
<moritzm> |
updated stretch netboot image for 9.9 point release |
[production] |
2019-04-26
§
|
20:15 |
<foks> |
changing email and password for "Lemon martini@global" |
[production] |
19:38 |
<foks> |
changing password for JDiPierro@global |
[production] |
19:21 |
<bblack> |
varnish-backend-restart on cp4026, evidence of artificial 503s from mbox lag behavior, probably related to the semi-abuse client doing odd 404 traffic to ulsfo that's triggering bugs in swift's rewrite.py .... |
[production] |
19:04 |
<foks> |
changing password for Subinsebastien |
[production] |
17:50 |
<mutante> |
analytics1052 - reported broken systemd state in Icinga - service mcelog was in state failed - systemctl start mcelog - (T212219 ?) |
[production] |
16:18 |
<jynus> |
stop s6 mariadb instance on dbstore2001 T220572 |
[production] |
15:34 |
<jbond42> |
upgrade puppet 4=> 5 and facter 2 => 3 on canary hosts: thumbor1001 ms-fe1005 ms-be1013 scb1001 restbase1007 |
[production] |
15:05 |
<jbond42> |
upgrade puppet 4=> 5 and facter 2 => 3 on canary hosts: ores1001.yaml wtp1025.yaml rdb1006.yaml |
[production] |
14:18 |
<marostegui> |
Set pc1004-1006 and pc2004-2006 as unracked on netbox - T209858 T210969 |
[production] |
13:17 |
<jbond42> |
upgrade puppet 4=> 5 and facter 2 => 3 on canary hosts: mw1311.yaml, mx2001 & dubnium |
[production] |
12:52 |
<ema> |
cp4025: restart varnish-be due to mbox lag |
[production] |
12:50 |
<jijiki> |
Restarting hhvm on mw1288 |
[production] |
12:48 |
<jbond42> |
upgrade puppet 4=> 5 and facter 2 => 3 on mc1019, maps1001 and logstash1007 |
[production] |
12:45 |
<ema@puppetmaster1001> |
conftool action : set/pooled=yes; selector: cluster=cache_upload,name=cp4021.ulsfo.wmnet,dc=ulsfo |
[production] |