6401-6450 of 10000 results (71ms)
2018-07-31 ยง
15:29 <_joe_> restarting apache on phab1001 [production]
15:20 <godog> depool thumbor100[12] ahead of switch move - T183585 [production]
15:01 <XioNoX> starting the eqiad row B servers move - T183585 [production]
13:51 <moritzm> installing ffmpeg 3.2.12 security updates on video scalers [production]
13:34 <akosiaris> repool mathoid eqiad cluster in discovery [production]
13:18 <akosiaris> upgrade kubernetes1004 to 1.9.9 [production]
13:14 <akosiaris> upgrade kubernetes1002 to 1.9.9 [production]
13:14 <akosiaris> upgrade kubernetes1003 to 1.9.9 [production]
13:03 <akosiaris> upgrade kubernetes1001 to 1.9.9 [production]
12:58 <akosiaris> upgrade chlorine.eqiad.wmnet to kubernetes 1.9.9 [production]
12:54 <akosiaris> upgrade argon.eqiad.wmnet to kubernetes 1.9.9 [production]
12:45 <akosiaris> depool eqiad mathoid in discovery [production]
12:29 <gehel@puppetmaster1001> conftool action : set/weight=15; selector: dc=eqiad,cluster=wdqs,name=wdqs1005.eqiad.wmnet [production]
12:29 <gehel@puppetmaster1001> conftool action : set/weight=15; selector: dc=eqiad,cluster=wdqs,name=wdqs1004.eqiad.wmnet [production]
12:29 <gehel> rebalance LVS weights to send less traffic to wdqs1003 - T200563 [production]
12:13 <reedy@deploy1001> Synchronized wmf-config/CommonSettings.php: Remove logging now in mw core (duration: 00m 48s) [production]
12:11 <reedy@deploy1001> Synchronized wmf-config/InitialiseSettings.php: wmg - for Sentry (duration: 00m 48s) [production]
12:09 <reedy@deploy1001> Synchronized wmf-config/CommonSettings.php: Remove wmg - for Sentry (duration: 00m 48s) [production]
12:06 <reedy@deploy1001> Synchronized wmf-config/CommonSettings.php: Load Sentry with wfLoadExtension (duration: 00m 48s) [production]
12:05 <reedy@deploy1001> Synchronized wmf-config/liquidthreads.php: Remove lqt cruft, load with wfLoadExtension (duration: 00m 48s) [production]
11:44 <gehel> restarting blazegraph on wdqs1003 - JVM unresponsive [production]
11:38 <zeljkof> EU SWAT finished [production]
11:37 <zfilipin@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:448050|Introduce autopatrolled on bnwikisource (T199475)]] (duration: 00m 48s) [production]
11:30 <zfilipin@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:449391|Use HD logos for hewiktionary (T200470)]] (duration: 00m 48s) [production]
11:24 <zfilipin@deploy1001> Synchronized static/images/project-logos/: SWAT: [[gerrit:449390|Upload HD logos for hewiktionary (T200470)]] (duration: 00m 48s) [production]
11:16 <zfilipin@deploy1001> Synchronized static/images/project-logos: SWAT: [[gerrit:449389|Milestone logo for atjwiki (T200713)]] (duration: 00m 49s) [production]
11:10 <zfilipin@deploy1001> Synchronized static/images/project-logos/hewikiquote.png: SWAT: [[gerrit:448154|Update hewikiquote logo (T200296)]] (duration: 00m 50s) [production]
10:55 <_joe_> test log [production]
10:40 <akosiaris@deploy1001> scap-helm mathoid finished [production]
10:40 <akosiaris@deploy1001> scap-helm mathoid cluster codfw completed [production]
10:39 <akosiaris@deploy1001> scap-helm mathoid cluster eqiad completed [production]
10:39 <akosiaris@deploy1001> scap-helm mathoid upgrade production stable/mathoid [namespace: mathoid, clusters: eqiad,codfw] [production]
09:46 <ema> reboot cp1045 (jessie) for kernel updates [production]
09:29 <ema> upload varnishkafka 1.0.13-1 to stretch-wikimedia T200445 T186250 [production]
08:44 <jynus> stop and reimage db1104 to stretch [production]
08:17 <akosiaris> repool mathoid codfw in discovery, the kubernetes upgrade is done [production]
08:08 <akosiaris> upgrade kubernetes2004 to 1.9.9 [production]
08:05 <akosiaris> upgrade kubernetes2003 to 1.9.9 [production]
08:00 <akosiaris> upgrade kubernetes2002 to 1.9.9 [production]
07:55 <ema> reboot cp2018 for kernel updates [production]
07:54 <moritzm> reboot cp1008 for kernel tests [production]
07:53 <akosiaris> upgrade kubernetes2001 to 1.9.9 [production]
07:50 <ema> reboot cp2025 for kernel updates [production]
07:47 <akosiaris> upgrade acrux.codfw.wmnet to kubernetes 1.9.9 [production]
07:44 <jynus> stopping db1118 mariadb and starting mysql there [production]
07:36 <moritzm> reboot multatuli for kernel tests [production]
07:35 <akosiaris> upgrade acrab.codfw.wmnet to kubernetes 1.9.9 [production]
07:32 <moritzm> run decomission_appserver on terbium [production]
07:27 <akosiaris> backup kubetcd2001 etcd data before kubernetes upgrade [production]
07:24 <akosiaris> depool codfw mathoid from discovery for kubernetes upgrade [production]