2016-05-10
ยง
|
18:18 |
<bblack> |
disabling puppet on caches for nginx change observe/deploy... |
[production] |
18:10 |
<jynus> |
testing GTID replication on es2019 T133385 T130702 |
[production] |
18:01 |
<cscott> |
OCG: script reported "Cleared 0 (of 363141 total) entries from cache in 56.894 seconds" (T120079) |
[production] |
18:01 |
<ottomata> |
stopping kafka on kafka1022 to upgrade to 0.9 |
[production] |
18:00 |
<cscott> |
OCG: clearing cache for ocg1003.eqiad.wmnet and ocg1003 (T120079) |
[production] |
17:57 |
<ottomata> |
stopping camus and puppet on analytics1027 during upgrade of one kafka broker |
[production] |
17:56 |
<yurik> |
about to deploy graphoid |
[production] |
17:41 |
<cscott> |
updated OCG to version b0c57a1c6890e9fa1f2c3743fc14cb6a7f244fc3 (T120079) |
[production] |
17:38 |
<cscott> |
starting OCG deploy |
[production] |
16:40 |
<ema> |
repooling cp3007 running varnish 4 |
[production] |
16:04 |
<godog> |
nodetool cleanup on restbase2005 T132976 |
[production] |
16:03 |
<robh> |
i fubar'd sinistra's grub, it'll be offline for a bit while longer. |
[production] |
15:52 |
<csteipp> |
deployed patch for T134863 |
[production] |
15:48 |
<godog> |
collect mysqld metrics with prometheus-metrics-collector 0.8.1 on db2070 for 24h T128185 |
[production] |
15:35 |
<thcipriani@tin> |
Synchronized wmf-config/CommonSettings.php: SWAT: Configure $wgCheckUserCAMultiLock for CentralAuth wikis [[gerrit:286927]] (duration: 00m 26s) |
[production] |
15:27 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Simplify $wgApiFrameOptions configuration (2/2) PART II [[gerrit:287968]] (duration: 00m 27s) |
[production] |
15:26 |
<thcipriani@tin> |
Synchronized wmf-config/CommonSettings.php: SWAT: Simplify $wgApiFrameOptions configuration (2/2) PART I [[gerrit:287968]] (duration: 00m 26s) |
[production] |
15:23 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Simplify $wgApiFrameOptions configuration (1/2) [[gerrit:287939]] (duration: 00m 26s) |
[production] |
15:22 |
<robh> |
sinistra powercycling and troubleshooting starting for disk issue |
[production] |
15:15 |
<moritzm> |
restarting apache on silver (wikitech host) for openssl update |
[production] |
15:15 |
<godog> |
graphite-web reload on graphite1001 after merging https://gerrit.wikimedia.org/r/281631 |
[production] |
15:10 |
<thcipriani@tin> |
Synchronized portals: (no message) (duration: 00m 33s) |
[production] |
15:10 |
<thcipriani@tin> |
Synchronized portals/prod/wikipedia.org/assets: (no message) (duration: 00m 27s) |
[production] |
15:09 |
<thcipriani> |
running sync-portals for portals SWAT |
[production] |
15:07 |
<moritzm> |
restarted apache on californium for openssl update |
[production] |
15:06 |
<thcipriani@tin> |
Synchronized wmf-config/CommonSettings.php: SWAT: Remove misleading comment in UploadWizard configuration [[gerrit:287948]] (duration: 00m 47s) |
[production] |
14:56 |
<jynus> |
dropped pdns db and associated user accounts on m5-master |
[production] |
14:54 |
<bblack> |
restarting pybal on lvs3002 |
[production] |
14:53 |
<moritzm> |
restarting ntp on nescio for openssl update |
[production] |
14:52 |
<bblack> |
restarting pybal on lvs3004 |
[production] |
14:45 |
<moritzm> |
restarting ntp on maerlant for openssl update |
[production] |
14:37 |
<moritzm> |
restarting ntp on acamar for openssl update |
[production] |
14:32 |
<moritzm> |
restarting ntp on chromium for openssl update |
[production] |
14:27 |
<ema> |
upgrading cp3007 (misc) to varnish 4 |
[production] |
14:24 |
<moritzm> |
restarting ntp on hydrogen for openssl update |
[production] |
14:15 |
<moritzm> |
restarting ntp on achernar for openssl update |
[production] |
14:10 |
<moritzm> |
restarting apache on neon for openssl update |
[production] |
14:08 |
<moritzm> |
restarting apache on uranium for openssl update |
[production] |
14:01 |
<ema> |
depooling and rebooting cp1066 to test mdadm boot workaround T131961 |
[production] |
13:58 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Add db1023 db weight; reduce weight on db1035 and db1044 (duration: 00m 26s) |
[production] |
13:55 |
<moritzm> |
restarting nginx on dataset1001, ms1001 and francium for openssl update |
[production] |
13:30 |
<ema> |
depooling and rebooting cp1065 to test mdadm boot workaround T131961 |
[production] |
13:18 |
<krinkle@tin> |
Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 28s) |
[production] |
13:17 |
<krinkle@tin> |
Synchronized wmf-config/ProductionServices.php: (no message) (duration: 00m 28s) |
[production] |
12:47 |
<hashar@tin> |
Synchronized multiversion/MWMultiVersion.php: Typo fix in a couple comment blocks (duration: 00m 28s) |
[production] |
12:46 |
<hashar@tin> |
Synchronized typos: (no message) (duration: 01m 55s) |
[production] |
12:33 |
<godog> |
restart ircecho on kraz |
[production] |
12:28 |
<mobrovac> |
mobileapps deploying b8c396ae |
[production] |
12:07 |
<moritzm> |
rolling restart of maps cluster for openssl update |
[production] |
12:03 |
<moritzm> |
"powercycled" kraz (stuck by qemu bug) |
[production] |