3251-3300 of 10000 results (36ms)
2016-05-10 ยง
20:01 <bblack> re-enabling puppet on caches [production]
19:53 <demon@tin> Finished scap: group0 wikis to 1.28.0-wmf.1 (duration: 26m 49s) [production]
19:26 <demon@tin> Started scap: group0 wikis to 1.28.0-wmf.1 [production]
19:20 <ottomata> upgraded kafka1022 to confluent kafka 0.9.0.1 [production]
19:11 <ottomata> reenabling camus and puppet on analytics1027 [production]
18:38 <mutante> deleted /tmp/make-wmf-branch on tin by request [production]
18:20 <yurik> finished graphoid deployment & restart. T134575 [production]
18:18 <bblack> disabling puppet on caches for nginx change observe/deploy... [production]
18:10 <jynus> testing GTID replication on es2019 T133385 T130702 [production]
18:01 <cscott> OCG: script reported "Cleared 0 (of 363141 total) entries from cache in 56.894 seconds" (T120079) [production]
18:01 <ottomata> stopping kafka on kafka1022 to upgrade to 0.9 [production]
18:00 <cscott> OCG: clearing cache for ocg1003.eqiad.wmnet and ocg1003 (T120079) [production]
17:57 <ottomata> stopping camus and puppet on analytics1027 during upgrade of one kafka broker [production]
17:56 <yurik> about to deploy graphoid [production]
17:41 <cscott> updated OCG to version b0c57a1c6890e9fa1f2c3743fc14cb6a7f244fc3 (T120079) [production]
17:38 <cscott> starting OCG deploy [production]
16:40 <ema> repooling cp3007 running varnish 4 [production]
16:04 <godog> nodetool cleanup on restbase2005 T132976 [production]
16:03 <robh> i fubar'd sinistra's grub, it'll be offline for a bit while longer. [production]
15:52 <csteipp> deployed patch for T134863 [production]
15:48 <godog> collect mysqld metrics with prometheus-metrics-collector 0.8.1 on db2070 for 24h T128185 [production]
15:35 <thcipriani@tin> Synchronized wmf-config/CommonSettings.php: SWAT: Configure $wgCheckUserCAMultiLock for CentralAuth wikis [[gerrit:286927]] (duration: 00m 26s) [production]
15:27 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: Simplify $wgApiFrameOptions configuration (2/2) PART II [[gerrit:287968]] (duration: 00m 27s) [production]
15:26 <thcipriani@tin> Synchronized wmf-config/CommonSettings.php: SWAT: Simplify $wgApiFrameOptions configuration (2/2) PART I [[gerrit:287968]] (duration: 00m 26s) [production]
15:23 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: Simplify $wgApiFrameOptions configuration (1/2) [[gerrit:287939]] (duration: 00m 26s) [production]
15:22 <robh> sinistra powercycling and troubleshooting starting for disk issue [production]
15:15 <moritzm> restarting apache on silver (wikitech host) for openssl update [production]
15:15 <godog> graphite-web reload on graphite1001 after merging https://gerrit.wikimedia.org/r/281631 [production]
15:10 <thcipriani@tin> Synchronized portals: (no message) (duration: 00m 33s) [production]
15:10 <thcipriani@tin> Synchronized portals/prod/wikipedia.org/assets: (no message) (duration: 00m 27s) [production]
15:09 <thcipriani> running sync-portals for portals SWAT [production]
15:07 <moritzm> restarted apache on californium for openssl update [production]
15:06 <thcipriani@tin> Synchronized wmf-config/CommonSettings.php: SWAT: Remove misleading comment in UploadWizard configuration [[gerrit:287948]] (duration: 00m 47s) [production]
14:56 <jynus> dropped pdns db and associated user accounts on m5-master [production]
14:54 <bblack> restarting pybal on lvs3002 [production]
14:53 <moritzm> restarting ntp on nescio for openssl update [production]
14:52 <bblack> restarting pybal on lvs3004 [production]
14:45 <moritzm> restarting ntp on maerlant for openssl update [production]
14:37 <moritzm> restarting ntp on acamar for openssl update [production]
14:32 <moritzm> restarting ntp on chromium for openssl update [production]
14:27 <ema> upgrading cp3007 (misc) to varnish 4 [production]
14:24 <moritzm> restarting ntp on hydrogen for openssl update [production]
14:15 <moritzm> restarting ntp on achernar for openssl update [production]
14:10 <moritzm> restarting apache on neon for openssl update [production]
14:08 <moritzm> restarting apache on uranium for openssl update [production]
14:01 <ema> depooling and rebooting cp1066 to test mdadm boot workaround T131961 [production]
13:58 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Add db1023 db weight; reduce weight on db1035 and db1044 (duration: 00m 26s) [production]
13:55 <moritzm> restarting nginx on dataset1001, ms1001 and francium for openssl update [production]
13:30 <ema> depooling and rebooting cp1065 to test mdadm boot workaround T131961 [production]
13:18 <krinkle@tin> Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 28s) [production]