2151-2200 of 10000 results (74ms)
2018-05-08 §
06:00 <marostegui> Set db1055 ready only [production]
06:00 <marostegui> Start x1 failover [production]
05:41 <marostegui> Move db2034 under db1069 for x1 failover - T186320 [production]
05:36 <marostegui> Move dbstore1002:x1 under db1069 for x1 failover - T186320 [production]
05:29 <marostegui> Disable puppet on db1055 and db1069 before x1 failover - T186320 [production]
05:28 <marostegui> Disable gtid on db1069 an db2034 before x1 failover - T186320 [production]
05:26 <marostegui> Deploy schema change on db1121 with replication (this will generate lag on labs on s4) - T191519 T188299 T190148 [production]
05:26 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1121 for alter table (duration: 01m 00s) [production]
05:19 <marostegui> Reload haproxy on dbproxy1010 to repool labsdb1011 - https://phabricator.wikimedia.org/T174047 [production]
05:18 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1097:3314 after alter table (duration: 01m 00s) [production]
04:27 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2221.codfw.wmnet [production]
04:26 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2220.codfw.wmnet [production]
04:24 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2219.codfw.wmnet [production]
02:33 <l10nupdate@tin> scap sync-l10n completed (1.32.0-wmf.2) (duration: 05m 45s) [production]
00:12 <ejegg> updated CiviCRM from 9752607052 to 81e54c850d [production]
2018-05-07 §
23:41 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2218.codfw.wmnet [production]
23:39 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2217.codfw.wmnet [production]
23:39 <mutante> mw2219,mw2220,mw2221 - reinstall with stetch [production]
23:37 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2216.codfw.wmnet [production]
22:31 <bstorm_> labsdb1009,labsdb1010,labsdb1011 are now on up-to-date views per T174047 [production]
22:23 <ppchelko@tin> Started restart [changeprop/deploy@7e86531]: Restart changeprop to try forcing it rebalancing topics [production]
21:28 <mutante> mw2216,mw2217,mw2218 - wmf-auto-reimage --conftool , reinstall with stretch [production]
21:25 <XioNoX> re-pool eqsin - T193897 [production]
20:48 <imarlier@tin> Started restart [performance/coal@50fe0dd]: Restart coal-web service everywhere, hopefully [production]
20:48 <arlolra> Updated Parsoid to 6e38948 (T192909) [production]
20:41 <arlolra@tin> Finished deploy [parsoid/deploy@cd5e875]: Updating Parsoid to 6e38948 (duration: 12m 25s) [production]
20:30 <otto@tin> Finished deploy [statsv/statsv@c186340]: Configure api.version via CLI opt -- prep for Kafka main upgrade T167039 (duration: 00m 05s) [production]
20:30 <otto@tin> Started deploy [statsv/statsv@c186340]: Configure api.version via CLI opt -- prep for Kafka main upgrade T167039 [production]
20:29 <arlolra@tin> Started deploy [parsoid/deploy@cd5e875]: Updating Parsoid to 6e38948 [production]
20:25 <bsitzmann@tin> Finished deploy [mobileapps/deploy@e20f23d]: Update mobileapps to c1f4de6 (T191538) (duration: 06m 09s) [production]
20:19 <bsitzmann@tin> Started deploy [mobileapps/deploy@e20f23d]: Update mobileapps to c1f4de6 (T191538) [production]
19:58 <XioNoX> removing onboard ports license from cr1-eqsin config - T193897 [production]
17:34 <bawolff@tin> Synchronized php-1.32.0-wmf.2/extensions/LoginNotify/includes/Hooks.php: https://gerrit.wikimedia.org/r/#/c/431611/ Do not send loginnotify emails for throttled logins (duration: 01m 08s) [production]
17:29 <cmjohnson1> updating f/w lvs1016 [production]
17:08 <gehel@tin> Finished deploy [wdqs/wdqs@bd4b3ed]: new wdqs GUI, updater and blazegraph (duration: 05m 18s) [production]
17:03 <gehel@tin> Started deploy [wdqs/wdqs@bd4b3ed]: new wdqs GUI, updater and blazegraph [production]
16:57 <elukey> executed sudo megacli -AdpBbuCmd -BbuLearn -aALL -NoLog on analytics1032 - BBU alerts flapping [production]
16:37 <marostegui> Reload haproxy on dbproxy1010 to depool labsdb1011 - https://phabricator.wikimedia.org/T174047 [production]
16:26 <sbisson@tin> Finished deploy [kartotherian/deploy@9935fdb]: Kartotherian: remove temporary and unused osm-intl-i18n source (duration: 03m 28s) [production]
16:23 <sbisson@tin> Started deploy [kartotherian/deploy@9935fdb]: Kartotherian: remove temporary and unused osm-intl-i18n source [production]
15:34 <marostegui> Deploy schema change on db1097:3314 - T191519 T188299 T190148 [production]
15:34 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1097:3314 for alter table (duration: 01m 00s) [production]
15:28 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1084 after alter table (duration: 00m 57s) [production]
14:59 <marostegui> Reload haproxy on dbproxy1010 to repool labsdb1010 - https://phabricator.wikimedia.org/T174047 [production]
14:30 <imarlier@tin> Finished deploy [performance/coal@50fe0dd]: Coal version that uses the graphite API to fetch data, instead of reading directly from whisper files (duration: 00m 13s) [production]
14:30 <imarlier@tin> Started deploy [performance/coal@50fe0dd]: Coal version that uses the graphite API to fetch data, instead of reading directly from whisper files [production]
14:13 <herron> upgraded prometheus-jmx-exporter to 0.3.0-1 on puppetdb servers [production]
14:12 <herron> puppetdb updates complete — re-enabling puppet agents [production]
14:01 <herron> temporarily disabling puppet agents for puppetdb security update [production]
13:36 <zeljkof> EU SWAT finished [production]