2251-2300 of 10000 results (61ms)
2019-05-15 §
16:28 <elukey> restart nutcracker on mw2240 to pick up the new config (no more memcached settings) [production]
16:26 <bstorm_> T212972 updated all views on labsdb1009 [production]
16:17 <reedy@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T223166 (duration: 00m 56s) [production]
16:16 <reedy@deploy1001> Synchronized php-1.34.0-wmf.5/extensions/WikimediaEvents/: T219128 (duration: 01m 13s) [production]
16:14 <reedy@deploy1001> Synchronized php-1.34.0-wmf.4/extensions/WikimediaEvents/: T219128 (duration: 01m 06s) [production]
16:03 <jynus> disable puppet on all production databases [production]
15:21 <reedy@deploy1001> Synchronized php-1.34.0-wmf.4/extensions/GrowthExperiments/includes/HelpPanel/QuestionPoster.php: T222980 (duration: 00m 57s) [production]
14:28 <andrewbogott> repooling labweb1002 [production]
14:16 <andrewbogott> depooling labweb1002 to test https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/509916/ [production]
14:15 <godog> bootstrap restbase1019-b - T219404 [production]
13:21 <anomie@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Setting actor migration to write-new/read-new on testwikis and mediawikiwiki (T188327) (duration: 00m 57s) [production]
12:22 <Lucas_WMDE> EU SWAT done [production]
12:20 <lucaswerkmeister-wmde@deploy1001> Synchronized php-1.34.0-wmf.4/extensions/VisualEditor/: SWAT: [[gerrit:510217|VisualEditorHooks: Use isVisualAvailable() when changing tabs/editsections]] + [[gerrit:510218|DesktopArticleTarget.init: Allow veaction=edit to override namespace settings (T221892)]] (duration: 01m 15s) [production]
12:20 <akosiaris> depool esams, network issues [production]
11:47 <akosiaris@deploy1001> scap-helm mathoid finished [production]
11:47 <akosiaris@deploy1001> scap-helm mathoid cluster staging completed [production]
11:46 <akosiaris@deploy1001> scap-helm mathoid upgrade --wait -f mathoid-staging-values.yaml staging stable/mathoid [namespace: mathoid, clusters: staging] [production]
11:41 <akosiaris@deploy1001> scap-helm citoid finished [production]
11:41 <akosiaris@deploy1001> scap-helm citoid cluster eqiad completed [production]
11:41 <akosiaris@deploy1001> scap-helm citoid upgrade -f citoid-eqiad-values.yaml production stable/citoid [namespace: citoid, clusters: eqiad] [production]
11:32 <akosiaris@deploy1001> scap-helm citoid finished [production]
11:32 <akosiaris@deploy1001> scap-helm citoid cluster codfw completed [production]
11:31 <akosiaris@deploy1001> scap-helm citoid upgrade -f citoid-codfw-values.yaml production stable/citoid [namespace: citoid, clusters: codfw] [production]
11:31 <godog> bootstrap restbase1019-a - T219404 [production]
11:29 <akosiaris> upgrade to statsd_export 0.9 for citoid T220709 [production]
11:27 <akosiaris@deploy1001> scap-helm citoid finished [production]
11:27 <akosiaris@deploy1001> scap-helm citoid cluster staging completed [production]
11:27 <akosiaris@deploy1001> scap-helm citoid upgrade -f citoid-staging-values.yaml staging stable/citoid [namespace: citoid, clusters: staging] [production]
10:31 <elukey> superset.wikimedia.org moved to analytics-tool1004 (Buster + python 3.7 + Superset 0.32 upgrade) [production]
10:27 <moritzm> installing linux 4.9.168-1+deb9u2 kernel on stretch hosts (no reboots, just installing the new package) [production]
10:04 <elukey@deploy1001> Finished deploy [analytics/superset/deploy@9cdb9c5]: Superset 0.32 - update pyhive dependency (duration: 00m 26s) [production]
10:04 <elukey@deploy1001> Started deploy [analytics/superset/deploy@9cdb9c5]: Superset 0.32 - update pyhive dependency [production]
09:33 <hashar> Disable CI castor cache system since the instance is being migrated. Some / most CI jobs might have failed for the last 20 minutes or so T223148 [production]
08:45 <elukey@deploy1001> Finished deploy [analytics/superset/deploy@31c2c30]: Superset 0.32 (duration: 00m 26s) [production]
08:44 <elukey@deploy1001> Started deploy [analytics/superset/deploy@31c2c30]: Superset 0.32 [production]
08:36 <elukey> stop superset on analytics-tool1003 as prep step for the migration to the new host - T212243 [production]
08:31 <moritzm> rebooting mw2164 [production]
07:33 <elukey> restart nutcracker on mw2245 to pick up config changes (removal of memcached config) [production]
07:29 <elukey> powercycle an-worker1094 (OEM event occurred, checking if temporary) [production]
07:21 <oblivian@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Remove the php7 beta feature T219128 (duration: 00m 59s) [production]
06:24 <elukey> force remount of /mnt/hdfs on stat1007 - fuse hdfs stuck [production]
01:40 <eileen> process control updated - omnigroupmember.load re-enabled [production]
01:39 <eileen> civicrm revision changed from 5024c968ed to 4b6d569383, config revision is a099f13a55 [production]
2019-05-14 §
20:44 <herron@deploy1001> Finished deploy [logstash/plugins@7fb8843]: adding logstash-filter-truncate plugin (duration: 00m 07s) [production]
20:43 <herron@deploy1001> Started deploy [logstash/plugins@7fb8843]: adding logstash-filter-truncate plugin [production]
20:41 <herron@deploy1001> Finished deploy [logstash/plugins@7fb8843]: (no justification provided) (duration: 00m 01s) [production]
20:41 <herron@deploy1001> Started deploy [logstash/plugins@7fb8843]: (no justification provided) [production]
20:13 <chaomodus> restarting gerrit on cobalt to pick up metrics export changes [production]
19:37 <herron> adding logstash filter truncate plugin to prod logstash collectors [production]
19:28 <gehel> shutting down elastic2038 for memory replacement - T217398 [production]