801-850 of 10000 results (72ms)
2019-04-16 ยง
19:49 <otto@deploy1001> scap-helm eventgate-analytics finished [production]
19:49 <otto@deploy1001> scap-helm eventgate-analytics cluster staging completed [production]
19:49 <otto@deploy1001> scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml --reset-values --set debug_mode_enabled=true stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] [production]
19:48 <otto@deploy1001> scap-helm eventgate-analytics finished [production]
19:48 <otto@deploy1001> scap-helm eventgate-analytics cluster staging completed [production]
19:48 <otto@deploy1001> scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml --reset-values --set main_app.debug_mode_enabled=true stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] [production]
19:11 <twentyafterfour> twentyafterfour@deploy1001:/srv/mediawiki-staging$ scap prep 1.34.0-wmf.1 [production]
19:07 <bblack> restarting varnish backend on cp1083 [production]
19:04 <bblack> restarting varnish backend on cp1085 [production]
18:55 <cdanis> cdanis@cp1085.eqiad.wmnet ~ % sudo -i depool [production]
18:53 <otto@deploy1001> scap-helm eventgate-analytics finished [production]
18:53 <otto@deploy1001> scap-helm eventgate-analytics cluster staging completed [production]
18:53 <otto@deploy1001> scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml --reset-values --set main_app.profiling_enabled=true stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] [production]
18:46 <twentyafterfour> branching 1.34.0-wmf.1 refs T220726 [production]
18:25 <otto@deploy1001> scap-helm eventgate-analytics finished [production]
18:25 <otto@deploy1001> scap-helm eventgate-analytics cluster staging completed [production]
18:25 <otto@deploy1001> scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml --reset-values --set wmfdebug_enabled=true stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] [production]
18:14 <cmjohnson1> powering off mw1280 to replace DIMM [production]
18:07 <mutante> restbase2007, restbase2008 - re-enabled puppet which was disabled with reason 'decom'ed' but actually needed to run to decom after they had moved to role::spare::system (T208087) [production]
17:56 <reedy@deploy1001> Synchronized php-1.33.0-wmf.25/extensions/WikimediaIncubator/: T220623 (duration: 00m 53s) [production]
17:47 <herron> beginning rolling ELK upgrade to 5.6.15 [production]
17:46 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/InitialiseSettings-labs.php: [[gerrit:504386|no-op preparatory change (T221107)]] (duration: 00m 52s) [production]
17:36 <arturo> toolforge k8s reallocation (from nova-network to neutron) is causing troubles with IRC bots, expect missing entries in the SAL [production]
17:28 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
17:28 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime [production]
17:27 <andrewbogott> restarting rabbitmq on cloudcontrol1003 [production]
17:26 <cdanis@puppetmaster1001> conftool action : set/pooled=no; selector: dc=eqiad,name=mw1280.eqiad.wmnet,cluster=api_appserver [production]
17:25 <arturo> rebooted cloudnet1003 [production]
17:24 <gehel> force initialization of unassigned shards on elasticsearch eqiad [production]
17:16 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:504374|no-op preparatory change (T221108)]] (duration: 00m 52s) [production]
16:54 <Lucas_WMDE> lucaswerkmeister-wmde@mwmaint1002:~$ mwscript extensions/WikibaseQualityConstraints/maintenance/ImportConstraintEntities.php --wiki=testwikidatawiki --config-format=wgConf | tee T221108.php [production]
16:53 <mutante> bast2001 - shutdown -h now - decom'ed (T219492) [production]
16:48 <mutante> puppet node clean bast2001.wikimedia.org ; puppet node deactivate bast2001.wikimedia.org ; it showed up in Icinga again despite running decom cookbook (T219492) [production]
16:47 <otto@deploy1001> scap-helm eventgate-analytics finished [production]
16:47 <otto@deploy1001> scap-helm eventgate-analytics cluster staging completed [production]
16:47 <otto@deploy1001> scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml --reset-values --set wmfdebug_enabled=true stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] [production]
16:44 <otto@deploy1001> scap-helm eventgate-analytics finished [production]
16:44 <otto@deploy1001> scap-helm eventgate-analytics cluster staging completed [production]
16:44 <otto@deploy1001> scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml --reset-values stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] [production]
16:43 <jynus> upgrading and shutting down db1078 T219115 [production]
16:41 <jynus> disabling notifications on db1078 T219115 [production]
16:37 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1078 (duration: 00m 52s) [production]
15:36 <arturo> reimaging cloudnet2002-dev because role name change [production]
15:21 <otto@deploy1001> scap-helm eventgate-analytics finished [production]
15:21 <otto@deploy1001> scap-helm eventgate-analytics cluster staging completed [production]
15:20 <otto@deploy1001> scap-helm eventgate-analytics upgrade staging --version 0.0.28 -f eventgate-analytics-staging-values.yaml --reset-values stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] [production]
15:19 <otto@deploy1001> scap-helm eventgate-analytics finished [production]
15:19 <otto@deploy1001> scap-helm eventgate-analytics cluster staging completed [production]
15:19 <otto@deploy1001> scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml --reset-values stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] [production]
15:18 <otto@deploy1001> scap-helm eventgate-analytics finished [production]