2201-2250 of 10000 results (85ms)
2019-12-18 ยง
14:37 <jmm@cumin2001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
14:37 <jmm@cumin2001> START - Cookbook sre.hosts.decommission [production]
14:28 <moritzm> removing pollux from Ganeti (obsoleted by ldap-corp2001 for a while now) [production]
14:06 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'zotero' for release 'production' . [production]
14:06 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'wikifeeds' for release 'production' . [production]
14:05 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'termbox' for release 'production' . [production]
14:05 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'sessionstore' for release 'production' . [production]
14:04 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'restrouter' for release 'production' . [production]
14:02 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'mathoid' for release 'production' . [production]
14:02 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'blubberoid' for release 'production' . [production]
14:02 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventgate-main' for release 'main' . [production]
14:01 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'logging-external' . [production]
14:00 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventgate-analytics' for release 'analytics' . [production]
13:59 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'echostore' for release 'production' . [production]
13:58 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'cxserver' for release 'production' . [production]
13:58 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'citoid' for release 'production' . [production]
13:57 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'blubberoid' for release 'production' . [production]
13:38 <moritzm> installing dbus security updates for stretch [production]
13:30 <jforrester@deploy1001> rebuilt and synchronized wikiversions files: train: Rolling Wikitech back to 1.35.0-wmf.10 T233859 [production]
13:11 <jforrester@deploy1001> rebuilt and synchronized wikiversions files: train: Rolling Commons back to 1.35.0-wmf.10 T233859 [production]
13:04 <jforrester@deploy1001> Synchronized php: group1 wikis to 1.35.0-wmf.11 (duration: 01m 01s) [production]
13:03 <jforrester@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.11 [production]
13:02 <moritzm> installing ruby2.5 security updates [production]
12:56 <jbond42> enable puppet fleet wide [production]
12:52 <jbond42> disable puppet fleet wide to restart apache on puppetmasters [production]
12:52 <akosiaris> pool wikifeeds eqiad. For some reason it was depooled [production]
12:50 <akosiaris@cumin1001> conftool action : set/pooled=true; selector: name=eqiad,dnsdisc=(wikifeeds) [production]
12:48 <wmde-fisch@deploy1001> Synchronized php-1.35.0-wmf.11/extensions/Popups: SWAT: [[gerrit:559010|Fix initial preferences for newly created user accounts (T240947)]] (duration: 01m 02s) [production]
12:35 <wmde-fisch@deploy1001> Synchronized php-1.35.0-wmf.10/extensions/Popups: SWAT: [[gerrit:559010|Fix initial preferences for newly created user accounts (T240947)]] (duration: 01m 03s) [production]
12:21 <ladsgroup@deploy1001> Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:558239|Add a bit for forcing LC caching backend in cli mode (T105683)]] (duration: 01m 03s) [production]
11:28 <moritzm> installing ruby2.3 security updates [production]
11:27 <jbond42> installing apache update on basion servers [production]
11:26 <moritzm> installing spamassassin security updates on fermium/lists [production]
11:16 <marostegui> Upgrade db2081, db2082 [production]
11:14 <moritzm> installing spamassassin security updates on mendelevium/OTRS [production]
10:47 <jforrester@deploy1001> Synchronized php-1.35.0-wmf.11/extensions/VisualEditor/includes/ApiVisualEditor.php: T240961: Fix unchecked array access in ApiVisualEditor (duration: 01m 02s) [production]
10:16 <akosiaris> depooling eventgate.*|mathoid|citoid|restrouter|sessionstore|echostore|zotero|termbox|wikifeeds|cxserver|blubberoid) from codfw kubernetes [production]
10:16 <akosiaris@cumin1001> conftool action : set/pooled=false; selector: name=codfw,dnsdisc=(eventgate.*|mathoid|citoid|restrouter|sessionstore|echostore|zotero|termbox|wikifeeds|cxserver|blubberoid) [production]
10:10 <marostegui> Upgrade db2083 [production]
10:09 <jforrester@deploy1001> Synchronized php-1.35.0-wmf.10/extensions/GrowthExperiments/includes: T240444 Make PageViewInfo a soft dependency (duration: 01m 04s) [production]
10:06 <akosiaris@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
10:06 <akosiaris@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:05 <akosiaris@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:05 <akosiaris@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:05 <akosiaris@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:05 <akosiaris@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:05 <akosiaris@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
10:05 <akosiaris@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:04 <akosiaris@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:04 <akosiaris@cumin1001> START - Cookbook sre.hosts.downtime [production]