5901-5950 of 10000 results (30ms)
2020-10-12 §
07:53 <filippo@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
07:53 <filippo@cumin1001> START - Cookbook sre.hosts.downtime [production]
2020-10-10 §
01:32 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:633281|Enable session-ip log channel everywhere (T264799)]] (duration: 00m 59s) [production]
00:54 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:633277|Enable session-ip log channel on all but enwiki (T264799)]] (duration: 01m 01s) [production]
00:18 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:633276|Enable session-ip log channel on eswiki (T264799)]] (duration: 00m 55s) [production]
00:13 <mutante> built prometheus-nutcracker-exporter for buster and imported on apt1001 (0.2+nmu1) [production]
2020-10-09 §
23:44 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:633274|Enable session-ip log channel on Wikidata (T264799)]] (duration: 00m 59s) [production]
23:25 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:633272|Enable session-ip log channel on Commons (T264799)]] (duration: 00m 59s) [production]
23:13 <mutante> maps2010 is down since almost 3 days - unhandled crit alert but nothing in SAL and only related ticket says resolved - powercycling it - boots normal but doesn't have a prod role (T260271) [production]
23:07 <mutante> maps2010 is down since almost 3 days - unhandled crit alert but nothing in SAL or tickets [production]
23:06 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
23:06 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
23:06 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
23:06 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
23:06 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
23:06 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
23:03 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
23:03 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
22:52 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:633271|Enable session-ip log channel on group1, except Commons/Wikidata (T264799)]] (duration: 00m 57s) [production]
22:23 <tgr@deploy1001> Synchronized php-1.36.0-wmf.11/includes/: Backport: [[gerrit:633252|Log IP/device changes within the same session (T264799)]] & [[gerrit:633254|SessionManager: Always log IP/UA in session-ip]] (duration: 01m 04s) [production]
22:20 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:633210|Enable session-ip log channel on group0 (T264799)]] (duration: 00m 59s) [production]
22:09 <tgr@deploy1001> Synchronized php-1.36.0-wmf.10/includes/: Backport: [[gerrit:633252|Log IP/device changes within the same session (T264799)]] & [[gerrit:633254|SessionManager: Always log IP/UA in session-ip]] (duration: 01m 06s) [production]
22:01 <tgr_> rolling out T264799#6533622 [production]
21:53 <Urbanecm> [urbanecm@mwmaint2001 ~]$ mwscript extensions/CentralAuth/maintenance/attachAccount.php --wiki=dewiki --userlist users.txt # users.txt contains Almeida # T263935 [production]
20:41 <dwisehaupt> upgrading pay-lvs1001 to buster [production]
20:31 <dwisehaupt> upgrading pay-lvs1002 to buster [production]
20:04 <dwisehaupt> upgrading payments1001 to buster [production]
19:14 <dwisehaupt> upgrading payments1002 to buster [production]
19:10 <dzahn@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
18:44 <dzahn@cumin1001> START - Cookbook sre.ganeti.makevm [production]
18:30 <dwisehaupt> upgrading payments1003 to buster [production]
17:53 <dwisehaupt> upgrading payments1004 to buster [production]
17:52 <cstone> civicrm revision changed from b86a15a430 to 585eb835d8, config revision is 57843925bb [production]
16:06 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
15:56 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
15:42 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
15:40 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
14:41 <jayme@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'zotero' for release 'production' . [production]
14:32 <jayme@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'zotero' for release 'production' . [production]
14:18 <jayme@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'zotero' for release 'staging' . [production]
13:48 <jayme@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'wikifeeds' for release 'production' . [production]
13:45 <jayme> helm rollback push-notification in eqiad to revision 8 [production]
13:31 <gehel@cumin1001> START - Cookbook sre.wdqs.data-reload [production]
13:29 <jayme@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'wikifeeds' for release 'production' . [production]
13:23 <jayme@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'wikifeeds' for release 'staging' . [production]
13:12 <jayme@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'termbox' for release 'production' . [production]
12:55 <jayme@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'termbox' for release 'production' . [production]
12:52 <jayme@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'termbox' for release 'staging' . [production]
12:33 <jayme@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'proton' for release 'production' . [production]
12:20 <jayme@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'push-notifications' for release 'main' . [production]