101-150 of 10000 results (57ms)
2020-03-31 §
05:48 <kartik@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'cxserver' for release 'production' . [production]
05:46 <vgutierrez@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
05:46 <vgutierrez@cumin1001> START - Cookbook sre.hosts.downtime [production]
05:46 <kartik@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'cxserver' for release 'staging' . [production]
05:26 <marostegui> Deploy schema change on db1097:3314 [production]
05:13 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1097:3314 for schema change', diff saved to https://phabricator.wikimedia.org/P10822 and previous config saved to /var/cache/conftool/dbconfig/20200331-051354-marostegui.json [production]
00:26 <eileen> civicrm revision changed from cf2e2c11c3 to 524b162174, config revision is 708198a154 [production]
2020-03-30 §
23:30 <cdanis> cr3-esams: commit flex-flow-sizing T248394 [production]
23:20 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Touch and secondary sync of IS for cache-busting (duration: 00m 58s) [production]
23:19 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Alphabetize wikis in each GrowthExperiments settings (duration: 00m 58s) [production]
23:16 <cdanis> cr2-esams: commit flex-flow-sizing T248394 [production]
23:08 <cdanis> cdanis@cr3-knams# commit comment "sensible flow table sizes T248394" [production]
22:56 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Touch and secondary sync of IS for cache-busting (duration: 00m 58s) [production]
22:53 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Provide wmgSiteLogoIcon (duration: 00m 57s) [production]
22:52 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: Set wmgSiteLogoIcon for each project family and four special wikis (duration: 00m 58s) [production]
22:50 <jforrester@deploy1001> Synchronized wmf-config/mobile.php: Set wgMobileFrontendLogo from wgLogos['icon'] if set (duration: 00m 59s) [production]
22:37 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Touch and secondary sync of IS for cache-busting (duration: 00m 57s) [production]
22:36 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Split wgLogos setting into wmgSiteLogo1x etc. (duration: 00m 59s) [production]
22:33 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: Construct wgLogos in CommonSettings so that projects can inherit values (duration: 01m 02s) [production]
19:55 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
19:55 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime [production]
15:36 <ejegg> updated payments listener (standalone SmashPig) from dc0c6b208b to d80e4c5abd [production]
15:32 <vgutierrez> pool cp2033 - T248816 [production]
15:25 <jeh> add icinga 2h downtime and soft reset iDRAC on labstore1005.mgmt.eqiad.wmnet T247965 [production]
14:58 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:57 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
14:57 <vgutierrez@cumin1001> START - Cookbook sre.hosts.decommission [production]
14:55 <vgutierrez@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:53 <vgutierrez> depool & decommission cp2008 - T248864 [production]
14:23 <vgutierrez> pool cp2032 - T248816 [production]
14:17 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
14:17 <vgutierrez@cumin1001> START - Cookbook sre.hosts.decommission [production]
14:01 <vgutierrez> depool & decommission cp2006 - T248856 [production]
13:57 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:45 <vgutierrez> pool cp2031 - T248816 [production]
13:09 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:07 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=99) [production]
13:07 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
13:06 <vgutierrez@cumin1001> START - Cookbook sre.hosts.downtime [production]
12:56 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
12:56 <vgutierrez@cumin1001> START - Cookbook sre.hosts.decommission [production]
12:53 <vgutierrez> depool & decommission cp2005 - T248848 [production]
12:26 <cdanis> cdanis@re0.cr2-codfw# set chassis fpc 5 inline-services flex-flow-sizing cdanis@re0.cr2-codfw# commit comment "flex-flow-sizing T248394" [production]
12:24 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
12:23 <vgutierrez@cumin1001> START - Cookbook sre.hosts.decommission [production]
12:21 <vgutierrez> depool & decommission cp2004 - T248824 [production]
12:03 <XioNoX> delete unused ROA for ARIN v6 prefixes - T235886 [production]
11:59 <XioNoX> delete unused ROAs for RIPE prefixes - T235886 [production]
11:42 <mutante> miscweb2002 - race condition with apache2 mpm and php7.3 module met - a2dismond mpm_event ; systemctl restart apache2 ; puppet agent -tv (also see T196968, https://gerrit.wikimedia.org/r/c/operations/puppet/+/451206) T247887 [production]
11:37 <mutante> miscweb2002 - installed OS, added to puppet, added role and ... sed -i 's/tin.eqiad/deployment.eqiad/g' /srv/deployment/iegreview/iegreview-cache/.config (T247648) [production]