4451-4500 of 10000 results (39ms)
2021-08-05 §
11:39 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on maps2006.codfw.wmnet with reason: Rebuilding as buster replica of maps2009 [production]
11:39 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on maps2006.codfw.wmnet with reason: Rebuilding as buster replica of maps2009 [production]
11:38 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on maps2008.codfw.wmnet with reason: Rebuilding as buster replica of maps2009 [production]
11:38 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on maps2008.codfw.wmnet with reason: Rebuilding as buster replica of maps2009 [production]
11:11 <hnowlan@puppetmaster1001> conftool action : set/pooled=no; selector: name=maps2006.codfw.wmnet [production]
11:07 <topranks> Reconfiguring packet buffer partitioning on cloudsw-d5-eqiad T288037 [production]
11:06 <ayounsi@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
11:01 <ayounsi@cumin1001> START - Cookbook sre.dns.netbox [production]
10:25 <ladsgroup@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:709821|Add shellbox-constraint services and use them (T176312)]], Part III (duration: 01m 06s) [production]
10:24 <ladsgroup@deploy1002> Synchronized wmf-config/Wikibase.php: Config: [[gerrit:709821|Add shellbox-constraint services and use them (T176312)]], Part II (duration: 01m 07s) [production]
10:23 <ladsgroup@deploy1002> Synchronized wmf-config/ProductionServices.php: Config: [[gerrit:709821|Add shellbox-constraint services and use them (T176312)]], Part I (duration: 01m 07s) [production]
10:15 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
10:11 <vgutierrez> restart acme-chief on acmechief1001 [production]
10:06 <jayme@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host dragonfly-supernode2001.codfw.wmnet [production]
10:04 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
10:03 <topranks> Reconfiguring packet buffer partitioning on cloudsw-c8-eqiad T288036 [production]
10:01 <ladsgroup@deploy1002> Synchronized php-1.37.0-wmf.17/extensions/WikibaseQualityConstraints/src/ConstraintCheck/Checker/FormatChecker.php: Backport: [[gerrit:710093|Route Shellbox requests to 'constraint-regex-checker' service (T176312)]] (duration: 01m 06s) [production]
09:59 <ladsgroup@deploy1002> Synchronized php-1.37.0-wmf.16/extensions/WikibaseQualityConstraints/src/ConstraintCheck/Checker/FormatChecker.php: Backport: [[gerrit:710092|Route Shellbox requests to 'constraint-regex-checker' service (T176312)]] (duration: 01m 27s) [production]
09:56 <jayme@cumin1001> START - Cookbook sre.ganeti.makevm for new host dragonfly-supernode2001.codfw.wmnet [production]
09:49 <oblivian@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
09:36 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on maps1008.eqiad.wmnet with reason: REIMAGE [production]
09:34 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on maps1008.eqiad.wmnet with reason: REIMAGE [production]
09:28 <oblivian@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
09:19 <jayme@cumin1001> conftool action : set/pooled=yes; selector: name=registry2004.codfw.wmnet,dc=codfw,cluster=docker-registry [production]
09:05 <oblivian@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
08:28 <godog> bounce grafana to apply new settings - T119719 [production]
08:00 <marostegui> Failover m2 from db1107 to db1183 - T287852 [production]
06:54 <godog> prometheus/ops codfw +100G [production]
06:15 <godog> add back thanos-be1003 sdf1 in thanos-swift [production]
04:03 <ejegg> re-enabled fundraising scheduled jobs (process-control) [production]
03:03 <ejegg> disabled fundraising scheduled jobs (process-control) [production]
02:50 <TimStarling> on mwmaint1002 killing populateEditCount.php for loginwiki -- it's slow but it's not going to find any edits [production]
02:46 <eileen> civicrm revision changed from d6baf291f4 to e52f569991, config revision is 360c8a1f08 [production]
01:26 <Krinkle> krinkle@mwmaint1002 Temporarily grant myself `translationadmin` on wikimania2016wiki in order to approve an edit given FlaggedRevs-like nature of Translate [production]
00:24 <legoktm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Remove DynamicPageList from all Wikimania wikis except 2016 (T287916) (duration: 01m 52s) [production]
2021-08-04 §
22:18 <ebernhardson@deploy1002> Finished deploy [wikimedia/discovery/analytics@34cd541]: gerrit:709835 and 709836 (duration: 06m 52s) [production]
22:11 <ebernhardson@deploy1002> Started deploy [wikimedia/discovery/analytics@34cd541]: gerrit:709835 and 709836 [production]
20:56 <legoktm@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
20:21 <legoktm@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
19:22 <dduvall> 1.37.0-wmf.17 promoted to group1. no new errors or troubling error rates spotted (T281158) [production]
19:16 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
19:12 <dduvall@deploy1002> Synchronized php: group1 wikis to 1.37.0-wmf.17 (duration: 01m 15s) [production]
19:11 <dduvall@deploy1002> rebuilt and synchronized wikiversions files: group1 wikis to 1.37.0-wmf.17 [production]
18:45 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
18:41 <urbanecm@deploy1002> Synchronized php-1.37.0-wmf.17/extensions/GrowthExperiments/: 5c3ac582335265287369e2d06332645ddbcba412: Fix array key handling for GEHelpPanelLinks in on-wiki config (T288023) (duration: 01m 08s) [production]
18:34 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2380.codfw.wmnet [production]
18:33 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2379.codfw.wmnet [production]
18:30 <urbanecm@deploy1002> Synchronized php-1.37.0-wmf.16/extensions/GrowthExperiments/: 36a2b9f58148dad5434daa6d03b77f4c8b839314: Fix array key handling for GEHelpPanelLinks in on-wiki config (T288023) (duration: 01m 06s) [production]
18:28 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
18:25 <mutante> mw2379, mw2380 - scap pull [production]