2051-2100 of 10000 results (41ms)
2021-08-17 §
08:37 <jelto@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts mw[1276-1279].eqiad.wmnet [production]
08:29 <effie> disable puppet on mediawiki hosts to merge 712920 [production]
08:24 <jelto@cumin1001> START - Cookbook sre.hosts.decommission for hosts mw[1276-1279].eqiad.wmnet [production]
08:24 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1456.eqiad.wmnet with reason: new setup [production]
08:24 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1456.eqiad.wmnet with reason: new setup [production]
08:21 <mutante> mw2383 - scap pull (still depooled because T286463 but alerts in Icinga since a while) [production]
08:20 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw1456.eqiad.wmnet with reason: REIMAGE [production]
08:18 <zpapierski@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'rdf-streaming-updater' for release 'main' . [production]
08:18 <jelto@cumin1001> conftool action : set/pooled=inactive; selector: name=mw127[6-9].eqiad.wmnet [production]
08:18 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1456.eqiad.wmnet with reason: REIMAGE [production]
08:17 <jelto@cumin1001> conftool action : set/pooled=no; selector: name=mw127[6-9].eqiad.wmnet [production]
08:15 <jelto@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on mw[1276-1279].eqiad.wmnet with reason: decom old appservers in eqiad T280203 [production]
08:15 <jelto@cumin1001> START - Cookbook sre.hosts.downtime for 3:00:00 on mw[1276-1279].eqiad.wmnet with reason: decom old appservers in eqiad T280203 [production]
08:06 <zpapierski@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'rdf-streaming-updater' for release 'main' . [production]
08:00 <jelto@cumin1001> conftool action : set/weight=30; selector: name=mw144[7-9].eqiad.wmnet [production]
07:59 <mutante> mw1384 - start failed ferm service [production]
07:59 <jelto@cumin1001> conftool action : set/weight=30; selector: name=mw1450.eqiad.wmnet [production]
07:52 <mutante> mw1451 through mw1455 - fresh hardware pooled the first time as appservers [production]
07:50 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw145[1-5].eqiad.wmnet [production]
07:49 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw145[1-5].eqiad.wmnet [production]
07:48 <dzahn@cumin1001> conftool action : set/weight=30; selector: name=mw145[1-5].eqiad.wmnet [production]
07:44 <marostegui> Drop aft_feedback tables on x1 T250715 [production]
07:39 <jelto@cumin1001> conftool action : set/pooled=yes; selector: name=mw1450.eqiad.wmnet [production]
07:39 <jelto@cumin1001> conftool action : set/pooled=yes; selector: name=mw144[7-9].eqiad.wmnet [production]
06:57 <tstarling@deploy1002> Synchronized php-1.37.0-wmf.18/extensions/SecurePoll/includes/Entities/Election.php: T288924 (duration: 00m 57s) [production]
06:56 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
06:55 <tstarling@deploy1002> Synchronized php-1.37.0-wmf.18/extensions/SecurePoll/cli/dump.php: T288924 (duration: 00m 58s) [production]
06:54 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
05:59 <TimStarling> foreachwikiindblist securepollglobal mysql.php --write -- -e 'insert into securepoll_properties (pr_entity,pr_key,pr_value) select el_entity,'\''mobile-jump-url'\'','\''https://vote.m.wikimedia.org/wiki/Special:SecurePoll'\'' from securepoll_elections where el_title='\''DWalden STV Election Test 456'\'' limit 1;' [production]
05:47 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
05:43 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
05:37 <tstarling@deploy1002> Finished scap: collected SecurePoll maintenance scripts and bug fix (duration: 04m 12s) [production]
05:36 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
05:35 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
05:33 <tstarling@deploy1002> Started scap: collected SecurePoll maintenance scripts and bug fix [production]
05:28 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
05:27 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
03:11 <eileen> civicrm revision changed from 175a3101f7 to 66568246a2, config revision is 7bdc78073d [production]
02:39 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
02:37 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
02:05 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
02:04 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
00:44 <eileen> civicrm revision changed from ba0c7705bb to 175a3101f7, config revision is 7bdc78073d [production]
00:14 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
00:12 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
00:07 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: eccdd3ed3fda1abee9a4c57719afd0d1faae41c3: Growth mentor dashboard: Enable on testwiki (T278920) (duration: 00m 59s) [production]
2021-08-16 §
23:20 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
23:20 <urbanecm> Evening B&C window done [production]
23:19 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
23:18 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: a14868bbdf442eede5711576c4b4da51df0ccd77: Enable NewUserMessage on hiwiktionary (T287091) (duration: 01m 00s) [production]