3451-3500 of 10000 results (42ms)
2021-08-17 §
08:15 <jelto@cumin1001> START - Cookbook sre.hosts.downtime for 3:00:00 on mw[1276-1279].eqiad.wmnet with reason: decom old appservers in eqiad T280203 [production]
08:06 <zpapierski@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'rdf-streaming-updater' for release 'main' . [production]
08:00 <jelto@cumin1001> conftool action : set/weight=30; selector: name=mw144[7-9].eqiad.wmnet [production]
07:59 <mutante> mw1384 - start failed ferm service [production]
07:59 <jelto@cumin1001> conftool action : set/weight=30; selector: name=mw1450.eqiad.wmnet [production]
07:52 <mutante> mw1451 through mw1455 - fresh hardware pooled the first time as appservers [production]
07:50 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw145[1-5].eqiad.wmnet [production]
07:49 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw145[1-5].eqiad.wmnet [production]
07:48 <dzahn@cumin1001> conftool action : set/weight=30; selector: name=mw145[1-5].eqiad.wmnet [production]
07:44 <marostegui> Drop aft_feedback tables on x1 T250715 [production]
07:39 <jelto@cumin1001> conftool action : set/pooled=yes; selector: name=mw1450.eqiad.wmnet [production]
07:39 <jelto@cumin1001> conftool action : set/pooled=yes; selector: name=mw144[7-9].eqiad.wmnet [production]
06:57 <tstarling@deploy1002> Synchronized php-1.37.0-wmf.18/extensions/SecurePoll/includes/Entities/Election.php: T288924 (duration: 00m 57s) [production]
06:56 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
06:55 <tstarling@deploy1002> Synchronized php-1.37.0-wmf.18/extensions/SecurePoll/cli/dump.php: T288924 (duration: 00m 58s) [production]
06:54 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
05:59 <TimStarling> foreachwikiindblist securepollglobal mysql.php --write -- -e 'insert into securepoll_properties (pr_entity,pr_key,pr_value) select el_entity,'\''mobile-jump-url'\'','\''https://vote.m.wikimedia.org/wiki/Special:SecurePoll'\'' from securepoll_elections where el_title='\''DWalden STV Election Test 456'\'' limit 1;' [production]
05:47 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
05:43 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
05:37 <tstarling@deploy1002> Finished scap: collected SecurePoll maintenance scripts and bug fix (duration: 04m 12s) [production]
05:36 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
05:35 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
05:33 <tstarling@deploy1002> Started scap: collected SecurePoll maintenance scripts and bug fix [production]
05:28 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
05:27 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
03:11 <eileen> civicrm revision changed from 175a3101f7 to 66568246a2, config revision is 7bdc78073d [production]
02:39 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
02:37 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
02:05 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
02:04 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
00:44 <eileen> civicrm revision changed from ba0c7705bb to 175a3101f7, config revision is 7bdc78073d [production]
00:14 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
00:12 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
00:07 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: eccdd3ed3fda1abee9a4c57719afd0d1faae41c3: Growth mentor dashboard: Enable on testwiki (T278920) (duration: 00m 59s) [production]
2021-08-16 §
23:20 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
23:20 <urbanecm> Evening B&C window done [production]
23:19 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
23:18 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: a14868bbdf442eede5711576c4b4da51df0ccd77: Enable NewUserMessage on hiwiktionary (T287091) (duration: 01m 00s) [production]
23:15 <eileen> civicrm revision changed from 1e32084622 to ba0c7705bb, config revision is 7bdc78073d [production]
22:13 <bblack> dns[1235]002: upgrade gdnsd package to 3.8.0-1~wmf1 [production]
21:31 <bblack> authdns1001: upgrade gdnsd package to 3.8.0-1~wmf1 [production]
21:28 <bblack> dns4002: upgrade gdnsd package to 3.8.0-1~wmf1 [production]
20:38 <bstorm@cumin1001> END (PASS) - Cookbook wmcs.wikireplicas.add_wiki (exit_code=0) [production]
20:38 <bstorm@cumin1001> Added views for new wiki: labswiki T287442 [production]
20:37 <bstorm@cumin1001> START - Cookbook wmcs.wikireplicas.add_wiki [production]
20:36 <bstorm@cumin1001> END (FAIL) - Cookbook wmcs.wikireplicas.add_wiki (exit_code=99) [production]
20:36 <bstorm@cumin1001> START - Cookbook wmcs.wikireplicas.add_wiki [production]
20:35 <bstorm@cumin1001> END (FAIL) - Cookbook wmcs.wikireplicas.add_wiki (exit_code=99) [production]
20:35 <bstorm@cumin1001> START - Cookbook wmcs.wikireplicas.add_wiki [production]
18:48 <dancy> Restarted Jenkins due to stuck jobs. [production]