501-550 of 10000 results (49ms)
2021-11-02 ยง
23:46 <tgr> UTC late deploys done [production]
23:45 <tgr@deploy1002> Synchronized wmf-config: Config: Use page id for GrowthExperiments image recommendations, except for testwiki ([[gerrit:736314|736314]] [[gerrit:736317|736317]] (T290949 T292154) (duration: 01m 03s) [production]
23:44 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
23:34 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
23:34 <tgr@deploy1002> Synchronized wmf-config/CommonSettings.php: Config: [[gerrit:735094|Use url-downloader proxy for GrowthExperiments (T290949)]] (duration: 01m 14s) [production]
23:30 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
22:14 <robh@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-db1002.eqiad.wmnet with OS buster [production]
21:50 <robh@cumin1001> START - Cookbook sre.hosts.reimage for host an-db1002.eqiad.wmnet with OS buster [production]
21:32 <robh@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host an-db1002.eqiad.wmnet with OS buster [production]
21:03 <robh@cumin1001> START - Cookbook sre.hosts.reimage for host an-db1002.eqiad.wmnet with OS buster [production]
20:52 <robh@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-db1001.eqiad.wmnet with OS buster [production]
20:28 <robh@cumin1001> START - Cookbook sre.hosts.reimage for host an-db1001.eqiad.wmnet with OS buster [production]
20:01 <thcipriani> 1.38.0-wmf.7 on testwikis, leaving it there for today for US holiday (T293948) [production]
19:58 <thcipriani@deploy1002> Pruned MediaWiki: 1.38.0-wmf.5 (duration: 04m 08s) [production]
19:53 <thcipriani@deploy1002> Finished scap: testwikis wikis to 1.38.0-wmf.7 refs T293948 (duration: 50m 13s) [production]
19:50 <moritzm> imported ganeti 2.16.0-1~bpo9+1+wmf1to component/ganeti216 for stretch-wikimedia (with additional cherrypicked patches for compat with KVM 3.1) T284811 [production]
19:47 <robh@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
19:39 <robh@cumin1001> START - Cookbook sre.dns.netbox [production]
19:35 <robh@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts an-db1002.eqiad.wmnet [production]
19:08 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
19:08 <robh@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host an-db1001.eqiad.wmnet with OS buster [production]
19:05 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
19:02 <thcipriani@deploy1002> Started scap: testwikis wikis to 1.38.0-wmf.7 refs T293948 [production]
18:46 <thcipriani> starting to stage train for 1.38.0-wmf.7 (T293948) [production]
18:33 <robh@cumin1001> START - Cookbook sre.hosts.decommission for hosts an-db1002.eqiad.wmnet [production]
18:32 <robh@cumin1001> START - Cookbook sre.hosts.reimage for host an-db1001.eqiad.wmnet with OS buster [production]
18:23 <robh@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:18 <robh@cumin1001> START - Cookbook sre.dns.netbox [production]
18:15 <robh@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts an-db1001.eqiad.wmnet [production]
18:14 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
18:11 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
18:01 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
17:59 <urbanecm@deploy1002> Synchronized php-1.38.0-wmf.6/extensions/DiscussionTools/modules/dt-ve/dt.ui.UsernameCompletionAction.js: 494af124b95e2eabff94fde79aed6b6f6f81feab: UsernameCompletion: Filter out users with indefinite sitewide blocks from API results (T294783) (duration: 00m 55s) [production]
17:58 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
17:57 <robh@cumin1001> START - Cookbook sre.hosts.decommission for hosts an-db1001.eqiad.wmnet [production]
17:48 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
17:45 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
17:44 <urbanecm@deploy1002> Synchronized wmf-config/CommonSettings.php: 339be07a35de1fa3846b845376695d68a9d743fd: foundationwiki: Set wgCentralAuthCookies to true (T205347) (duration: 00m 54s) [production]
17:35 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
17:33 <moritzm> installing opencv security updates [production]
17:31 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
17:24 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: e3227703a662ecda744bb159f39b128ed289c76d: Revert "Revert "foundationwiki: Enable Translate extension"" (T205349) (duration: 00m 55s) [production]
17:22 <urbanecm@deploy1002> Synchronized php-1.38.0-wmf.6/includes/cache/LinkCache.php: 1e78aeabd682537d8c284559e1356d15c62da810: LinkCache: Try invalidating cache before throwing (T205349) (duration: 00m 56s) [production]
17:22 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
17:18 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
16:38 <mmandere> pool cp4036.ulsfo.wmnet - T290694 [production]
16:30 <mmandere@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp4036.ulsfo.wmnet with OS buster [production]
15:41 <mmandere> pool cp4034.ulsfo.wmnet - T290694 [production]
15:38 <mmandere@cumin1001> START - Cookbook sre.hosts.reimage for host cp4036.ulsfo.wmnet with OS buster [production]
15:32 <mmandere@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp4034.ulsfo.wmnet with OS buster [production]