2601-2650 of 10000 results (40ms)
2021-10-18 §
14:59 <kormat@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on 11 hosts with reason: Schema change s7 T281058 [production]
14:54 <herron> rebuilt and uploaded kafkatee for bullseye T292196 [production]
14:50 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:45 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
14:36 <phuedx@deploy1002> Synchronized wmf-config/InitialiseSettings-labs.php: Config: [[gerrit:731346|[beta] Rename $wgIPInfoGeoIP2Path to $wgIPInfoGeoIP2Prefix (T289361)]] (duration: 00m 56s) [production]
14:36 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
14:33 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
14:15 <oblivian@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
14:09 <oblivian@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
13:54 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
13:51 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
13:48 <lucaswerkmeister-wmde@deploy1002> Synchronized wmf-config/InitialiseSettings-labs.php: Config: [[gerrit:731015|Remove wmg variables for dispatch via jobs (T291828)]] (2/2) (duration: 00m 56s) [production]
13:47 <lucaswerkmeister-wmde@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:731015|Remove wmg variables for dispatch via jobs (T291828)]] (1/2) (duration: 00m 56s) [production]
13:37 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
13:35 <lucaswerkmeister-wmde@deploy1002> Synchronized wmf-config/Wikibase.php: Config: [[gerrit:731014|Unconditionally enable Wikibase dispatching via jobs (T291828)]] (duration: 00m 56s) [production]
13:34 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
12:22 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2079.codfw.wmnet with OS buster [production]
12:04 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
12:02 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
11:55 <Lucas_WMDE> UTC morning backport window done [production]
11:55 <lucaswerkmeister-wmde@deploy1002> Synchronized wmf-config/InitialiseSettings-labs.php: Config: [[gerrit:730748|Remove $wmgWikibaseDispatchViaJobsAllowedClients (T291828)]] (2/2) (duration: 00m 56s) [production]
11:54 <lucaswerkmeister-wmde@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:730748|Remove $wmgWikibaseDispatchViaJobsAllowedClients (T291828)]] (1/2) (duration: 00m 56s) [production]
11:53 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
11:51 <marostegui@cumin1001> START - Cookbook sre.hosts.reimage for host db2079.codfw.wmnet with OS buster [production]
11:50 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
11:49 <marostegui> Reimage db2079 (codfw s8 master) T290868 [production]
11:48 <lucaswerkmeister-wmde@deploy1002> Synchronized wmf-config/Wikibase.php: Config: [[gerrit:730747|Set dispatchViaJobsAllowedClients to null everywhere (T291828)]] (duration: 00m 56s) [production]
11:41 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
11:38 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
11:37 <lucaswerkmeister-wmde@deploy1002> Synchronized php-1.38.0-wmf.4/extensions/Wikibase/repo/includes/ChangeModification/DispatchChangesJob.php: Backport: [[gerrit:731239|Make deduplication actually work for DispatchChangesJob (T291118)]] (duration: 00m 55s) [production]
11:10 <lucaswerkmeister-wmde@deploy1002> Synchronized php-1.38.0-wmf.4/extensions/Wikibase/repo/includes/Hooks/RecentChangeSaveHookHandler.php: Backport: [[gerrit:731238|Create DispatchChangesJob without change id (T291118)]] (2/2) (duration: 00m 56s) [production]
11:09 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
11:09 <lucaswerkmeister-wmde@deploy1002> Synchronized php-1.38.0-wmf.4/extensions/Wikibase/repo/includes/ChangeModification/DispatchChangesJob.php: Backport: [[gerrit:731238|Create DispatchChangesJob without change id (T291118)]] (duration: 00m 56s) [production]
11:07 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
10:55 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
10:51 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
10:47 <moritzm> copied wmf-certificates from buster-wikimedia to stretch-wikimedia in reprepro [production]
10:38 <lucaswerkmeister-wmde@deploy1002> Synchronized php-1.38.0-wmf.4/extensions/Wikibase/repo/: Backport: [[gerrit:731237|Don't filter by change Id when dispatching to client wikis ()]] (duration: 00m 59s) [production]
09:48 <moritzm> installing node-tar security updates on buster [production]
09:39 <vgutierrez> updating acme-chief to version 0.34 on acmechief instances - T292619 [production]
09:38 <godog> sync metrics from graphite1004 to graphite2003 - T247963 [production]
09:13 <moritzm> installing apr security updates on bullseye [production]
08:57 <godog> cleanup graphite metrics not modified for >= ~3yr (1024 days) [production]
07:34 <ema> cp3060 (text), cp3061 (upload): upgrade varnish to 6.0.8 T292290 [production]
07:34 <elukey> depool + restart blazegraph on wdqs1013 [production]
07:01 <oblivian@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
06:31 <oblivian@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
06:09 <oblivian@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
2021-10-16 §
03:56 <ryankemper@cumin1001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
02:19 <ryankemper@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]