1751-1800 of 10000 results (40ms)
2021-10-06 §
00:14 <mutante> puppetmaster2002 - rm /etc/logrotate.d/geoipupdate (not managed by puppet anymore but not removed, caused duplicate logrotate config, made logrotate service fail), start logrotate [production]
00:08 <cstone> civicrm revision changed from 34d3c3aae8 to b6f5f71c18 [production]
00:01 <tgr@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:725132|Add WN as an alias to project namespace in Polish Wikinews (T291344)]] (duration: 01m 04s) [production]
2021-10-05 §
23:54 <tgr@deploy1002> Synchronized static/images/mobile/copyright/wikiversity.svg: Config: [[gerrit:725413|Wikiversity Logo Update for 2017 Logo Version (T292109)]] (duration: 01m 03s) [production]
23:47 <tgr@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:704376|Adding and use wordmark in azwiki (T284877)]] (duration: 01m 04s) [production]
23:44 <tgr@deploy1002> Synchronized static/images/mobile/copyright/wikipedia-wordmark-az.svg: Config: [[gerrit:704376|Adding and use wordmark in azwiki (T284877)]] (duration: 01m 23s) [production]
23:16 <tgr@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:725386|Add image_suggestion_interaction event stream]] (duration: 01m 12s) [production]
23:02 <legoktm> deleting old stretch docker images from the registry for T292485 [production]
22:24 <brennen@deploy1002> rebuilt and synchronized wikiversions files: Revert group0 wikis to 1.38.0-wmf.2 [production]
22:20 <brennen> 1.38.0-wmf.3 (T281167) rolling back to testwikis for the day; will revisit in US-morning [production]
20:47 <brennen@deploy1002> rebuilt and synchronized wikiversions files: group0 wikis to 1.38.0-wmf.3 refs T281167 [production]
20:44 <brennen@deploy1002> Synchronized php-1.38.0-wmf.3/includes/page: Backport: [[gerrit:726594|Pre-format comments for non-local files too]] (T292570) (duration: 01m 04s) [production]
20:18 <mutante> puppetmaster1003 et al - converting maxmind geoip database fetching from cron to timers [production]
20:06 <mutante> cumin 'puppetmaster*' "disable-puppet 'T288844 - T273673 - gerrit:721595 - ${USER}'" [production]
19:30 <mutante> restoring /home/amire80 from and to mwmaint2002 via Bacula bconsole (T292573) [production]
19:09 <brennen@deploy1002> rebuilt and synchronized wikiversions files: Revert group0 wikis to 1.38.0-wmf.2 [production]
19:03 <brennen@deploy1002> rebuilt and synchronized wikiversions files: group0 wikis to 1.38.0-wmf.3 refs T281167 [production]
18:26 <brennen@deploy1002> Pruned MediaWiki: 1.37.0-wmf.23 (duration: 01m 57s) [production]
18:23 <brennen@deploy1002> Pruned MediaWiki: 1.37.0-wmf.21 (duration: 04m 20s) [production]
18:21 <brennen> 1.38.0-wmf.3 (T281167): pruning old branches, starting with 1.37.0-wmf.21, proceeeding to 1.37.0-wmf.23 if time allows [production]
18:11 <ppchelko@deploy1002> Synchronized wmf-config: Remove mb_strtoupper overrides for HHVM T219279 Php72ToUpper.php removal (duration: 01m 06s) [production]
18:04 <ppchelko@deploy1002> Synchronized wmf-config/CommonSettings.php: Remove mb_strtoupper overrides for HHVM T219279 CS.php (duration: 01m 06s) [production]
17:55 <brennen@deploy1002> Finished scap: testwikis wikis to 1.38.0-wmf.3 refs T281167 (duration: 45m 59s) [production]
17:12 <btullis@cumin1001> END (PASS) - Cookbook sre.aqs.roll-restart (exit_code=0) for AQS aqs cluster: Roll restart of all AQS's nodejs daemons. - btullis@cumin1001 [production]
17:09 <brennen@deploy1002> Started scap: testwikis wikis to 1.38.0-wmf.3 refs T281167 [production]
17:03 <btullis@cumin1001> START - Cookbook sre.aqs.roll-restart for AQS aqs cluster: Roll restart of all AQS's nodejs daemons. - btullis@cumin1001 [production]
17:02 <btullis@cumin1001> END (FAIL) - Cookbook sre.aqs.roll-restart (exit_code=99) for AQS aqs cluster: Roll restart of all AQS's nodejs daemons. - btullis@cumin1001 [production]
17:02 <btullis@cumin1001> START - Cookbook sre.aqs.roll-restart for AQS aqs cluster: Roll restart of all AQS's nodejs daemons. - btullis@cumin1001 [production]
16:56 <brennen> successfully applied security patches for 1.38.0-wmf.3 train (T281167) [production]
16:47 <brennen> coordinated with deployment backup and starting train prep for 1.38.0-wmf.3 (T281167), branched at 65279490f82c785181b8b6961e40901a4aaafca4 [production]
15:57 <jbond@cumin2002> END (PASS) - Cookbook sre.puppet.renew-cert (exit_code=0) for puppetboard2002.codfw.wmnet: Renew puppet certificate - jbond@cumin2002 [production]
15:57 <jbond@cumin2002> START - Cookbook sre.puppet.renew-cert for puppetboard2002.codfw.wmnet: Renew puppet certificate - jbond@cumin2002 [production]
15:38 <jbond> reimage puppetboard2002 [production]
15:15 <jbond@cumin1001> END (PASS) - Cookbook sre.puppet.renew-cert (exit_code=0) for puppetboard1002.eqiad.wmnet: Renew puppet certificate - jbond@cumin1001 [production]
15:15 <jbond@cumin1001> START - Cookbook sre.puppet.renew-cert for puppetboard1002.eqiad.wmnet: Renew puppet certificate - jbond@cumin1001 [production]
15:10 <moritzm> imported routinator 0.10.1-1bullseye to thirdparty/routinator for bullseye-wikimedia T292503 [production]
14:58 <jbond> reimage puppetboard1002 [production]
14:40 <effie> depool mw1455 and mw1422 [production]
14:30 <Pchelolo> run foreachwiki uppercaseTitlesForUnicodeTransition.php --charmap current_to_php7_overrides.php T219279 [production]
13:51 <reedy@deploy1002> Synchronized wmf-config/CommonSettings.php: ExtensionDistributor - Drop REL1_31, start REL1_37 (duration: 00m 57s) [production]
13:46 <Pchelolo> run renameInvalidUsernames.php --wiki loginwiki --list /tmp/rename_users_for_uppercase_all.txt T219279 [production]
13:39 <elukey@cumin1001> END (FAIL) - Cookbook sre.aqs.roll-restart (exit_code=99) for AQS aqs cluster: Roll restart of all AQS's nodejs daemons. - elukey@cumin1001 [production]
13:39 <elukey@cumin1001> START - Cookbook sre.aqs.roll-restart for AQS aqs cluster: Roll restart of all AQS's nodejs daemons. - elukey@cumin1001 [production]
13:23 <ppchelko@deploy1002> Synchronized php-1.38.0-wmf.2/maintenance/uppercaseTitlesForUnicodeTransition.php: Backport uppercaseTitlesForUnicodeTransition.php maintenance script improvements T219279 (duration: 00m 58s) [production]
12:53 <ema> upload varnish 6.0.8-1wm1 to apt.wikimedia.org T292290 [production]
12:43 <elukey> import AMD ROCm 4.2 to buster-wikimedia's thirdparty/amd-rocm42 - T287267 [production]
12:24 <ema> deployment-cache-text06: upgrade varnish to 6.0.8-1wm1 T292290 [production]
11:58 <hnowlan> reverted restbase2023 to use CN=hostname certificate due to loading errors [production]
11:57 <hnowlan@cumin1001> END (FAIL) - Cookbook sre.cassandra.roll-restart (exit_code=99) for nodes matching restbase2023.codfw.wmnet: Switching over to using FQDN certificate - hnowlan@cumin1001 [production]
11:57 <hnowlan@cumin1001> START - Cookbook sre.cassandra.roll-restart for nodes matching restbase2023.codfw.wmnet: Switching over to using FQDN certificate - hnowlan@cumin1001 [production]