251-300 of 10000 results (28ms)
2021-12-09 §
10:02 <vgutierrez> pool durum2002 [production]
10:00 <vgutierrez> depool durum2002 [production]
09:24 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2020.codfw.wmnet [production]
09:20 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti2020.codfw.wmnet [production]
09:10 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ganeti2020.codfw.wmnet with OS buster [production]
08:19 <jmm@cumin2002> START - Cookbook sre.hosts.reimage for host ganeti2020.codfw.wmnet with OS buster [production]
08:13 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on ganeti2020.codfw.wmnet with reason: Temporarily remove node from Ganeti for reimage [production]
08:12 <jmm@cumin2002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on ganeti2020.codfw.wmnet with reason: Temporarily remove node from Ganeti for reimage [production]
03:37 <cwhite> bounce superset on an-tool1010 and 1005 to pick up statsd changes T247963 [production]
03:34 <cwhite> bounce navtiming on webperf1001 to pick up statsd changes T297265 [production]
03:31 <cwhite@deploy1002> Synchronized wmf-config/ProductionServices.php: fail over statsd to graphite2003 T297265 (duration: 01m 05s) [production]
03:28 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
03:27 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
02:54 <cwhite> failover statsd ingest host to graphite2003 T297265 [production]
00:26 <rzl> graphite1004.mgmt: /admin1-> racadm serveraction powercycle (T297265) [production]
00:17 <legoktm> deployed updated patches for T297322 [production]
00:11 <rzl> rzl@graphite1004:~$ sudo shutdown -r now T297265 [production]
2021-12-08 §
22:18 <legoktm@deploy1002> Synchronized php-1.38.0-wmf.9/includes/actions/: T297322 (duration: 01m 05s) [production]
22:16 <legoktm@deploy1002> Synchronized php-1.38.0-wmf.12/includes/actions/: T297322 (duration: 01m 05s) [production]
21:48 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
21:46 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
21:42 <dancy@deploy1002> Synchronized php: group1 wikis to 1.38.0-wmf.12 refs T293953 (duration: 01m 04s) [production]
21:41 <dancy@deploy1002> rebuilt and synchronized wikiversions files: group1 wikis to 1.38.0-wmf.12 refs T293953 [production]
21:30 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
21:30 <ladsgroup@deploy1002> Synchronized php-1.38.0-wmf.12/extensions/WikidataPageBanner/includes/WikidataPageBanner.php: Backport: [[gerrit:745240|Make sure 'enable-toc' key is set (T297318)]] (duration: 01m 05s) [production]
21:29 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
20:53 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
20:51 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
20:49 <taavi@deploy1002> Synchronized php-1.38.0-wmf.12/extensions/3D/src/Hooks.php: Backport: [[gerrit:745238|Remove use of $wgUseAjax]] (duration: 01m 07s) [production]
20:30 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
20:29 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
20:27 <jhathaway> enable exim on mx2001 [production]
20:27 <jgiannelos@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . [production]
20:27 <jgiannelos@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . [production]
20:26 <jgiannelos@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . [production]
20:23 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
20:22 <dancy@deploy1002> Synchronized php: group1 wikis to 1.38.0-wmf.9 refs T293953 (duration: 01m 04s) [production]
20:22 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
20:21 <dancy@deploy1002> rebuilt and synchronized wikiversions files: group1 wikis to 1.38.0-wmf.9 refs T293953 [production]
20:17 <dancy@deploy1002> Synchronized php: group1 wikis to 1.38.0-wmf.12 refs T293953 (duration: 01m 05s) [production]
20:16 <dancy@deploy1002> rebuilt and synchronized wikiversions files: group1 wikis to 1.38.0-wmf.12 refs T293953 [production]
20:11 <jgiannelos@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'tegola-vector-tiles' for release 'main' . [production]
19:12 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
19:08 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
19:05 <majavah> utc evening deploys done [production]
19:05 <taavi@deploy1002> Synchronized wmf-config/interwiki.php: Config: [[gerrit:745301|Update interwiki cache]] (duration: 01m 06s) [production]
16:36 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
16:35 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
16:33 <taavi@deploy1002> Synchronized php-1.38.0-wmf.12/extensions/CodeMirror/resources/modules/ve-cm/ve.ui.CodeMirror.init.less: Backport: [[gerrit:744803|Fix invalid reference to core resources/ directory (T296639)]] (duration: 01m 06s) [production]
15:49 <krinkle@deploy1002> Synchronized php-1.38.0-wmf.12/resources/src/mediawiki.base/: Ie9fa768c0dc1 (duration: 01m 06s) [production]