|
2020-07-02
§
|
| 11:35 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 11:35 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 11:33 |
<vgutierrez> |
rolling restart of codfw load balancers to catch up on kernel upgrades |
[production] |
| 11:18 |
<akosiaris> |
preactively restart docker-registry on registry1001, registry1002 to force CA refresh |
[production] |
| 11:16 |
<akosiaris> |
restart docker-registry on registry2002 for CA refresh |
[production] |
| 11:14 |
<_joe_> |
restarting docker-registry on registry2001 |
[production] |
| 10:34 |
<godog> |
move "cluster overview" dashboard to Thanos - T256954 |
[production] |
| 09:35 |
<XioNoX> |
advertise codfw prefixes from eqord |
[production] |
| 09:28 |
<jayme> |
imported chartmuseum_0.12.0-2 to buster-wikimedia - T253843 |
[production] |
| 09:07 |
<addshore> |
addshore@mwmaint1002:~$ mwscript maintenance/createAndPromote.php --wiki testwikidatawiki --force --custom-groups oversight "DCausse_(WMF)" # T256949 |
[production] |
| 09:07 |
<addshore> |
addshore@mwmaint1002:~$ mwscript maintenance/createAndPromote.php --wiki testwikidatawiki --force --custom-groups oversight "Addshore" # T256949 |
[production] |
| 08:59 |
<XioNoX> |
deploy flex flow for MX204s - T248394 |
[production] |
| 05:52 |
<_joe_> |
removing all tags for envoy-tls-local-proxy |
[production] |
| 05:46 |
<_joe_> |
upload docker-report 0.0.4 on buster-wikimedia T242604 |
[production] |
| 04:32 |
<eileen> |
process-control config revision is b4655897b5 |
[production] |
| 03:17 |
<eileen> |
process-control config revision is 12fe6b5151 |
[production] |
| 03:15 |
<eileen> |
tools revision changed from 4ea8567819 to e974147f27 |
[production] |
| 02:32 |
<eileen> |
tools revision changed from e38f7a83d4 to 4ea8567819 |
[production] |
| 00:53 |
<eileen> |
tools revision changed from 806e2b4412 to e38f7a83d4 |
[production] |
|
2020-07-01
§
|
| 23:53 |
<catrope@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Set $wgForceUIAsContentMsg for zhwikibooks, zhwikinews, zhwikiquote, zhwikisource, zhwikiversity, zhwiktionary (T256521) (duration: 00m 55s) |
[production] |
| 23:35 |
<ejegg> |
updated fundraising CiviCRM from 391d0fdf75 to a48caf0f37 |
[production] |
| 23:32 |
<catrope@deploy1001> |
Synchronized static/images/project-logos/: Change Simplified Chinese logo for zhwiki (T256839) (duration: 00m 55s) |
[production] |
| 23:18 |
<krinkle@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Ibb42db7fd1ee (duration: 00m 55s) |
[production] |
| 23:00 |
<bstorm> |
set a short downtime on labstore1006/7 to prevent alert while disabling direct systemd monitoring |
[production] |
| 22:37 |
<krinkle@deploy1001> |
Synchronized php-1.35.0-wmf.39/includes/Title.php: I8d5bad9c654c4ab (duration: 01m 00s) |
[production] |
| 21:00 |
<mholloway-shell@deploy1001> |
helmfile [CODFW] Ran 'sync' command on namespace 'mobileapps' for release 'production' . |
[production] |
| 20:58 |
<mholloway-shell@deploy1001> |
helmfile [EQIAD] Ran 'sync' command on namespace 'mobileapps' for release 'production' . |
[production] |
| 20:56 |
<mholloway-shell@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'mobileapps' for release 'staging' . |
[production] |
| 20:56 |
<Krinkle> |
krinkle@deploy1001 Ran `scap deploy --init` for /srv/deployment/performance/arc-lamp |
[production] |
| 20:55 |
<mholloway-shell@deploy1001> |
Finished deploy [mobileapps/deploy@d7476f5]: Update mobileapps to 953fc41a (duration: 04m 08s) |
[production] |
| 20:51 |
<mholloway-shell@deploy1001> |
Started deploy [mobileapps/deploy@d7476f5]: Update mobileapps to 953fc41a |
[production] |
| 20:27 |
<eileen> |
tools revision changed from 6f38c14fe3 to 806e2b4412 - |
[production] |
| 20:11 |
<eileen> |
tools revision changed from aab96444df to 6f38c14fe3 |
[production] |
| 19:23 |
<twentyafterfour> |
1.35.0-wmf.39 is now deployed to group2 wikis, everything appears to be normal. refs T254176 |
[production] |
| 19:18 |
<twentyafterfour@deploy1001> |
rebuilt and synchronized wikiversions files: group2 wikis to 1.35.0-wmf.39 refs T254176 |
[production] |
| 18:43 |
<addshore@deploy1001> |
Synchronized wmf-config: REVERT T254315 Wikidata client wikis: Define entity sources configuration [[gerrit:569259]] (duration: 01m 04s) |
[production] |
| 18:41 |
<addshore@deploy1001> |
sync-file aborted: T254315 Wikidata client wikis: Define entity sources configuration [[gerrit:569259]] (duration: 00m 38s) |
[production] |
| 18:38 |
<joal@deploy1001> |
Finished deploy [analytics/refinery@8b7bddf] (thin): Regular analytics weekly train THIN [analytics/refinery@8b7bddf] (duration: 02m 19s) |
[production] |
| 18:36 |
<joal@deploy1001> |
Started deploy [analytics/refinery@8b7bddf] (thin): Regular analytics weekly train THIN [analytics/refinery@8b7bddf] |
[production] |
| 18:35 |
<joal@deploy1001> |
Finished deploy [analytics/refinery@8b7bddf]: Regular analytics weekly train [analytics/refinery@8b7bddf] (duration: 08m 09s) |
[production] |
| 18:27 |
<joal@deploy1001> |
Started deploy [analytics/refinery@8b7bddf]: Regular analytics weekly train [analytics/refinery@8b7bddf] |
[production] |
| 18:25 |
<joal@deploy1001> |
Finished deploy [analytics/refinery@114bfed]: Regular analytics weekly train [analytics/refinery@114bfed] (duration: 03m 41s) |
[production] |
| 18:21 |
<joal@deploy1001> |
Started deploy [analytics/refinery@114bfed]: Regular analytics weekly train [analytics/refinery@114bfed] |
[production] |
| 18:18 |
<ppchelko@deploy1001> |
Synchronized wmf-config/InitialiseSettings-labs.php: Enable kafka purges on wikitech gerrit:607590 IS-labs.php (duration: 01m 03s) |
[production] |
| 18:07 |
<ppchelko@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Deploy MediaModeration on all production wikis gerrit:608753 (duration: 01m 07s) |
[production] |
| 17:14 |
<XioNoX> |
set flex-flow-sizing to cr2-eqsin - T248394 |
[production] |
| 16:57 |
<XioNoX> |
restart cr2-eqsin for software upgrade - T243080 |
[production] |
| 16:00 |
<XioNoX> |
updating eqsin LVS BGP neighbors IPs - T255766 |
[production] |
| 15:16 |
<XioNoX> |
re0.cr1-eqsin> request system power-off both-routing-engines - T255766 |
[production] |
| 15:15 |
<XioNoX> |
disable BGP to pybal on cr1-eqsin - T255766 |
[production] |