|
2020-02-03
§
|
| 21:33 |
<brennen@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.35.0-wmf.16 |
[production] |
| 21:29 |
<bd808> |
Attempting migration to 2020 Kubernetes cluster (T244107) |
[tools.copyvios] |
| 21:28 |
<brennen@deploy1001> |
Synchronized php-1.35.0-wmf.16/includes/TemplateParser.php: Syncing https://gerrit.wikimedia.org/r/c/mediawiki/core/+/569643 for T243548 (duration: 01m 08s) |
[production] |
| 21:26 |
<bd808> |
Moved uwsgi.log archives to $HOME/logs to clean up $HOME a bit |
[tools.copyvios] |
| 21:14 |
<halfak@deploy1001> |
Finished deploy [ores/deploy@50a101a]: T243451 (duration: 12m 47s) |
[production] |
| 21:01 |
<halfak@deploy1001> |
Started deploy [ores/deploy@50a101a]: T243451 |
[production] |
| 20:43 |
<mutante> |
doc1001 - sudo chown -R doc-uploader:doc-uploader /srv/docroot/ |
[production] |
| 20:19 |
<XioNoX> |
reactivate L3 only LB in esams/knams |
[production] |
| 20:19 |
<XioNoX> |
remove test flowspec rule from cr3-knams |
[production] |
| 20:13 |
<mutante> |
doc1001 - re-enabled puppet after merging gerrit:569620 - Git::Clone[integration/docroot]/File[/srv/docroot]/mode: mode changed '2775' to '0755' - Profile::Doc/File[/srv/docroot/org/wikimedia/doc]/group: group changed 'doc-uploader' to 'wikidev', mode changed '0775' to '0755'. needs another follow-up (T237707) |
[production] |
| 19:27 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: [officewiki] Enable VisualEditor desktop section editing (duration: 01m 07s) |
[production] |
| 19:21 |
<Urbanecm> |
Morning SWAT done |
[production] |
| 19:20 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InterwikiSortOrders.php: SWAT: 7b53a52: Add gcr, mnw and szy to InterwikiSortOrders (duration: 01m 11s) |
[production] |
| 19:19 |
<mutante> |
doc1001 - chown -R doc-uploader:doc-uploader /srv/docroot ; temp. disabled puppet (T237707) |
[production] |
| 19:09 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: 7bb6a12: Configure remainder of testwikis group for kask-transition (T243106) (duration: 01m 14s) |
[production] |
| 18:58 |
<mutante> |
< bblack> !log doc1001: chown -R nobody:wikidev /srv/docroot | < mutante> !doc1001 sudo -u doc-uploader chmod g+w /srv/docroot/org/wikimedia/doc | https://gerrit.wikimedia.org/r/c/operations/puppet/+/484304 | (T237707) |
[production] |
| 18:44 |
<bblack> |
doc1001: chown -R nobody:wikidev /srv/docroot |
[production] |
| 18:34 |
<brennen> |
edited /srv/mediawiki-stating/wikiversions.json on deploy1001; scap pull and scap wikiversions-compile on mwdebug1002; revert wikiversions changes on deploy1001. |
[production] |
| 18:25 |
<mholloway-shell@deploy1001> |
helmfile [CODFW] Ran 'apply' command on namespace 'wikifeeds' for release 'production' . |
[production] |
| 18:23 |
<mholloway-shell@deploy1001> |
helmfile [EQIAD] Ran 'apply' command on namespace 'wikifeeds' for release 'production' . |
[production] |
| 18:17 |
<mholloway-shell@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'wikifeeds' for release 'staging' . |
[production] |
| 16:57 |
<wm-bot> |
<jeanfred> Deploy latest from Git master: 3b2867f, 10f67fd, 2e6a669 (T244030), 279c92b, de6308e |
[tools.integraality] |
| 16:52 |
<eevans@deploy1001> |
helmfile [EQIAD] Ran 'apply' command on namespace 'sessionstore' for release 'production' . |
[production] |
| 16:47 |
<eevans@deploy1001> |
helmfile [CODFW] Ran 'apply' command on namespace 'sessionstore' for release 'production' . |
[production] |
| 16:43 |
<hauskatze> |
Gerrit: replication start mediawiki/extensions/AControlImageLink --wait # new repo |
[releng] |
| 16:38 |
<eevans@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'sessionstore' for release 'staging' . |
[production] |
| 16:28 |
<James_F> |
Zuul: Publish `npm run doc` for Vector T242674 |
[releng] |
| 15:38 |
<XioNoX> |
rollback: add debug on eqiad-knams link interfaces - T240659 |
[production] |
| 15:33 |
<XioNoX> |
add debug on eqiad-knams link interfaces - T240659 |
[production] |
| 14:59 |
<moritzm> |
restarting exim on phab* to pick up libidn security update |
[production] |
| 14:55 |
<moritzm> |
restarting superset on an-tool1004/1005 to pick up libidn security update |
[production] |
| 14:44 |
<moritzm> |
restarting apache on an-tool*. cloudmetrics*, logstash*, grafana1002 to pick up libidn security update |
[production] |
| 14:21 |
<moritzm> |
restarting slapd on ldap-corp* to pick up libidn2 security updates |
[production] |
| 14:18 |
<cdanis> |
T243634 ✔️ cdanis@cp4031.ulsfo.wmnet ~ 🕤☕ sudo varnish-frontend-restart |
[production] |
| 14:12 |
<arturo> |
move tools-prometheus-04 from cloudvirt1022 to cloudvirt1013 |
[tools] |
| 13:58 |
<moritzm> |
installing libidn2 security updates |
[production] |
| 13:32 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 13:32 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 13:32 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 13:32 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 13:31 |
<moritzm> |
rebooting ganeti1009 - ganeti1022 to pick up microcode update T228924 |
[production] |
| 12:58 |
<XioNoX> |
deactivate v6 BGP to AS25596 |
[production] |
| 12:57 |
<moritzm> |
installing spamassassin security updates |
[production] |
| 12:53 |
<Urbanecm> |
Previous message should be "EU SWAT done" |
[production] |
| 12:52 |
<Urbanecm> |
Morning SWAT done |
[production] |
| 12:52 |
<Urbanecm> |
Purge https://en.wikipedia.org/static/images/project-logos/zh_classicalwiki*.png (T243509) |
[production] |
| 12:51 |
<urbanecm@deploy1001> |
Synchronized static/images/project-logos/: SWAT: af0b745: Update logo for zh_classical wiki (T243509) (duration: 01m 06s) |
[production] |
| 12:48 |
<arturo> |
shutdown tools-prometheus-01 and tools-prometheus-02, after fixing the proxy `tools-prometheus.wmflabs.org` to tools-prometheus-03, data synced (T238096) |
[tools] |
| 12:45 |
<urbanecm@deploy1001> |
Synchronized dblists/mobilemainpagelegacy.dblist: SWAT: e9387b2: Disable MobileFrontend Mainpage special casing on frwiktionary (T241888) (duration: 01m 05s) |
[production] |
| 12:40 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: 5f13c19: Add minerva custom log for la.wiki (T240728; 2/2) (duration: 01m 06s) |
[production] |