|
2020-02-03
§
|
| 22:05 |
<mutante> |
ganeti1010 - rebooting host to clear microcode mitigations CPU alert |
[production] |
| 21:39 |
<brennen@deploy1001> |
rebuilt and synchronized wikiversions files: Revert "group2 wikis to 1.35.0-wmf.15" |
[production] |
| 21:33 |
<brennen@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.35.0-wmf.16 |
[production] |
| 21:28 |
<brennen@deploy1001> |
Synchronized php-1.35.0-wmf.16/includes/TemplateParser.php: Syncing https://gerrit.wikimedia.org/r/c/mediawiki/core/+/569643 for T243548 (duration: 01m 08s) |
[production] |
| 21:14 |
<halfak@deploy1001> |
Finished deploy [ores/deploy@50a101a]: T243451 (duration: 12m 47s) |
[production] |
| 21:01 |
<halfak@deploy1001> |
Started deploy [ores/deploy@50a101a]: T243451 |
[production] |
| 20:43 |
<mutante> |
doc1001 - sudo chown -R doc-uploader:doc-uploader /srv/docroot/ |
[production] |
| 20:19 |
<XioNoX> |
reactivate L3 only LB in esams/knams |
[production] |
| 20:19 |
<XioNoX> |
remove test flowspec rule from cr3-knams |
[production] |
| 20:13 |
<mutante> |
doc1001 - re-enabled puppet after merging gerrit:569620 - Git::Clone[integration/docroot]/File[/srv/docroot]/mode: mode changed '2775' to '0755' - Profile::Doc/File[/srv/docroot/org/wikimedia/doc]/group: group changed 'doc-uploader' to 'wikidev', mode changed '0775' to '0755'. needs another follow-up (T237707) |
[production] |
| 19:27 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: [officewiki] Enable VisualEditor desktop section editing (duration: 01m 07s) |
[production] |
| 19:21 |
<Urbanecm> |
Morning SWAT done |
[production] |
| 19:20 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InterwikiSortOrders.php: SWAT: 7b53a52: Add gcr, mnw and szy to InterwikiSortOrders (duration: 01m 11s) |
[production] |
| 19:19 |
<mutante> |
doc1001 - chown -R doc-uploader:doc-uploader /srv/docroot ; temp. disabled puppet (T237707) |
[production] |
| 19:09 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: 7bb6a12: Configure remainder of testwikis group for kask-transition (T243106) (duration: 01m 14s) |
[production] |
| 18:58 |
<mutante> |
< bblack> !log doc1001: chown -R nobody:wikidev /srv/docroot | < mutante> !doc1001 sudo -u doc-uploader chmod g+w /srv/docroot/org/wikimedia/doc | https://gerrit.wikimedia.org/r/c/operations/puppet/+/484304 | (T237707) |
[production] |
| 18:44 |
<bblack> |
doc1001: chown -R nobody:wikidev /srv/docroot |
[production] |
| 18:34 |
<brennen> |
edited /srv/mediawiki-stating/wikiversions.json on deploy1001; scap pull and scap wikiversions-compile on mwdebug1002; revert wikiversions changes on deploy1001. |
[production] |
| 18:25 |
<mholloway-shell@deploy1001> |
helmfile [CODFW] Ran 'apply' command on namespace 'wikifeeds' for release 'production' . |
[production] |
| 18:23 |
<mholloway-shell@deploy1001> |
helmfile [EQIAD] Ran 'apply' command on namespace 'wikifeeds' for release 'production' . |
[production] |
| 18:17 |
<mholloway-shell@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'wikifeeds' for release 'staging' . |
[production] |
| 16:52 |
<eevans@deploy1001> |
helmfile [EQIAD] Ran 'apply' command on namespace 'sessionstore' for release 'production' . |
[production] |
| 16:47 |
<eevans@deploy1001> |
helmfile [CODFW] Ran 'apply' command on namespace 'sessionstore' for release 'production' . |
[production] |
| 16:38 |
<eevans@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'sessionstore' for release 'staging' . |
[production] |
| 15:38 |
<XioNoX> |
rollback: add debug on eqiad-knams link interfaces - T240659 |
[production] |
| 15:33 |
<XioNoX> |
add debug on eqiad-knams link interfaces - T240659 |
[production] |
| 14:59 |
<moritzm> |
restarting exim on phab* to pick up libidn security update |
[production] |
| 14:55 |
<moritzm> |
restarting superset on an-tool1004/1005 to pick up libidn security update |
[production] |
| 14:44 |
<moritzm> |
restarting apache on an-tool*. cloudmetrics*, logstash*, grafana1002 to pick up libidn security update |
[production] |
| 14:21 |
<moritzm> |
restarting slapd on ldap-corp* to pick up libidn2 security updates |
[production] |
| 14:18 |
<cdanis> |
T243634 ✔️ cdanis@cp4031.ulsfo.wmnet ~ 🕤☕ sudo varnish-frontend-restart |
[production] |
| 13:58 |
<moritzm> |
installing libidn2 security updates |
[production] |
| 13:32 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 13:32 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 13:32 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 13:32 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 13:31 |
<moritzm> |
rebooting ganeti1009 - ganeti1022 to pick up microcode update T228924 |
[production] |
| 12:58 |
<XioNoX> |
deactivate v6 BGP to AS25596 |
[production] |
| 12:57 |
<moritzm> |
installing spamassassin security updates |
[production] |
| 12:53 |
<Urbanecm> |
Previous message should be "EU SWAT done" |
[production] |
| 12:52 |
<Urbanecm> |
Morning SWAT done |
[production] |
| 12:52 |
<Urbanecm> |
Purge https://en.wikipedia.org/static/images/project-logos/zh_classicalwiki*.png (T243509) |
[production] |
| 12:51 |
<urbanecm@deploy1001> |
Synchronized static/images/project-logos/: SWAT: af0b745: Update logo for zh_classical wiki (T243509) (duration: 01m 06s) |
[production] |
| 12:45 |
<urbanecm@deploy1001> |
Synchronized dblists/mobilemainpagelegacy.dblist: SWAT: e9387b2: Disable MobileFrontend Mainpage special casing on frwiktionary (T241888) (duration: 01m 05s) |
[production] |
| 12:40 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: 5f13c19: Add minerva custom log for la.wiki (T240728; 2/2) (duration: 01m 06s) |
[production] |
| 12:37 |
<urbanecm@deploy1001> |
Synchronized static/images/mobile/copyright/: SWAT: 5f13c19: Add minerva custom log for la.wiki (T240728; 1/2) (duration: 01m 06s) |
[production] |
| 12:35 |
<moritzm> |
installing openjpeg2 security updates |
[production] |
| 12:31 |
<Urbanecm> |
Purge https://en.wikipedia.org/static/images/mobile/copyright/wikipedia-wordmark-szl.svg (T233104) |
[production] |
| 12:30 |
<urbanecm@deploy1001> |
Synchronized static/images/mobile/copyright/: SWAT: 76e67cd: e266e25: Add wordmarks for szlwiki and etwiki (T233104, T230379) (duration: 01m 06s) |
[production] |
| 12:29 |
<urbanecm@deploy1001> |
Synchronized static/images/mobile/copyright/: SWAT: 76e67cd: e266e25: Add static wordmarks for szlwiki and etwiki (T233104, T230379) (duration: 01m 06s) |
[production] |