6551-6600 of 10000 results (84ms)
2020-01-26 §
16:42 <cdanis> ✔️ cdanis@cp4030.ulsfo.wmnet ~ 🕦☕ sudo depool [production]
16:38 <bblack> applying GRE MTU mitigation from T232602 to all cp1, cp3, cp5 cache nodes [production]
15:43 <XioNoX> 3*prepend in esams/knams [production]
15:26 <elukey> repool deployed [production]
15:24 <elukey> repool esams [production]
15:01 <cdanis> deployed [production]
15:00 <cdanis> depool esams [production]
14:56 <XioNoX> enabling netflow sampling on the knams-esams links (esams side) [production]
11:25 <effie> restarted tilerator and tileratorui on maps1002 [production]
11:23 <effie> restarted tilerator and tileratorui on maps1001 [production]
10:38 <effie> deployed [production]
10:37 <effie> Pool esams back [production]
01:12 <cdanis> deployed [production]
01:12 <cdanis> depool esams with new geo-maps-esams-offline [production]
2020-01-25 §
12:49 <Urbanecm> Run mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=mediawikiwiki --logwiki=metawiki TokyVrpns Mike20LCN (T243668) [production]
04:53 <thcipriani|afk> restarting gerrit-replica [production]
2020-01-24 §
22:31 <mutante> ganeti1003 - sudo gnt-instance remove etherpad1001.eqiad.wmnet (T224580) [production]
22:21 <mutante> shutting down etherpad1001 - service fully migrated to etherpad1002 - running decom cookbook on ganeti VM (T224580) [production]
22:20 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
22:19 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
21:18 <cdanis> ✔️ cdanis@cp4029.ulsfo.wmnet ~ 🕟🍵 sudo depool [production]
17:54 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Clean up CheckUser config (duration: 01m 09s) [production]
15:43 <gehel> restart blazegraph + updater on wdqs1007 (seems stuck, known issue) [production]
15:33 <otto@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventstreams' for release 'production' . [production]
14:28 <vgutierrez> uploaded mtail 3.0.0~rc5-1~bpo9+1wmf2 to apt.wm.o (buster) - T243591 [production]
14:26 <akosiaris@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
14:24 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
14:23 <akosiaris@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
13:16 <akosiaris@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . [production]
11:09 <moritzm> purged stale grafana package from grafana1001, caused systemd unit failure [production]
11:04 <effie> restart php-fpm on mw1238-mw1239 [production]
09:29 <akosiaris> disable and mask etherpad-lite on etherpad1002 to avoid corruption issues. T224580 [production]
08:42 <marostegui> Remove wikiadmin2 user from pc2XXX codfw hosts T243512 [production]
08:17 <moritzm> installing python-apt security updates [production]
07:19 <_joe_> force run puppet on all esams cache nodes, for mitigation of T243313 [production]
06:37 <marostegui> Stop replication on db1107 [production]
06:12 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2085 after memory replacement T243148', diff saved to https://phabricator.wikimedia.org/P10256 and previous config saved to /var/cache/conftool/dbconfig/20200124-061228-marostegui.json [production]
01:24 <mutante> running puppet on cp-text_ulsfo [production]
00:46 <mutante> cp4032 - starting varnishmtail.service [production]
00:36 <catrope@deploy1001> Synchronized php-1.35.0-wmf.16/extensions/CentralNotice/resources/ext.centralNotice.display/hide.js: T240802 (duration: 01m 05s) [production]
00:34 <catrope@deploy1001> Synchronized php-1.35.0-wmf.15/extensions/CentralNotice/resources/ext.centralNotice.display/hide.js: T240802 (duration: 01m 07s) [production]
00:33 <mutante> cp4032 - starting varnishmtail.service which was failed [production]
00:32 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Bump Parsoid/PHP cluster memory_limit again (T239806, T236833) (duration: 01m 05s) [production]
2020-01-23 §
21:08 <otto@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventstreams' for release 'production' . [production]
20:30 <brennen@deploy1001> rebuilt and synchronized wikiversions files: Revert "group2 wikis to 1.35.0-wmf.15" [production]
20:29 <brennen> reverting group2 to 1.35.0-wmf.15 [production]
20:10 <brennen@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.35.0-wmf.16 [production]
20:00 <Urbanecm> Morning SWAT done [production]
19:56 <mlitn@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Add 3d-patents page to wgForceUIMsgAsContentMsg (duration: 01m 08s) [production]
19:15 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 2d8f773: Use editeditorprotected for protecting pages for editors (T230103) (duration: 01m 05s) [production]