|
2019-12-17
§
|
| 22:55 |
<ebernhardson@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@0dd9f6b]: Ship kerberos configuration for oozie jobs (duration: 15m 50s) |
[production] |
| 22:39 |
<ebernhardson@deploy1001> |
Started deploy [wikimedia/discovery/analytics@0dd9f6b]: Ship kerberos configuration for oozie jobs |
[production] |
| 22:19 |
<akosiaris@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'blubberoid' for release 'staging' . |
[production] |
| 22:18 |
<akosiaris@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . |
[production] |
| 22:10 |
<ebernhardson@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@100bf96]: Ship kerberos configuration for oozie jobs (duration: 00m 34s) |
[production] |
| 22:09 |
<ebernhardson@deploy1001> |
Started deploy [wikimedia/discovery/analytics@100bf96]: Ship kerberos configuration for oozie jobs |
[production] |
| 21:52 |
<cdanis> |
✔️ cdanis@cp3050.esams.wmnet ~ 🕔🍵 sudo depool |
[production] |
| 21:04 |
<mholloway-shell@deploy1001> |
Synchronized php-1.35.0-wmf.10/extensions/MachineVision: Add more info to MachineVisionEntitySaveException message, take 2 (duration: 01m 04s) |
[production] |
| 21:02 |
<mholloway-shell@deploy1001> |
Synchronized php-1.35.0-wmf.11/extensions/MachineVision: Add more info to MachineVisionEntitySaveException message, take 2 (duration: 01m 04s) |
[production] |
| 19:49 |
<hashar> |
Restarting CI Jenkins for plugins upgrades |
[production] |
| 19:41 |
<mholloway-shell@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Disable MachineVision email notifications (T240878) (duration: 01m 07s) |
[production] |
| 19:00 |
<mholloway-shell@deploy1001> |
Synchronized php-1.35.0-wmf.10/extensions/MachineVision: Add more info to MachineVisionEntitySaveException message (duration: 01m 08s) |
[production] |
| 18:58 |
<mholloway-shell@deploy1001> |
Synchronized php-1.35.0-wmf.11/extensions/MachineVision: Add more info to MachineVisionEntitySaveException message (duration: 01m 07s) |
[production] |
| 18:12 |
<mholloway-shell@deploy1001> |
Finished deploy [mobileapps/deploy@c30d801]: Update mobileapps to 5551575 (duration: 06m 38s) |
[production] |
| 18:06 |
<mholloway-shell@deploy1001> |
Started deploy [mobileapps/deploy@c30d801]: Update mobileapps to 5551575 |
[production] |
| 17:06 |
<moritzm> |
uploading debmonitor-client 0.2.0 to apt.wikimedia.org (jessie/stretch/buster) T237978 |
[production] |
| 16:49 |
<marostegui> |
Deploy schema change on commonswiki.logging on db1138 (s4 primary master) - T233135 |
[production] |
| 16:14 |
<jforrester@deploy1001> |
Synchronized php-1.35.0-wmf.10/includes/specials/pagers/NewPagesPager.php: T240924 NewPagesPager: Fix namespace query conditions (duration: 01m 03s) |
[production] |
| 16:07 |
<jforrester@deploy1001> |
Synchronized php-1.35.0-wmf.11/includes/specials/pagers/NewPagesPager.php: T240924 NewPagesPager: Fix namespace query conditions (duration: 01m 02s) |
[production] |
| 15:57 |
<jmm@deploy1001> |
Finished deploy [debmonitor/deploy@bb99a23]: Debmonitor release v0.2.0 - T237978 (duration: 06m 25s) |
[production] |
| 15:52 |
<ema> |
text@ulsfo rolling ats-backend-restart to disable compress plugin https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/558089/ T238495 |
[production] |
| 15:50 |
<jmm@deploy1001> |
Started deploy [debmonitor/deploy@bb99a23]: Debmonitor release v0.2.0 - T237978 |
[production] |
| 15:24 |
<akosiaris@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . |
[production] |
| 15:17 |
<addshore> |
addshore@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/rebuildPropertyTerms.php --wiki=wikidatawiki --batch-size=10 --from-id=3929876 # T237984 (I stopped it at Processed up to page 14546856 (P501)) |
[production] |
| 15:14 |
<onimisionipe> |
pool maps2003 after postgres init - T239728 |
[production] |
| 15:13 |
<addshore> |
addshore@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/rebuildPropertyTerms.php --wiki=wikidatawiki --batch-size=10 --from-id=3929876 # T237984 |
[production] |
| 14:46 |
<akosiaris@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . |
[production] |
| 14:45 |
<akosiaris@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'kube-system' for release 'coredns' . |
[production] |
| 14:45 |
<akosiaris@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . |
[production] |
| 14:42 |
<akosiaris@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . |
[production] |
| 14:42 |
<akosiaris@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'kube-system' for release 'coredns' . |
[production] |
| 14:42 |
<akosiaris@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . |
[production] |
| 14:40 |
<cdanis> |
tearing down tmux sessions generating nic_saturation kludge on some memcached hosts |
[production] |
| 14:36 |
<gehel> |
restarting elastic1054 for config change (new master) |
[production] |
| 14:15 |
<ema> |
cp: rolling ats-tls-restart to clear issues caused by T240950 |
[production] |
| 14:10 |
<marostegui> |
Upgrade db2091 |
[production] |
| 14:05 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@b95d700]: Deploying a fix to the puppet prefix tab (duration: 03m 26s) |
[production] |
| 14:02 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@b95d700]: Deploying a fix to the puppet prefix tab |
[production] |
| 13:53 |
<gehel@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) |
[production] |
| 13:51 |
<gehel@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 13:49 |
<gehel@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) |
[production] |
| 13:48 |
<gehel@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 13:39 |
<jforrester@deploy1001> |
rebuilt and synchronized wikiversions files: group0 to 1.35.0-wmf.11 T233859 |
[production] |
| 13:34 |
<jforrester@deploy1001> |
Finished scap: testwiki to php-1.35.0-wmf.11 and rebuild l10n cache T233859 (duration: 36m 46s) |
[production] |
| 13:25 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Fully repool db1091', diff saved to https://phabricator.wikimedia.org/P9915 and previous config saved to /var/cache/conftool/dbconfig/20191217-132554-marostegui.json |
[production] |
| 13:02 |
<moritzm> |
installing intel-microcode updates to 3.20191115.1 on buster/stretch (with one Xeon type rolled back to a regression causing failing reboots, see DSA 4562-2) |
[production] |
| 13:01 |
<ayounsi@deploy1001> |
Finished deploy [homer/deploy@359de04]: Homer release v0.1.1 - T228388 (duration: 00m 30s) |
[production] |
| 13:01 |
<ayounsi@deploy1001> |
Started deploy [homer/deploy@359de04]: Homer release v0.1.1 - T228388 |
[production] |
| 12:58 |
<jforrester@deploy1001> |
Started scap: testwiki to php-1.35.0-wmf.11 and rebuild l10n cache T233859 |
[production] |
| 12:50 |
<jforrester@deploy1001> |
Pruned MediaWiki: 1.35.0-wmf.8 (duration: 09m 25s) |
[production] |