|
2019-08-02
§
|
| 17:10 |
<krinkle@deploy1001> |
Synchronized docroot/noc/db.php: ee528e886268c08e9377fbd764ec861b09adfc73 (duration: 00m 48s) |
[production] |
| 16:42 |
<XioNoX> |
replace rhenium with netflow1001 netflow target + iBGP peer on all routers |
[production] |
| 15:52 |
<mholloway-shell@deploy1001> |
Finished deploy [mobileapps/deploy@250f711]: Fix MCS production crashers (T229521, T229630) (duration: 04m 41s) |
[production] |
| 15:47 |
<mholloway-shell@deploy1001> |
Started deploy [mobileapps/deploy@250f711]: Fix MCS production crashers (T229521, T229630) |
[production] |
| 15:14 |
<@> |
helmfile [STAGING] Ran 'apply' command on namespace 'restrouter' for release 'staging' . |
[production] |
| 15:12 |
<@> |
helmfile [STAGING] Ran 'apply' command on namespace 'restrouter' for release 'staging' . |
[production] |
| 14:14 |
<mforns@deploy1001> |
Finished deploy [analytics/refinery@b50a939]: deploying refinery up to b50a93955952ed863d5ef7703a91ab59f5d979cf (rollback of cassandra and edit_hourly hive2 actions to unbreak production) (duration: 16m 47s) |
[production] |
| 13:57 |
<mforns@deploy1001> |
Started deploy [analytics/refinery@b50a939]: deploying refinery up to b50a93955952ed863d5ef7703a91ab59f5d979cf (rollback of cassandra and edit_hourly hive2 actions to unbreak production) |
[production] |
| 13:54 |
<@> |
helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . |
[production] |
| 13:45 |
<oblivian@puppetmaster1001> |
conftool action : set/weight=10; selector: cluster=api_appserver,dc=eqiad,service=nginx,name=mw12[23].* |
[production] |
| 12:33 |
<marostegui> |
Restarted wikibugs a few minutes ago as it was not sending anything on IRC |
[production] |
| 11:56 |
<Amir1> |
aborted l10nupdate |
[production] |
| 11:54 |
<Amir1> |
start of l10nupdate |
[production] |
| 11:48 |
<ladsgroup@deploy1001> |
scap sync-l10n completed (1.34.0-wmf.16) (duration: 00m 44s) |
[production] |
| 11:39 |
<ladsgroup@deploy1001> |
Finished scap: [[phab:T229604|Rebuilding l10n cache]] (duration: 05m 06s) |
[production] |
| 11:34 |
<ladsgroup@deploy1001> |
Started scap: [[phab:T229604|Rebuilding l10n cache]] |
[production] |
| 10:51 |
<ladsgroup@deploy1001> |
Synchronized php-1.34.0-wmf.16/extensions/Wikibase: [[gerrit:527501|Revert "fix eslint errors in lib after moving submodule files into lib"]] (duration: 01m 08s) |
[production] |
| 10:01 |
<@> |
helmfile [STAGING] Ran 'apply' command on namespace 'restrouter' for release 'staging' . |
[production] |
| 09:22 |
<marostegui> |
Compress s7 on labsdb1010 - T222978 |
[production] |
| 09:17 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:526657|Revert: Switch property terms migration to WRITE_NEW on production wikidata (T225053)]] (duration: 00m 48s) |
[production] |
| 09:12 |
<elukey> |
umount /sys/kernel/debug/tracing on analytics1043 |
[production] |
| 08:57 |
<akosiaris@> |
helmfile [STAGING] Ran 'apply' command on namespace 'kube-system' for release 'calico-policy-controller' . |
[production] |
| 08:56 |
<@> |
helmfile [STAGING] Ran 'apply' command on namespace 'kube-system' for release 'calico-policy-controller' . |
[production] |
| 08:16 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Add db2129 to s6 (duration: 00m 46s) |
[production] |
| 07:55 |
<marostegui@cumin2001> |
dbctl commit of MediaWiki config (dc=all), diff saved to 'https://phabricator.wikimedia.org/P8852', previous config saved to /var/cache/conftool/dbconfig/20190802-075548-marostegui.json |
[production] |
| 07:53 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Add db2129 to the config T228969 (duration: 00m 47s) |
[production] |
| 07:52 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Add db2129 to the config T228969 (duration: 00m 47s) |
[production] |
| 07:43 |
<marostegui> |
Restart hhvm on mw1226 |
[production] |
| 07:40 |
<_joe_> |
restarting php-fpm on mw1270, with 80 pms - static, apc 6 GB no ttl |
[production] |
| 07:38 |
<_joe_> |
disabling puppet on mw1270 for testing of different php settings |
[production] |
| 07:21 |
<marostegui> |
Add db2124 to tendril and zarcillo T228969 |
[production] |
| 07:00 |
<_joe_> |
running systemd-tmpfiles --create nutcracker.conf on scandium |
[production] |
| 06:46 |
<vgutierrez> |
upgrading acme-chief to version 0.20 in acme-chief test instances - T229096 |
[production] |
| 05:21 |
<vgutierrez> |
uploaded acme-chief 0.20 to apt.wikimedia.org (buster) - T229096 |
[production] |
| 05:10 |
<marostegui> |
Stop MySQL on db2058 for decommissioning T229543 |
[production] |
| 05:06 |
<marostegui> |
Remove db2058 from tendril and zarcillo T229543 |
[production] |
|
2019-08-01
§
|
| 23:32 |
<Urbanecm> |
Evening SWAT done |
[production] |
| 23:32 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: 819073a: Add `autopatrolled` group to az wikisource (T229371) (duration: 00m 49s) |
[production] |
| 23:29 |
<urbanecm@deploy1001> |
Synchronized wmf-config/flaggedrevs.php: SWAT: 8aca0eb: Remove the "autoreview" user group from ru.wikipedia (T229596) (duration: 00m 47s) |
[production] |
| 23:22 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: cf01272: Add importing to english wikiquote (T228607) (duration: 00m 48s) |
[production] |
| 23:10 |
<ebernhardson@deploy1001> |
Synchronized php-1.34.0-wmf.16/extensions/WikimediaEvents/modules/all/ext.wikimediaEvents.searchSatisfaction.js: T229614: Pass proper types to eventlogging to resolve eventlogging errors in wmf.16 (duration: 00m 47s) |
[production] |
| 22:52 |
<mholloway-shell@deploy1001> |
Finished deploy [mobileapps/deploy@5ebf93e]: Update mobileapps to 2ee48ab (duration: 04m 34s) |
[production] |
| 22:47 |
<mholloway-shell@deploy1001> |
Started deploy [mobileapps/deploy@5ebf93e]: Update mobileapps to 2ee48ab |
[production] |
| 22:17 |
<ebernhardson@deploy1001> |
Synchronized php-1.34.0-wmf.16/extensions/WikimediaEvents/extension.json: T229614: Update eventlogging schema version to resolve eventlogging errors in wmf.16 (duration: 00m 47s) |
[production] |
| 22:13 |
<mutante> |
scandium apt-get autoremove |
[production] |
| 22:13 |
<mutante> |
scandium apt-get remove --purge wikimedia-lvs-realserver (T228069) |
[production] |
| 21:48 |
<mutante> |
scandium - apt-get remove --purge hhvm* (T228069) |
[production] |
| 21:23 |
<brennen@deploy1001> |
Synchronized php: group1 and group2 to 1.34.0-wmf.16 (duration: 00m 46s) |
[production] |
| 21:22 |
<brennen@deploy1001> |
rebuilt and synchronized wikiversions files: group1 and group2 to 1.34.0-wmf.16 |
[production] |
| 20:57 |
<krinkle@deploy1001> |
Synchronized php-1.34.0-wmf.16/includes/Revision/RevisionRenderer.php: T229589 - 3f1b32e4db3698b8 (duration: 00m 50s) |
[production] |