2015-12-08
§
|
09:15 |
<godog> |
reimage restbase1008 |
[production] |
05:45 |
<gwicke> |
restbase1008: disable cassandra with `systemctl mask cassandra` |
[production] |
04:00 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Tue Dec 8 04:00:02 UTC 2015 (duration 1h 34m 44s) |
[production] |
03:12 |
<gwicke> |
Keeping puppet on restbase production cluster disabled until Marko & Filippo can deploy tomorrow morning. PLEASE DO NOT ENABLE! |
[production] |
02:25 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.7) (duration: 09m 56s) |
[production] |
01:16 |
<catrope@tin> |
Synchronized wmf-config/InitialiseSettings.php: Also blacklist Minerva for WPB (duration: 00m 28s) |
[production] |
00:59 |
<gwicke> |
disabling puppet in production restbase cluster in preparation for testing https://gerrit.wikimedia.org/r/#/c/257408/ in staging |
[production] |
00:39 |
<catrope@tin> |
Synchronized php-1.27.0-wmf.7/extensions/MobileFrontend/: SWAT (duration: 00m 28s) |
[production] |
00:38 |
<catrope@tin> |
Synchronized php-1.27.0-wmf.7/extensions/MwEmbedSupport/: SWAT (duration: 00m 28s) |
[production] |
00:37 |
<catrope@tin> |
Synchronized php-1.27.0-wmf.7/resources/src/oojs-ui-local.js: SWAT: connect OOjs UI to MW's l10n system (duration: 00m 28s) |
[production] |
00:37 |
<catrope@tin> |
Synchronized php-1.27.0-wmf.7/resources/ResourcesOOUI.php: SWAT: connect OOjs UI to MW's l10n system (duration: 00m 27s) |
[production] |
00:34 |
<catrope@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: enable banners on mobile web beta on enwiki; remove MobileFrontend Browse config (duration: 00m 27s) |
[production] |
00:31 |
<catrope@tin> |
Synchronized wmf-config/squid.php: SWAT: stop using separate address for upload in wgHTCPRouting (duration: 00m 29s) |
[production] |
00:07 |
<catrope@tin> |
Synchronized wmf-config/InitialiseSettings.php: Enable Flow opt-in beta feature on bswiki and urwiki (duration: 00m 28s) |
[production] |
2015-12-07
§
|
22:29 |
<ori@tin> |
Synchronized php-1.27.0-wmf.7/extensions/MobileFrontend: I8c94425693: Improve disableImages cookie code (T120151) (duration: 00m 30s) |
[production] |
22:22 |
<ebernhardson@tin> |
Synchronized portals/prod: Deploy updated portals (duration: 00m 27s) |
[production] |
22:01 |
<mdholloway> |
mobileapps deployed 984f14b |
[production] |
21:31 |
<hoo@tin> |
Synchronized php-1.27.0-wmf.7/extensions/Wikidata/: (no message) (duration: 00m 37s) |
[production] |
21:15 |
<subbu> |
finished deploying parsoid sha 4a7df427 (cf0b9ef + cherry-pick of d65debd) |
[production] |
21:09 |
<subbu> |
restart parsoid on wtp1002 as a canary |
[production] |
21:05 |
<subbu> |
starting parsoid deploy |
[production] |
20:33 |
<andrewbogott> |
enabling puppet on labcontrol1002, testing over |
[production] |
20:07 |
<andrewbogott> |
disabling puppet on labcontrol1002 for an ldap/pdns test |
[production] |
19:52 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Repool es1015 at 100% load (duration: 00m 27s) |
[production] |
19:52 |
<andrewbogott> |
restarting nova-compute on all labvirt1X nodes |
[production] |
19:20 |
<andrewbogott> |
restarted pdns on labcontrol1001 and 1002 to catch up with recent opendj restarts |
[production] |
19:11 |
<andrewbogott> |
restarting ldap on neptunium and nembus due to replication warnings in the logs |
[production] |
18:36 |
<jynus> |
es1019 and its management interface became unresponsive |
[production] |
18:16 |
<mutante> |
deleting pmtpa host groups from nagios/icinga |
[production] |
17:04 |
<thcipriani@tin> |
Synchronized php-1.27.0-wmf.7/extensions/MobileApp/config/config.json: SWAT: Roll out RESTBase usage to Android Beta app: 10% [[gerrit:254045]] (duration: 00m 29s) |
[production] |
17:02 |
<thcipriani> |
reset uncommited change to includes/jobqueue/JobRunner.php in /srv/mediawiki-staging/php-1.27.0-wmf.7 |
[production] |
17:00 |
<hashar> |
Restarted Jenkins to start the ZeroMQ publisher https://phabricator.wikimedia.org/T120668 |
[production] |
16:56 |
<_joe_> |
upgrading pybal on primaries in esams, ulsfo, codfw |
[production] |
16:44 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Namespace configuration for en.wiktionary [[gerrit:254476]] and Enable subpages on custom aliases from 112 to 119 [[gerrit:254475]] (duration: 00m 27s) |
[production] |
16:43 |
<_joe_> |
installing pybal on eqiad backups |
[production] |
16:43 |
<jynus> |
restarting mysql, upgrading and rebooting mysql on es1019 |
[production] |
16:36 |
<_joe_> |
installing the new pybal version on the backup lvss in esams and ulsfo |
[production] |
16:31 |
<_joe_> |
upgrading pybal on all the backup LVSs in codfw |
[production] |
16:28 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Rights configuration on fa.wikipedia [[gerrit:254486]] (duration: 00m 29s) |
[production] |
16:28 |
<_joe_> |
upgrading pybal on lvs1007-12 |
[production] |
16:19 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Namespace configuration for ur.wikipedia [[gerrit:254665]] (duration: 00m 30s) |
[production] |
16:18 |
<_joe_> |
uploaded pybal 1.13.2 to reprepro |
[production] |
16:14 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Translate project namesapce for jbowiki [[gerrit:255954]] (duration: 00m 28s) |
[production] |
15:39 |
<moritzm> |
uploaded openssl 1.0.2e-1~wmf1 to carbon |
[production] |
15:37 |
<yurik> |
deployed kartotherian |
[production] |
15:25 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Depool es1019; es1017 at 100% load; pool es1015 with low weight (duration: 00m 28s) |
[production] |
14:56 |
<yurik> |
deployed latest tilerator |
[production] |
14:46 |
<_joe_> |
also restarted pybal on lvs3003 |
[production] |
14:42 |
<_joe_> |
restarted pybal on lvs1006 |
[production] |
14:38 |
<hashar> |
restarting Jenkins |
[production] |