2017-07-06
§
|
02:37 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Thu Jul 6 02:37:44 UTC 2017 (duration 6m 39s) |
[production] |
02:31 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.7) (duration: 09m 25s) |
[production] |
01:26 |
<ejegg> |
re-enabled fundraising jobs |
[production] |
00:46 |
<mutante> |
labcontrol1002 has multiple IPs, 208.80.154.102 (no DNS name) and 208.80.154.12 (labservices1002). labservices1002 is another host that ALSO has the 208.80.154.12 IP and 208.80.154.20 (lab-recursor1). Can the duplicate IP be removed from one of them? T169039 |
[production] |
00:21 |
<twentyafterfour> |
phabricator deployment really finished this time. really. |
[production] |
00:18 |
<twentyafterfour> |
diffusion fatals resolved by restarting apache and clearing phabricator's bytecode cache |
[production] |
00:16 |
<twentyafterfour> |
restarting apache and clearing phabricator caches |
[production] |
00:04 |
<twentyafterfour> |
phabricator update completed. |
[production] |
00:01 |
<twentyafterfour> |
preparing to deploy phabricator release/2017-07-05/1 (Milestone: https://phabricator.wikimedia.org/project/view/2881/ ) |
[production] |
2017-07-05
§
|
23:34 |
<eileen> |
civicrm updated from a9e3e0c55ce1c2a1efc162c1b2d25e6d6e91857c to 89147827da40f2d90784fb444fd3c5ef782a6239 |
[production] |
22:47 |
<Reedy> |
running `mwscript updateArticleCount.php --wiki=commonswiki --update` on screen on terbium T169822 |
[production] |
22:29 |
<mutante> |
subra/suhail: re-enabled puppet, now with role::spare, no more poolcounter, scheduled icinga downtimes for decom (T169506) |
[production] |
22:27 |
<niharika29@tin> |
Synchronized wmf-config/InitialiseSettings.php: Syncing InitialiseSettings for CodeMirror deployment (take 4) (duration: 00m 42s) |
[production] |
22:26 |
<niharika29@tin> |
scap failed: average error rate on 1/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) |
[production] |
22:21 |
<niharika29@tin> |
Synchronized wmf-config/InitialiseSettings.php: Syncing InitialiseSettings for CodeMirror deployment (take 2) (duration: 00m 42s) |
[production] |
22:20 |
<demon@tin> |
Synchronized wmf-config/CommonSettings.php: apache_request_headers protection (duration: 00m 42s) |
[production] |
22:16 |
<mutante> |
subra/suhail: disabling puppet, stopping poolcounterd, stopping other services, first step of decom, replaced by poolcounter200[12] (T169506) |
[production] |
22:13 |
<niharika29@tin> |
Finished scap: Deploying Codemirror on testwiki- full scap (T169284) (duration: 20m 43s) |
[production] |
22:09 |
<eileen> |
upgrade CiviCRM from ea9e3afa9062a8af5aa6202933a11e86e7f62775 to a9e3e0c55ce1c2a1efc162c1b2d25e6d6e91857c |
[production] |
21:53 |
<niharika29@tin> |
Started scap: Deploying Codemirror on testwiki- full scap (T169284) |
[production] |
21:53 |
<niharika29@tin> |
Synchronized wmf-config/InitialiseSettings.php: Syncing InitialiseSettings for CodeMirror deployment (duration: 00m 42s) |
[production] |
21:51 |
<niharika29@tin> |
scap aborted: Deploying Codemirror on testwiki- full scap (T169284) (duration: 03m 10s) |
[production] |
21:47 |
<niharika29@tin> |
Started scap: Deploying Codemirror on testwiki- full scap (T169284) |
[production] |
21:38 |
<niharika29@tin> |
Synchronized php-1.30.0-wmf.7/extensions/CodeMirror/: Deploying CodeMirror to testwiki (T169284) (duration: 00m 44s) |
[production] |
21:03 |
<chasemp> |
add madhuvishy to wmf-nda phab group |
[production] |
20:58 |
<eileen> |
update CiviCRM from e53d62193e51e839229c6aa78015ca0055ed8474 to ea9e3afa9062a8af5aa6202933a11e86e7f62775 |
[production] |
20:14 |
<RainbowSprinkles> |
commonswiki: nevermind that article count thing |
[production] |
20:07 |
<mutante> |
phab2001 - deleted /etc/systemd/system/phd.service (base::service_unit uses /lib/systemd/system/phd.service both have DIFFERENT content and conflicted, causing systemd degradation after reboot) |
[production] |
19:48 |
<RainbowSprinkles> |
commonswiki: running updateArticleCount.php (against the vslow slave) |
[production] |
19:31 |
<mutante> |
phab2001 - rebooting for kernel upgrade |
[production] |
19:19 |
<niharika29@tin> |
Synchronized php-1.30.0-wmf.7/extensions/MobileApp/config/android.json: Syncing in hopes of invalidating cache (duration: 00m 42s) |
[production] |
18:59 |
<niharika29@tin> |
Synchronized wmf-config/InitialiseSettings.php: Fix nowikisource template namespace subpages [mediawiki-config] - https://gerrit.wikimedia.org/r/362272 (duration: 00m 42s) |
[production] |
18:46 |
<niharika29@tin> |
Synchronized wmf-config/InitialiseSettings.php: Add 'WP' namespace alias to ruwiki [mediawiki-config] - https://gerrit.wikimedia.org/r/362267 (duration: 00m 42s) |
[production] |
18:41 |
<niharika29@tin> |
Synchronized wmf-config/InitialiseSettings.php: Add H as wgNamespaceAlias to NS_HELP for en.wikisource [mediawiki-config] - https://gerrit.wikimedia.org/r/362508 (duration: 00m 42s) |
[production] |
18:36 |
<niharika29@tin> |
Synchronized php-1.30.0-wmf.7/extensions/MobileApp/: Enable description editing for all wikis except enwiki. (T146705) (duration: 00m 43s) |
[production] |
18:26 |
<niharika29@tin> |
Synchronized wmf-config/InitialiseSettings.php: Set wgCategoryCollation to 'numeric' at he.wikisource [mediawiki-config] - https://gerrit.wikimedia.org/r/362592 (duration: 00m 43s) |
[production] |
18:14 |
<niharika29@tin> |
Synchronized wmf-config/InitialiseSettings.php: Enable OOjs UI EditPage buttons on es/fr/it/ja/ru-wiki and meta [mediawiki-config] - https://gerrit.wikimedia.org/r/360370 (duration: 00m 45s) |
[production] |
18:08 |
<niharika29@tin> |
Synchronized wmf-config/InitialiseSettings.php: Enable mobile non-JavaScript editing on ptwiki [mediawiki-config] - https://gerrit.wikimedia.org/r/361455 (duration: 00m 45s) |
[production] |
18:00 |
<moritzm> |
rebooting tungsten for kernel update |
[production] |
17:53 |
<moritzm> |
rebooting osmium for kernel update |
[production] |
17:46 |
<gehel> |
cleaning /srv/wdqs/import on all wdqs servers |
[production] |
17:41 |
<apergos> |
re-enabled puppet on stat1003 (last dataset nfs client), manually mounted /mnt/data because puppet run has an unrelated error |
[production] |
16:33 |
<jynus> |
restart mysql on db2062 |
[production] |
16:04 |
<ema> |
restart pybal on lvs200[12] to make them reconnect to conf2001 |
[production] |
16:03 |
<ema> |
restart pybal on lvs200[45] to make them reconnect to conf2001 |
[production] |
15:54 |
<jynus> |
restart mysql on db2072 |
[production] |
15:30 |
<apergos> |
re-enabled puppet on stat1002, did a manual run, dataset filesystem available again there |
[production] |
15:09 |
<apergos> |
re-enabled puppet on snapshot6,7, still watching dataset1001 performance |
[production] |
15:09 |
<ema> |
restart pybal on lvs2003 to make it reconnect to conf2001 |
[production] |
14:45 |
<ema> |
bounce pybal on lvs2006, not synced with etcd information |
[production] |