|
2016-10-04
ยง
|
| 19:31 |
<valhallasw`cloud> |
puppet is broken due to incorrect certificates. Cleaning up ('puppet cert clean toolsbeta-webgrid-lighttpd-1406.toolsbeta.eqiad.wmflabs' on puppetmaster3, 'rm -f /var/lib/puppet/client/ssl/certs/toolsbeta-webgrid-lighttpd-1406.toolsbeta.eqiad.wmflabs.pem' on host, for all hosts that I got emails for) |
[toolsbeta] |
| 19:26 |
<thcipriani@tin> |
Started scap: testwiki to 1.28.0-wmf.21 and rebuild l10n cache |
[production] |
| 19:17 |
<bd808> |
Added Markus Kroetzsch and Guenthermi as project maintainers |
[tools.wikidata-exports] |
| 19:09 |
<XenoRyet> |
update civicrm from b45b155befaf0f2f9ff663df156c1882e34b429c to 51b790b6e866f9be2d55a85873b1273923681127 |
[production] |
| 18:40 |
<RoanKattouw> |
Running extension/Echo/removeInvalidNotification.php on testwiki, test2wiki and mediawikiwiki (T147138) |
[production] |
| 18:33 |
<dereckson@tin> |
Synchronized wmf-config/InitialiseSettings.php: Flow opt in: Temporarily disable all, MW.org is redundant ([[Gerrit:314042]]) (duration: 00m 50s) |
[production] |
| 18:25 |
<thcipriani> |
cutting branch 1.28.0-wmf.21 of mediawiki and extensions |
[production] |
| 18:12 |
<XenoRyet> |
update civicrm from e2b5bbfbdaaad29925fc60586ce7a2da8297cc2d to b45b155befaf0f2f9ff663df156c1882e34b429c |
[production] |
| 18:10 |
<awight> |
fundraising campaigns reenabled |
[production] |
| 17:57 |
<yurik> |
deployed tilerator (disabled on maps-test*) https://gerrit.wikimedia.org/r/#/c/314030/ |
[production] |
| 17:51 |
<awight> |
disabled fundraising campaigns |
[production] |
| 17:44 |
<krinkle@tin> |
Synchronized docroot/noc/db.php: (no message) (duration: 00m 48s) |
[production] |
| 17:38 |
<yurik> |
deployed kartotherian https://gerrit.wikimedia.org/r/#/c/314018/ -- Possible issue https://phabricator.wikimedia.org/T147334 |
[production] |
| 17:19 |
<yurik> |
deploying kartotherian & tilerator updates |
[production] |
| 16:55 |
<krinkle@tin> |
Synchronized docroot/noc: (no message) (duration: 01m 01s) |
[production] |
| 16:32 |
<mutante> |
new wiki language Livvi-Karelian -> olo.wikipedia.org has been added to DNS (T146612) |
[production] |
| 16:30 |
<moritzm> |
upgrading labvirt1014 to Linux 4.4 |
[production] |
| 16:30 |
<mutante> |
authdns commands from T97051#1994679 to add olo.wp for T146612 |
[production] |
| 16:29 |
<mutante> |
authdns-gen-zones -f /srv/authdns/git/templates /etc/gdnsd/zones && gdnsd checkconf && gdnsd reload-zones |
[production] |
| 16:22 |
<bd808> |
Restarted puppetmaster process on deployment-puppetmaster |
[releng] |
| 16:19 |
<bd808> |
deployment-puppetmaster: removing cherry-pick of https://gerrit.wikimedia.org/r/#/c/305256/; conflicts with upstream changes |
[releng] |
| 15:18 |
<elukey> |
adding mw120[45] back to the api live pool after reimage |
[production] |
| 15:01 |
<godog> |
shutdown deployment-poolcounter02, replaced by deployment-poolcounter04 - T123734 |
[releng] |
| 15:00 |
<volans> |
created marostegui account into Racktables |
[production] |
| 14:50 |
<godog> |
eqiad-prod: ms-be1022 to weight 1000 T136631 |
[production] |
| 14:11 |
<cmjohnson1> |
ms-be1002 replacing failed disk slot 11 |
[production] |
| 14:07 |
<cmjohnson1> |
db1055 swapped disk 0 |
[production] |
| 14:06 |
<elukey> |
applied role::spare to analytics1026 opened a task to decom it together with 1015 |
[analytics] |
| 13:40 |
<hoo> |
Updated Wikidata's property suggester with data from Monday's json dump and applied the T132839 workarounds |
[production] |
| 13:33 |
<marostegui> |
Remove db1019 from prometheus also adding it to spare as it is going to be decommissioned |
[production] |
| 13:33 |
<godog> |
upgrade grafana to 3.1.1 on labmon1001 - T146354 |
[production] |
| 13:16 |
<hashar@tin> |
Synchronized rpc/RunJobs.php: trick mw into generating a raw exception report (duration: 00m 47s) |
[production] |
| 13:08 |
<elukey> |
reimage mw120[45] to Jessie |
[production] |
| 13:04 |
<hashar> |
Purged namespace 0 pages for arbcom_nlwiki (T147186) via: mwscript purgeList.php --wiki=arbcom_nlwiki --namespace=0 --verbose |
[production] |
| 13:03 |
<hashar@tin> |
Synchronized wmf-config/InitialiseSettings.php: Enable subpages for main namespace in arbcom_nlwiki T147186 (duration: 00m 49s) |
[production] |
| 12:56 |
<hashar@tin> |
Synchronized wmf-config/throttle.php: [throttle] Increase account creation limits for an event in Perpignan on 201 T147293 (duration: 00m 50s) |
[production] |
| 11:14 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Removing db1019 entry as it is going to be decommissioned - T146265 (duration: 00m 51s) |
[production] |
| 11:14 |
<elukey> |
adding mw120[23] back to the live api servers pool |
[production] |
| 10:23 |
<elukey> |
installed memcached 1.4.28-1.1+wmf1 on mc2009 as part of a performance test - T129963 |
[production] |
| 10:07 |
<elukey> |
reimaging mw120[23] to Jessie |
[production] |
| 09:56 |
<elukey> |
adding mw119[89] to the live api server pool (volans provides magic) |
[production] |
| 09:03 |
<hashar> |
Regenerating configuration of all Jenkins job due to https://gerrit.wikimedia.org/r/#/c/313306/ |
[production] |
| 09:02 |
<hashar> |
Regenerating configuration of all Jenkins job due to https://gerrit.wikimedia.org/r/#/c/313306/ |
[releng] |
| 08:43 |
<elukey> |
reimaging mw119[89] to jessie |
[production] |
| 07:10 |
<elukey> |
rebooting eventlog1001 for kernel upgrades (EventLogging stopped) |
[analytics] |
| 07:09 |
<elukey> |
rebooting eventlog1001 for kernel upgrades |
[production] |
| 07:04 |
<elukey> |
executed salt -C 'G@cluster:jobrunner and G@site:eqiad' cmd.run 'find /var/log/hhvm/ -type f -user root -exec chown www-data:www-data {} \;' (also in codfw) to reduce cronspam |
[production] |
| 02:41 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Tue Oct 4 02:41:38 UTC 2016 (duration 4m 55s) |
[production] |
| 02:36 |
<mwdeploy@tin> |
scap sync-l10n completed (1.28.0-wmf.20) (duration: 18m 19s) |
[production] |
| 01:14 |
<twentyafterfour> |
New scap command line autocompletions are now installed on deployment-tin and deployment-mira refs T142880 |
[releng] |