|
2016-08-29
§
|
| 23:47 |
<chasemp> |
stop nfs server on labstore1001 to try to fix scratch mount |
[production] |
| 23:38 |
<Krenair> |
added myself to the tools.admin service group earlier to try to figure out what was causing the outage, removed again now |
[tools] |
| 23:34 |
<dereckson@tin> |
Synchronized php-1.28.0-wmf.16/extensions/ORES/includes/Cache.php: Improvements to purging cache (T144216) (duration: 00m 47s) |
[production] |
| 23:27 |
<dereckson@tin> |
Synchronized wmf-config/InitialiseSettings.php: EditSubmitButtonLabelPublish: Temporarily don't do this (currently no-op) (duration: 00m 47s) |
[production] |
| 23:27 |
<dereckson@tin> |
Synchronized wmf-config/InitialiseSettings.php: Add Əlavə namespace to az.wiktionary (T143851) (duration: 00m 47s) |
[production] |
| 23:22 |
<dereckson@tin> |
Synchronized wmf-config/InitialiseSettings.php: ores: Update thresholds (T144101) (duration: 00m 48s) |
[production] |
| 23:13 |
<yuvipanda> |
bumped up worker_connections, restarted nginx |
[tools] |
| 22:45 |
<ejegg> |
enabled donations queue consumer |
[production] |
| 22:40 |
<ejegg> |
updated CiviCRM from d040549105151ccb66a464effbbd56a3e4bfbb8b to e1feb34ff688e230cced92c46e5c2a78e2b3cffa |
[production] |
| 22:39 |
<ejegg> |
disable donations queue consumer |
[production] |
| 22:39 |
<dapatrick> |
Deployed patch for T125177 to 1.28.0-wmf.16 |
[production] |
| 21:56 |
<catrope@tin> |
Synchronized wmf-config/InitialiseSettings.php: T131132 (duration: 00m 48s) |
[production] |
| 21:32 |
<urandom> |
T143226: Perform major compaction on local_group_wikipedia_T_parsoid_html.data, restbase1015-a.eqiad.wmnet |
[production] |
| 21:31 |
<urandom> |
T143226: Starting restbase1015-a.eqiad.wmnet |
[production] |
| 21:29 |
<urandom> |
T143226: Stopping restbase1015-a.eqiad.wmnet to remove repairedAt attribute on a table |
[production] |
| 21:11 |
<urandom> |
T143226: Perform major compaction on local_group_wikipedia_T_parsoid_html.data, restbase1007-b.eqiad.wmnet |
[production] |
| 20:33 |
<akosiaris> |
restarted ircecho on neon.wikimedia.org (icinga-wm) |
[production] |
| 20:12 |
<bd808> |
Updated striker to ffe13c1; see https://wikitech.wikimedia.org/wiki/Toolsadmin.wikimedia.org/Deployments#2016-08-29 |
[production] |
| 20:11 |
<bd808> |
starting striker deploy |
[production] |
| 20:10 |
<subbu> |
finished deploying parsoid sha 48cf803e |
[production] |
| 20:04 |
<subbu> |
synced new parsoid code; restarted parsoid on wtp1001 as a canary |
[production] |
| 20:02 |
<subbu> |
starting parsoid deploy |
[production] |
| 19:53 |
<bd808> |
Updated to 04e6f98 (If authenticating, pause to let auth actually work) && added authentication as registered stashbot freenode account |
[tools.stashbot] |
| 19:41 |
<bd808> |
Taking stashbot offline (hopefully briefly) |
[production] |
| 19:26 |
<Niharika> |
Updated iegreview to 29e98bb (Show all users in 'Manage Users' list (blocked and unblocked both)) |
[production] |
| 19:20 |
<yuvipanda> |
reboot toolsbeta-master, seems, uh, stuck |
[toolsbeta] |
| 19:18 |
<yuvipanda> |
reboot toolsbeta-mail, seems, uh, stuck |
[toolsbeta] |
| 18:48 |
<yuvipanda> |
reboot toolsbeta-puppetmaster3, puppet run process became Zommmmbiiiieeee, ate all my brains |
[toolsbeta] |
| 18:42 |
<thcipriani@tin> |
Synchronized wmf-config/CirrusSearch-common.php: SWAT: [[gerrit:307349|Define variables for AB test for all wikis]] and [[gerrit:307350|Revert "Revert "CirrusSearch BM25 A/B test config""]] (duration: 00m 47s) |
[production] |
| 18:32 |
<chasemp> |
make greg a phab admin to fight surge of spam bots |
[production] |
| 18:29 |
<thcipriani@tin> |
Synchronized wmf-config/CirrusSearch-common.php: REVERT SWAT: [[gerrit:306721|CirrusSearch BM25 A/B test config (T143586)]] (duration: 00m 48s) |
[production] |
| 18:23 |
<thcipriani@tin> |
Synchronized wmf-config/CirrusSearch-common.php: SWAT: [[gerrit:306721|CirrusSearch BM25 A/B test config (T143586)]] (duration: 00m 46s) |
[production] |
| 18:17 |
<yuvipanda> |
kill ldap entry for analytics303, doesn't exist |
[analytics] |
| 18:11 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:307248|Switch enwiki to uca-default collation (T136150)]] (duration: 00m 47s) |
[production] |
| 17:31 |
<demon@tin> |
Synchronized multiversion/: delete deleteMediawiki (duration: 01m 09s) |
[production] |
| 16:35 |
<yuvipanda> |
run chmod u+x /data/project/framabot |
[tools] |
| 16:12 |
<Amir1> |
mwscript extensions/ORES/maintenance/PopulateDatabase.php --wiki=fawiki (and seven other wikis) T144101 |
[production] |
| 16:07 |
<Amir1> |
mwscript extensions/ORES/maintenance/PurgeScoreCache.php --wiki=enwiki (and seven other wikis) (T144101) |
[production] |
| 15:38 |
<bd808> |
Cherry-picked https://gerrit.wikimedia.org/r/#/c/307315/ and restarted bot |
[tools.jouncebot] |
| 15:33 |
<halfak> |
restarted ores-celery-worker service on scb1002 |
[production] |
| 15:23 |
<Amir1> |
ladsgroup@terbium:~$ mwscript extensions/ORES/maintenance/CheckModelVersions.php on (fa|tr|pl|ru|pt|nl|wikidata|en)wiki |
[production] |
| 15:12 |
<halfak> |
deploying ores b8598dd (see T144101) |
[production] |
| 15:03 |
<bd808> |
Stopped & started bot to try and get it back in #wikimedia-operations |
[tools.jouncebot] |
| 14:28 |
<ema@palladium> |
conftool action : set/pooled=yes; selector: cp4015.ulsfo.wmnet |
[production] |
| 14:20 |
<ema@palladium> |
conftool action : set/pooled=no; selector: cp4015.ulsfo.wmnet |
[production] |
| 14:20 |
<ema> |
upgrading cp4015 to Varnish 4 (T131502) |
[production] |
| 14:06 |
<gehel> |
restart elasticsearch on logstash1004 to validate fix for T142357 |
[production] |
| 14:03 |
<hashar> |
European SWAT deploy is complete |
[production] |
| 14:03 |
<chasemp> |
reboot 94886e74-5be4-4669-a1c1-840ce7c65de9 ores-compute-01 |
[ores] |