|
2016-12-20
§
|
| 15:42 |
<mobrovac@tin> |
Starting deploy [parsoid/deploy@e8f0865]: Deploy of mwApiServer across the wtp fleet |
[production] |
| 15:32 |
<mobrovac@tin> |
Finished deploy [parsoid/deploy@e8f0865]: Canary deploy of mwApiServer to wtp[12]001, take two (duration: 00m 37s) |
[production] |
| 15:31 |
<mobrovac@tin> |
Starting deploy [parsoid/deploy@e8f0865]: Canary deploy of mwApiServer to wtp[12]001, take two |
[production] |
| 14:33 |
<mobrovac@tin> |
Finished deploy [parsoid/deploy@1d75b14]: Canary deploy of mwApiServer to wtp[12]001 (duration: 00m 32s) |
[production] |
| 14:33 |
<mobrovac@tin> |
Starting deploy [parsoid/deploy@1d75b14]: Canary deploy of mwApiServer to wtp[12]001 |
[production] |
| 12:04 |
<jynus> |
running redact_sanitarium.sh on db1069 |
[production] |
| 08:27 |
<elukey> |
renamed some log files ($something.1.gz to $something.1a.gz) on cp1008 and rutherium to unblock logrotation and reduce cronspam - T132324 |
[production] |
| 02:29 |
<mutante> |
fermium (lists) - upgrade apache2 | uranium (ganglia-web) - upgrade apache2, openssh, openssl |
[production] |
| 02:26 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Tue Dec 20 02:26:08 UTC 2016 (duration 4m 48s) |
[production] |
| 02:23 |
<mutante> |
osmium - upgrade imagemagick, php5 packages | hafnium - upgrade php5 |
[production] |
| 02:21 |
<l10nupdate@tin> |
scap sync-l10n completed (1.29.0-wmf.6) (duration: 06m 41s) |
[production] |
| 02:17 |
<mutante> |
contint1002/2001, einsteinium/tegmen - upgrade php5 | bromine - upgrade php5, libs |
[production] |
| 02:11 |
<mutante> |
auth (yubiauth), phab2001 - upgrade php5 | bohrium (piwik) - upgrade ssh,ssl,php5 |
[production] |
| 02:02 |
<mutante> |
copper - upgraded php5* | krypton - installed all pending upgrades |
[production] |
| 01:45 |
<mutante> |
terbium - upgrade imagemagick | wasat - upgrade php5, imagemagick |
[production] |
| 01:41 |
<mutante> |
tin - upgrading php, imagemagick,.. |
[production] |
| 01:35 |
<mutante> |
mira - upgrading php5 packages |
[production] |
|
2016-12-19
§
|
| 21:41 |
<ejegg|standup> |
updated fundraising dash from 040557d08b476283df7c2e243c71ce4043ffe7c8 to ea4305bc9b2c919d3f828ba542eb32b91b207af7 |
[production] |
| 21:39 |
<mutante> |
created instance puppet-paladox so he can use puppet::self for testing his suggested pupppet changes |
[git] |
| 21:27 |
<nuria> |
deployed analytics refinery, restarted webrequest load and pageview_hourly jobs |
[analytics] |
| 21:21 |
<andrewbogott> |
and also python-functools32_3.2.3.2-3~bpo8+1_all.deb |
[deployment-prep] |
| 21:21 |
<andrewbogott> |
and also python-functools32_3.2.3.2-3~bpo8+1_all.deb |
[releng] |
| 21:20 |
<andrewbogott> |
upgrading to python-jsonschema_2.5.1-5~bpo8+1_all.deb on deployment-eventlogging03 |
[deployment-prep] |
| 21:20 |
<andrewbogott> |
upgrading to python-jsonschema_2.5.1-5~bpo8+1_all.deb on deployment-eventlogging03 |
[releng] |
| 21:00 |
<nuria@tin> |
Finished deploy [analytics/refinery@ead5b8b]: (no message) (duration: 01m 59s) |
[production] |
| 20:58 |
<nuria@tin> |
Starting deploy [analytics/refinery@ead5b8b]: (no message) |
[production] |
| 20:51 |
<andrewbogott> |
upgrading to python-requests_2.12.3-1_all.deb ./python-urllib3_1.19.1-1_all.deb on deployment-mediawiki04 and deployment-tin |
[releng] |
| 20:51 |
<andrewbogott> |
upgrading to python-requests_2.12.3-1_all.deb ./python-urllib3_1.19.1-1_all.deb on deployment-mediawiki04 and deployment-tin |
[deployment-prep] |
| 20:11 |
<nuria> |
deployed analytics/refinery to cluster (2nd try) |
[analytics] |
| 20:09 |
<bd808> |
Second time we killed gps_exif_bot2.py (tools.gpsexif), was using 50MB/s io, lagging all of tools-bastion-03 |
[tools.gpsexif] |
| 20:07 |
<valhallasw`cloud> |
killed gps_exif_bot2.py (tools.gpsexif), was using 50MB/s io, lagging all of tools-bastion-03 |
[tools] |
| 19:44 |
<otto@tin> |
Finished deploy [analytics/refinery@711a572]: (no message) (duration: 00m 06s) |
[production] |
| 19:44 |
<otto@tin> |
Starting deploy [analytics/refinery@711a572]: (no message) |
[production] |
| 19:41 |
<nuria@tin> |
Finished deploy [analytics/refinery@711a572]: (no message) (duration: 00m 04s) |
[production] |
| 19:41 |
<nuria@tin> |
Starting deploy [analytics/refinery@711a572]: (no message) |
[production] |
| 19:36 |
<nuria@tin> |
Finished deploy [analytics/refinery@711a572]: (no message) (duration: 00m 04s) |
[production] |
| 19:36 |
<nuria@tin> |
Starting deploy [analytics/refinery@711a572]: (no message) |
[production] |
| 19:35 |
<nuria@tin> |
Finished deploy [analytics/refinery@711a572]: (no message) (duration: 27m 10s) |
[production] |
| 19:16 |
<mutante> |
analytics1027 - out of disk, apt-get clean to free about 500M |
[production] |
| 19:08 |
<nuria@tin> |
Starting deploy [analytics/refinery@711a572]: (no message) |
[production] |
| 16:17 |
<marostegui> |
Run lots os small optimize tables on db1015 as it needs to get some space back urgently |
[production] |
| 16:04 |
<andrewbogott> |
upgrading to python-urllib3_1.19 on scb1001 |
[production] |
| 14:02 |
<jynus> |
deploying new firewall rules to labsdb1009/10/11 |
[production] |
| 13:39 |
<elukey> |
Manually raise hhvm.server.connection_timeout_seconds on mw1259 to one day |
[production] |
| 13:15 |
<_joe_> |
restarted hhvm, apache on mw1260, raised the apache timeout to 1 day, restarted the jobrunner, disabled puppet |
[production] |
| 13:06 |
<yuvipanda> |
run /usr/local/bin/deploy-master http://tools-docker-builder-03.tools.eqiad.wmflabs v1.3.3wmf1 on tools-k8s-master-01 |
[tools] |
| 12:53 |
<yuvipanda> |
cleaned out pbuilder from tools-docker-builder-01 to clean up |
[tools] |
| 11:47 |
<_joe_> |
disabling puppet, reconfiguring timeout on apache, restarting HHVM on mw1259 |
[production] |
| 10:16 |
<elukey> |
reimaging mw1168 and mw1169 to Trusty - T153488 |
[production] |
| 09:38 |
<elukey> |
stopping jobrunner/jobchron daemons on mw116[89] as prep step for repurpose to videoscalers - T153488 |
[production] |