5251-5300 of 10000 results (70ms)
2016-12-20 §
15:31 <mobrovac@tin> Starting deploy [parsoid/deploy@e8f0865]: Canary deploy of mwApiServer to wtp[12]001, take two [production]
14:33 <mobrovac@tin> Finished deploy [parsoid/deploy@1d75b14]: Canary deploy of mwApiServer to wtp[12]001 (duration: 00m 32s) [production]
14:33 <mobrovac@tin> Starting deploy [parsoid/deploy@1d75b14]: Canary deploy of mwApiServer to wtp[12]001 [production]
12:04 <jynus> running redact_sanitarium.sh on db1069 [production]
08:27 <elukey> renamed some log files ($something.1.gz to $something.1a.gz) on cp1008 and rutherium to unblock logrotation and reduce cronspam - T132324 [production]
02:29 <mutante> fermium (lists) - upgrade apache2 | uranium (ganglia-web) - upgrade apache2, openssh, openssl [production]
02:26 <l10nupdate@tin> ResourceLoader cache refresh completed at Tue Dec 20 02:26:08 UTC 2016 (duration 4m 48s) [production]
02:23 <mutante> osmium - upgrade imagemagick, php5 packages | hafnium - upgrade php5 [production]
02:21 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.6) (duration: 06m 41s) [production]
02:17 <mutante> contint1002/2001, einsteinium/tegmen - upgrade php5 | bromine - upgrade php5, libs [production]
02:11 <mutante> auth (yubiauth), phab2001 - upgrade php5 | bohrium (piwik) - upgrade ssh,ssl,php5 [production]
02:02 <mutante> copper - upgraded php5* | krypton - installed all pending upgrades [production]
01:45 <mutante> terbium - upgrade imagemagick | wasat - upgrade php5, imagemagick [production]
01:41 <mutante> tin - upgrading php, imagemagick,.. [production]
01:35 <mutante> mira - upgrading php5 packages [production]
2016-12-19 §
21:41 <ejegg|standup> updated fundraising dash from 040557d08b476283df7c2e243c71ce4043ffe7c8 to ea4305bc9b2c919d3f828ba542eb32b91b207af7 [production]
21:00 <nuria@tin> Finished deploy [analytics/refinery@ead5b8b]: (no message) (duration: 01m 59s) [production]
20:58 <nuria@tin> Starting deploy [analytics/refinery@ead5b8b]: (no message) [production]
19:44 <otto@tin> Finished deploy [analytics/refinery@711a572]: (no message) (duration: 00m 06s) [production]
19:44 <otto@tin> Starting deploy [analytics/refinery@711a572]: (no message) [production]
19:41 <nuria@tin> Finished deploy [analytics/refinery@711a572]: (no message) (duration: 00m 04s) [production]
19:41 <nuria@tin> Starting deploy [analytics/refinery@711a572]: (no message) [production]
19:36 <nuria@tin> Finished deploy [analytics/refinery@711a572]: (no message) (duration: 00m 04s) [production]
19:36 <nuria@tin> Starting deploy [analytics/refinery@711a572]: (no message) [production]
19:35 <nuria@tin> Finished deploy [analytics/refinery@711a572]: (no message) (duration: 27m 10s) [production]
19:16 <mutante> analytics1027 - out of disk, apt-get clean to free about 500M [production]
19:08 <nuria@tin> Starting deploy [analytics/refinery@711a572]: (no message) [production]
16:17 <marostegui> Run lots os small optimize tables on db1015 as it needs to get some space back urgently [production]
16:04 <andrewbogott> upgrading to python-urllib3_1.19 on scb1001 [production]
14:02 <jynus> deploying new firewall rules to labsdb1009/10/11 [production]
13:39 <elukey> Manually raise hhvm.server.connection_timeout_seconds on mw1259 to one day [production]
13:15 <_joe_> restarted hhvm, apache on mw1260, raised the apache timeout to 1 day, restarted the jobrunner, disabled puppet [production]
11:47 <_joe_> disabling puppet, reconfiguring timeout on apache, restarting HHVM on mw1259 [production]
10:16 <elukey> reimaging mw1168 and mw1169 to Trusty - T153488 [production]
09:38 <elukey> stopping jobrunner/jobchron daemons on mw116[89] as prep step for repurpose to videoscalers - T153488 [production]
09:23 <marostegui> Stop mysql db2048 (depooled) for maintenance - T149553 [production]
09:20 <elukey> killing irc-echo [production]
09:04 <ariel@tin> Finished deploy [dumps/dumps@c8fb9a1]: table jobs to yaml config; stop dumping private tables completely (duration: 00m 01s) [production]
09:04 <ariel@tin> Starting deploy [dumps/dumps@c8fb9a1]: table jobs to yaml config; stop dumping private tables completely [production]
06:44 <marostegui> Deploy innodb compression dbstore2001 on dewiki and wikidatawiki - T151552 [production]
02:23 <l10nupdate@tin> ResourceLoader cache refresh completed at Mon Dec 19 02:23:18 UTC 2016 (duration 4m 23s) [production]
02:18 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.6) (duration: 06m 39s) [production]
00:33 <mobrovac> starting back cassandra on restbase1011 [production]
2016-12-18 §
22:34 <ariel@tin> Finished deploy [dumps/dumps@92946f0]: make monitoring more robust (duration: 00m 01s) [production]
22:34 <ariel@tin> Starting deploy [dumps/dumps@92946f0]: make monitoring more robust [production]
22:17 <ariel@tin> Finished deploy [dumps/dumps@2a35e23]: fix checkpoint prefetch jobs (duration: 00m 02s) [production]
22:17 <ariel@tin> Starting deploy [dumps/dumps@2a35e23]: fix checkpoint prefetch jobs [production]
18:32 <WMFlabs> Testing [production]
16:45 <elukey> starting cassandra instances on restbase1009, restbase1011 and restbase1013 (one at the time) - T153588 [production]
12:38 <mobrovac> started back cassandra restbase1009-a [production]