|
2017-04-06
§
|
| 12:51 |
<ema> |
upgrade cp3007 to linux 4.9 T162029 |
[production] |
| 12:50 |
<moritzm> |
upgraded mw1261 to HHVM 3.18.2 with cherrypicked fix for stat_cache deadlock, now running with stat_cache enabled again |
[production] |
| 12:39 |
<ema> |
rebooting cp2006 again to check for potential issues bringing up network ifaces / loading intel_uncore T162029 |
[production] |
| 12:28 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Restore db1081 original weight - T161088 (duration: 00m 40s) |
[production] |
| 12:28 |
<ema> |
cp2009 stuck rebooting, powercycled |
[production] |
| 12:20 |
<ema> |
upgrade cp2009 to linux 4.9 T162029 |
[production] |
| 12:16 |
<moritzm> |
uploaded HHVM 3.18.2 to jessie-wikimedia/experimental |
[production] |
| 11:51 |
<ema> |
upgrade cp2006 to linux 4.9 T162029 |
[production] |
| 11:27 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increae db1081 weight - T161088 (duration: 00m 40s) |
[production] |
| 10:59 |
<_joe_> |
running some tests for the switchdc automation |
[production] |
| 09:33 |
<moritzm> |
installing freetype security updates on trusty |
[production] |
| 08:43 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increae db1081 weight - T161088 (duration: 00m 39s) |
[production] |
| 08:41 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=no; selector: dc=codfw,cluster=wdqs |
[production] |
| 08:40 |
<moritzm> |
installing glibc updates on trusty |
[production] |
| 08:37 |
<gehel> |
shutting down wdqs codfw for data reimport - T162111 |
[production] |
| 08:34 |
<hashar> |
starting Jenkins on contint1001 |
[production] |
| 08:27 |
<moritzm> |
rebooting contint1001 to Linux 4.9 |
[production] |
| 08:02 |
<elukey> |
restart hhvm on mw1194 - dump debug in /tmp/hhvm.1692.bt. - threads stuck in HPHP::Treadmill::getAgeOldestRequest |
[production] |
| 07:56 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increae db1081 weight - T161088 (duration: 00m 39s) |
[production] |
| 07:32 |
<ema> |
cache_upload: ban all objects with content-type ~ "^text" T162035 |
[production] |
| 07:16 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1081 with low weight - T161088 (duration: 00m 48s) |
[production] |
| 06:29 |
<elukey> |
restart hhvm on mw1165 (jobrunner) - dump debug in /tmp/hhvm.19449.bt. - threads stuck in HPHP::Treadmill::getAgeOldestRequest |
[production] |
| 06:09 |
<marostegui> |
Deploy schema change db2029 (s7 codfw master) - T160390 |
[production] |
| 06:02 |
<marostegui> |
Configure and start replication on db1081 after the defragment - T161088 |
[production] |
| 05:58 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2047 - T160390 (duration: 00m 40s) |
[production] |
| 05:41 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1070 after compression - T153743 (duration: 00m 51s) |
[production] |
| 04:06 |
<twentyafterfour> |
restarting apache2 on iridium to apply a minor hotfix |
[production] |
| 03:06 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Thu Apr 6 03:06:35 UTC 2017 (duration 5m 59s) |
[production] |
| 03:00 |
<l10nupdate@tin> |
scap sync-l10n completed (1.29.0-wmf.19) (duration: 15m 46s) |
[production] |
| 02:25 |
<l10nupdate@tin> |
scap sync-l10n completed (1.29.0-wmf.18) (duration: 10m 28s) |
[production] |
| 01:45 |
<mutante> |
restarting gerrit to pick up config change gerrit:346180 (disable MD5) |
[production] |
| 00:39 |
<mutante> |
install1002/2002: deleting /srv/autoinstall/precise.cfg |
[production] |
| 00:37 |
<mutante> |
install1002/2002: deleteing /srv/tftboot/precise-installer | puppetmaster1002/2001: deleting /var/lib/puppet/volatile/tftpboot/precise-installer (clean up after gerrit:345549) |
[production] |
| 00:25 |
<twentyafterfour> |
Phabricator upgrade completed uneventfully, other than the undisputable fact that the new search functionality is awesome. |
[production] |
| 00:21 |
<mutante> |
added #wikimedia-traffic channel to stashbot config, test |
[production] |
| 00:19 |
<mutante> |
stopping and starting stashbot for config change - added #wikimedia-traffic channel |
[production] |
| 00:19 |
<twentyafterfour> |
updating phabricator, the service will be offline for just a few moments. |
[production] |
| 00:08 |
<twentyafterfour> |
preparing to update Phabricator to tag release/2017-04-05/1 #phab-2017-04-05 |
[production] |
|
2017-04-05
§
|
| 23:29 |
<thcipriani@tin> |
Synchronized static/images/mobile/copyright/wikipedia-wordmark-ru.svg: SWAT: [[gerrit:346581|Update Russian Wikipedia logo]] T162036 (duration: 00m 40s) |
[production] |
| 23:18 |
<demon@tin> |
Synchronized wmf-config/CommonSettings.php: unbreak dashiki again (duration: 00m 40s) |
[production] |
| 23:13 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:346584|Deploy Page previews to stable on Hungrian and Hebrew Wikipedias]] T162162 (duration: 00m 40s) |
[production] |
| 23:12 |
<demon@tin> |
Synchronized php-1.29.0-wmf.19/extensions/Dashiki/: swattttttt (duration: 00m 41s) |
[production] |
| 22:37 |
<mobrovac> |
restbase deploying a8d4d027 |
[production] |
| 22:12 |
<ppchelko@tin> |
Finished deploy [trending-edits/deploy@46544de]: Correctly calculate since parameter and allow to change decay for debugging, attempt 2 (duration: 07m 06s) |
[production] |
| 22:05 |
<ppchelko@tin> |
Started deploy [trending-edits/deploy@46544de]: Correctly calculate since parameter and allow to change decay for debugging, attempt 2 |
[production] |
| 22:04 |
<ppchelko@tin> |
Finished deploy [trending-edits/deploy@46544de]: Correctly calculate since parameter and allow to change decay for debugging (duration: 02m 29s) |
[production] |
| 22:02 |
<ppchelko@tin> |
Started deploy [trending-edits/deploy@46544de]: Correctly calculate since parameter and allow to change decay for debugging |
[production] |
| 21:58 |
<demon@tin> |
Synchronized wmf-config/CommonSettings.php: bump video transcode timeouts, brion made me do it (duration: 00m 40s) |
[production] |
| 20:53 |
<ppchelko@tin> |
Finished deploy [trending-edits/deploy@475a5c0]: Fix edit scorer (duration: 05m 34s) |
[production] |
| 20:47 |
<ppchelko@tin> |
Started deploy [trending-edits/deploy@475a5c0]: Fix edit scorer |
[production] |