|
2016-03-09
ยง
|
| 19:01 |
<volans@tin> |
Synchronized wmf-config/db-codfw.php: Change codfw external storage topology T127330 (duration: 00m 27s) |
[production] |
| 18:52 |
<anomie@tin> |
Synchronized php-1.27.0-wmf.16/includes/session/SessionManager.php: Add backtrace to log for MW_NO_SESSION warning mode [[gerrit:276232]] (duration: 00m 50s) |
[production] |
| 18:44 |
<volans> |
Changing topology of local codfw masters for es2 and es3 before merging https://gerrit.wikimedia.org/r/#/c/276229/1 T127330 |
[production] |
| 17:56 |
<bd808> |
Cleaned up git clone state in deployment-tin.deployment-prep:/srv/mediawiki-staging/php-master and queued beta-code-update-eqiad to try again (T129371) |
[releng] |
| 17:53 |
<csteipp> |
deployed patch for T110143 to wmf16 |
[production] |
| 17:48 |
<bd808> |
Git clone at deployment-tin.deployment-prep:/srv/mediawiki-staging/php-master in completely horrible state. Investigating |
[releng] |
| 17:40 |
<csteipp> |
deployed patch for T122056 |
[production] |
| 17:22 |
<bd808> |
Fixed https://integration.wikimedia.org/ci/job/beta-mediawiki-config-update-eqiad/4452/ |
[releng] |
| 17:19 |
<bd808> |
Manually cleaning up broken rebase in deployment-tin.deployment-prep:/srv/mediawiki-staging |
[releng] |
| 16:27 |
<bd808> |
Removed cherry-pick of https://gerrit.wikimedia.org/r/#/c/274696 ; manually cleaned up systemd unit and restarted logstash on deployment-logstash2 |
[releng] |
| 16:09 |
<thcipriani@tin> |
Synchronized wmf-config/throttle.php: SWAT: Wikipedia while at Women of the World Festival throttle rule [[gerrit:276179]] (duration: 00m 30s) |
[production] |
| 16:05 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Change LanguageOverlay bucket rates [[gerrit:276172]] (duration: 00m 52s) |
[production] |
| 15:46 |
<mafk> |
Merged https://gerrit.wikimedia.org/r/276184 |
[tools.stewardbots] |
| 14:59 |
<hashar> |
Image ci-jessie-wikimedia-1457535250 in wmflabs-eqiad is ready T129345 |
[releng] |
| 14:57 |
<hashar> |
Rebuilding snapshot image to get Xvfb enabled at boot time T129345 |
[releng] |
| 14:54 |
<volans@tin> |
Synchronized wmf-config/db-codfw.php: Rebalance external storage servers in codfw T127330 (duration: 00m 41s) |
[production] |
| 14:14 |
<moritzm> |
installing Django security updates |
[production] |
| 13:19 |
<moritzm> |
installing beanshell security updates |
[production] |
| 13:04 |
<moritzm> |
cherrypicked patch to deployment-prep which provides a systemd unit for logstash |
[releng] |
| 12:46 |
<paravoid> |
set disable on cr2-knams:xe-1/2/0 (Init7), issues with at least one large network |
[production] |
| 12:25 |
<elukey> |
added rdb1003 back to the Job Runners queue. All the jobchron processes on jobrunners/videoscalers need to be restarted. |
[production] |
| 12:07 |
<elukey@tin> |
Synchronized wmf-config/jobqueue-eqiad.php: Add rdb1003 back to the Redis JobQueue pool after maintenance (duration: 00m 34s) |
[production] |
| 12:00 |
<elukey> |
re-enabled puppet on rdb1004 |
[production] |
| 11:47 |
<moritzm> |
uploaded firmware-nonfree 20151018 to jessie-wikimedia on carbon |
[production] |
| 11:39 |
<godog> |
rolling restart cassandra in staging after merging https://gerrit.wikimedia.org/r/#/c/275917/ |
[production] |
| 11:27 |
<jynus> |
setting up master-master cross-datacenter replication for s2 (db1018-db2017) |
[production] |
| 11:20 |
<ema> |
hhvm restarted on mw1140 |
[production] |
| 11:04 |
<jynus> |
deployed manually new code at dbtree (noc.wikimedia.org) |
[production] |
| 10:55 |
<joal> |
restart oozie job with newly dpeloyed refnery |
[analytics] |
| 10:52 |
<hashar> |
Image ci-jessie-wikimedia-1457520493 in wmflabs-eqiad is ready |
[releng] |
| 10:48 |
<joal> |
deploying refinery on hdfs from stat1002 |
[analytics] |
| 10:45 |
<joal> |
Deploying refinery from Tin |
[analytics] |
| 10:39 |
<elukey> |
puppet disabled on rdb1004 (plus Redis instances) as precautionary step for master reimage - rdb1003 |
[production] |
| 10:35 |
<jynus> |
setting up master-master replication on tools (labsdb100[45]) |
[production] |
| 10:29 |
<hashar> |
Nodepool: created new image and refreshing snapshot in attempt to get Xvfb running T129320 T128090 |
[releng] |
| 10:15 |
<joal> |
Killing oozie jobs before deploy and restart with new error email configuration |
[analytics] |
| 09:32 |
<moritzm> |
rebooting iron for kernel update |
[production] |
| 09:26 |
<elukey> |
puppet disabled on rdb1003 for debian re-image. Redis servers going to be stopped too as pre-step for backup. |
[production] |
| 08:32 |
<oblivian@tin> |
Synchronized wmf-config/jobqueue-eqiad.php: re-routing writes from rdb1003 to rdb1005 for reimaging (duration: 00m 36s) |
[production] |
| 08:29 |
<jynus@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2035 (duration: 00m 39s) |
[production] |
| 07:49 |
<_joe_> |
uploading hhvm 3.12, extensions to reprepro |
[production] |
| 06:46 |
<joal> |
Deploying refinery-source v0.0.27 to archiva |
[analytics] |
| 06:26 |
<mutante> |
bast2001 - still installing in snail mode - please feel free to check if it's done, and if so re-add to puppet so users get created.thx |
[production] |
| 03:16 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Wed Mar 9 03:16:21 UTC 2016 (duration 8m 2s) |
[production] |
| 03:08 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.16) (duration: 17m 51s) |
[production] |
| 02:32 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.15) (duration: 13m 28s) |
[production] |
| 02:13 |
<ori@tin> |
Synchronized php-1.27.0-wmf.15/includes/diff/DairikiDiff.php: I4d4b8f81c: Dont quote assert expressions in DairikiDiff (duration: 00m 27s) |
[production] |
| 02:12 |
<ori@tin> |
Synchronized php-1.27.0-wmf.16/includes/diff/DairikiDiff.php: I4d4b8f81c: Dont quote assert expressions in DairikiDiff (duration: 00m 31s) |
[production] |
| 01:40 |
<csteipp> |
redeploy patch for T129120 |
[production] |
| 01:39 |
<csteipp@tin> |
Synchronized php-1.27.0-wmf.16/includes/api/ApiQueryInfo.php: (no message) (duration: 00m 33s) |
[production] |