2016-08-08
§
|
09:57 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp2007.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
09:57 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
09:57 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp2005.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
09:57 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp2004.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
09:57 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp2003.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
09:57 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp2002.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
09:52 |
<akosiaris> |
uploaded to apt.wikimedia.org precise-wikimedia: php5_5.3.10-1ubuntu3.24+wmf1 |
[production] |
09:51 |
<akosiaris> |
uploaded to apt.wikimedia.org jessie-wikimedia: php5_5.3.10-1ubuntu3.24+wmf1 |
[production] |
09:48 |
<legoktm@tin> |
Synchronized wmf-config/CommonSettings.php: Fix missed $wmg -> $wg for $wgRestbaseServer (duration: 00m 49s) |
[production] |
09:41 |
<legoktm@tin> |
Synchronized php-1.28.0-wmf.13/includes/revisiondelete/: Fix inconsistent RevDelFileItem visibilities - T142228 (duration: 00m 50s) |
[production] |
09:34 |
<elukey> |
re-imaging aqs1005 to migrate Cassandra partitions to RAID10 (T142075) |
[production] |
09:13 |
<moritzm> |
restarting elasticsearch on logstash100[56] to pick up java security updates |
[production] |
07:16 |
<moritzm> |
installing php5 security updates |
[production] |
02:26 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Mon Aug 8 02:26:21 UTC 2016 (duration 5m 46s) |
[production] |
02:20 |
<mwdeploy@tin> |
scap sync-l10n completed (1.28.0-wmf.13) (duration: 09m 21s) |
[production] |
2016-08-07
§
|
23:39 |
<reedy@tin> |
Synchronized wmf-config: last 2 to wfLoadExtension (duration: 00m 59s) |
[production] |
23:12 |
<reedy@tin> |
Synchronized wmf-config: Handful more extensions to wfLoadExtension (duration: 00m 49s) |
[production] |
22:57 |
<reedy@tin> |
Synchronized wmf-config: RestbaseUpdateJobs to wfLoadExtension (duration: 00m 51s) |
[production] |
22:55 |
<reedy@tin> |
Synchronized wmf-config/CommonSettings.php: Image Area to 100MP (duration: 00m 48s) |
[production] |
22:44 |
<reedy@tin> |
Synchronized wmf-config/extension-list: 2 more to extension.json (duration: 00m 48s) |
[production] |
22:35 |
<reedy@tin> |
Synchronized docroot/noc/conf: Cleanup! (duration: 00m 50s) |
[production] |
22:30 |
<reedy@tin> |
Synchronized docroot: trusted-xff symlink updates (duration: 00m 50s) |
[production] |
22:28 |
<reedy@tin> |
Synchronized wmf-config/: Swap trusted-xff from cdb to php (duration: 00m 51s) |
[production] |
20:49 |
<legoktm@tin> |
Synchronized php-1.28.0-wmf.13/extensions/GlobalBlocking/extension.json: Adding globalblock-exempt grant for OAuth - T142306 (duration: 00m 57s) |
[production] |
16:22 |
<cwd|afk> |
disabled globalcollect recurring donations |
[production] |
16:13 |
<akosiaris> |
restarted apache2 on palladium for full depool to take place |
[production] |
12:47 |
<hashar> |
root cause of CI outage is T126552 |
[production] |
12:41 |
<hashar> |
CI fully back. Root cause was Jenkins that could not properly create slaves config due to : Could not create rootDir /var/lib/jenkins/config-history/xxxx . Deleting via find /var/lib/jenkins/config-history/nodes/ -path '*_deleted_*' -delete |
[production] |
12:12 |
<hashar> |
CI stuck spawning instances via Nodepool apparently due to : Quota exceeded for instances: Requested 1, but already used 10 of 10 instances (HTTP 403) --- Though there is only 8 instances ... |
[production] |
12:10 |
<hashar> |
CI stuck spawning instances via Nodepool apparently due to : Quota exceeded for instances: Requested 1, but already used 10 of 10 instances (HTTP 403) --- Though there is only 8 instances ... |
[production] |
02:24 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Sun Aug 7 02:24:55 UTC 2016 (duration 5m 51s) |
[production] |
02:19 |
<mwdeploy@tin> |
scap sync-l10n completed (1.28.0-wmf.13) (duration: 08m 55s) |
[production] |
2016-08-05
§
|
23:39 |
<tgr@tin> |
Synchronized php-1.28.0-wmf.13/includes/api/ApiLogin.php: temporarily re-add dropped API feature to unbreak Pywikibot T142155 (duration: 00m 48s) |
[production] |
22:37 |
<andrewbogott> |
rebooting labvirt1014 as part of a protracted iptables/nova-compute investigation |
[production] |
21:03 |
<reedy@tin> |
Synchronized wmf-config/CommonSettings.php: Add transitionary timeline config primarily for beta (duration: 00m 57s) |
[production] |
18:26 |
<andrewbogott> |
restarting rabbitmq-server on labcontrol1001 |
[production] |
17:27 |
<ejegg> |
rolled back SmashPig to 26a475bf5ae03d88ebc4c2fe9707d562d8e3afe3 |
[production] |
17:25 |
<ejegg> |
updated SmashPig from 26a475bf5ae03d88ebc4c2fe9707d562d8e3afe3 to 2e8a2f4c92840bd999a8742211e0a65d484fde00 |
[production] |
16:03 |
<akosiaris> |
T107306 uploaded to apt.wikimedia.org jessie-wikimedia: apertium-spa-arg_0.4.0~r64399-1+wmf1 |
[production] |
16:02 |
<akosiaris> |
T107306 uploaded to apt.wikimedia.org jessie-wikimedia: apertium-arg-cat_0.1.0~r64925-1+wmf1 |
[production] |
15:16 |
<akosiaris> |
T135176 pool wtp1019-wtp1024 |
[production] |
15:13 |
<akosiaris@palladium> |
conftool action : set/pooled=yes; selector: wtp1024.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=parsoid', 'service=parsoid']) |
[production] |