|
2016-08-08
§
|
| 12:19 |
<moritzm> |
upgrading firejail on scb1001 (along with service restarts except changeprop) |
[production] |
| 11:45 |
<moritzm> |
upgrading firejail on scb* in codfw |
[production] |
| 11:17 |
<_joe_> |
creating nihal.codfw.wmnet as a VM for puppetdb, T142365 |
[production] |
| 11:08 |
<_joe_> |
creating nitrogen.eqiad.wmnet as a VM for puppetdb, T142365 |
[production] |
| 10:10 |
<legoktm@tin> |
Synchronized php-1.28.0-wmf.13/extensions/Cite/Cite_body.php: Cite::referencesFormatEntry: Avoid Undefined index: key - T132583 (duration: 00m 49s) |
[production] |
| 10:05 |
<akosiaris> |
T135176 depool wtp2001-wtp2020 |
[production] |
| 09:58 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp2020.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 09:58 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp2019.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 09:58 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp2018.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 09:58 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp2017.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 09:58 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp2016.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 09:58 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp2015.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 09:58 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp2014.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 09:57 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp2013.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 09:57 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp2012.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 09:57 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp2011.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 09:57 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp2010.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 09:57 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp2009.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 09:57 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp2008.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 09:57 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp2007.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 09:57 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp2006.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 09:57 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp2005.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 09:57 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp2004.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 09:57 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp2003.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 09:57 |
<akosiaris@palladium> |
conftool action : set/pooled=no; selector: wtp2002.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 09:52 |
<akosiaris> |
uploaded to apt.wikimedia.org precise-wikimedia: php5_5.3.10-1ubuntu3.24+wmf1 |
[production] |
| 09:51 |
<akosiaris> |
uploaded to apt.wikimedia.org jessie-wikimedia: php5_5.3.10-1ubuntu3.24+wmf1 |
[production] |
| 09:48 |
<legoktm@tin> |
Synchronized wmf-config/CommonSettings.php: Fix missed $wmg -> $wg for $wgRestbaseServer (duration: 00m 49s) |
[production] |
| 09:41 |
<legoktm@tin> |
Synchronized php-1.28.0-wmf.13/includes/revisiondelete/: Fix inconsistent RevDelFileItem visibilities - T142228 (duration: 00m 50s) |
[production] |
| 09:34 |
<elukey> |
re-imaging aqs1005 to migrate Cassandra partitions to RAID10 (T142075) |
[production] |
| 09:13 |
<moritzm> |
restarting elasticsearch on logstash100[56] to pick up java security updates |
[production] |
| 07:16 |
<moritzm> |
installing php5 security updates |
[production] |
| 02:26 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Mon Aug 8 02:26:21 UTC 2016 (duration 5m 46s) |
[production] |
| 02:20 |
<mwdeploy@tin> |
scap sync-l10n completed (1.28.0-wmf.13) (duration: 09m 21s) |
[production] |
|
2016-08-07
§
|
| 23:39 |
<reedy@tin> |
Synchronized wmf-config: last 2 to wfLoadExtension (duration: 00m 59s) |
[production] |
| 23:12 |
<reedy@tin> |
Synchronized wmf-config: Handful more extensions to wfLoadExtension (duration: 00m 49s) |
[production] |
| 22:57 |
<reedy@tin> |
Synchronized wmf-config: RestbaseUpdateJobs to wfLoadExtension (duration: 00m 51s) |
[production] |
| 22:55 |
<reedy@tin> |
Synchronized wmf-config/CommonSettings.php: Image Area to 100MP (duration: 00m 48s) |
[production] |
| 22:44 |
<reedy@tin> |
Synchronized wmf-config/extension-list: 2 more to extension.json (duration: 00m 48s) |
[production] |
| 22:35 |
<reedy@tin> |
Synchronized docroot/noc/conf: Cleanup! (duration: 00m 50s) |
[production] |
| 22:30 |
<reedy@tin> |
Synchronized docroot: trusted-xff symlink updates (duration: 00m 50s) |
[production] |
| 22:28 |
<reedy@tin> |
Synchronized wmf-config/: Swap trusted-xff from cdb to php (duration: 00m 51s) |
[production] |
| 20:49 |
<legoktm@tin> |
Synchronized php-1.28.0-wmf.13/extensions/GlobalBlocking/extension.json: Adding globalblock-exempt grant for OAuth - T142306 (duration: 00m 57s) |
[production] |
| 16:22 |
<cwd|afk> |
disabled globalcollect recurring donations |
[production] |
| 16:13 |
<akosiaris> |
restarted apache2 on palladium for full depool to take place |
[production] |
| 12:47 |
<hashar> |
root cause of CI outage is T126552 |
[production] |
| 12:41 |
<hashar> |
CI fully back. Root cause was Jenkins that could not properly create slaves config due to : Could not create rootDir /var/lib/jenkins/config-history/xxxx . Deleting via find /var/lib/jenkins/config-history/nodes/ -path '*_deleted_*' -delete |
[production] |
| 12:12 |
<hashar> |
CI stuck spawning instances via Nodepool apparently due to : Quota exceeded for instances: Requested 1, but already used 10 of 10 instances (HTTP 403) --- Though there is only 8 instances ... |
[production] |
| 12:10 |
<hashar> |
CI stuck spawning instances via Nodepool apparently due to : Quota exceeded for instances: Requested 1, but already used 10 of 10 instances (HTTP 403) --- Though there is only 8 instances ... |
[production] |
| 02:24 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Sun Aug 7 02:24:55 UTC 2016 (duration 5m 51s) |
[production] |