|
2015-08-14
§
|
| 17:59 |
<yurik> |
deployed latest kartotherian |
[production] |
| 17:21 |
<andrewbogott> |
disabling grid jobqueue for tools-exec-1211 tools-exec-1212 tools-exec-1215 tools-exec-1403 tools-exec-1406 tools-master tools-shadow tools-webgrid-generic-1402 tools-webgrid-lighttpd-1203 tools-webgrid-lighttpd-1208 tools-webgrid-lighttpd-1403 tools-webgrid-lighttpd-1404 tools-webproxy-01 in anticipation of monday reboot of labvirt1004 |
[tools] |
| 16:14 |
<ostriches> |
fixed deployment-cache-upload04 |
[releng] |
| 15:20 |
<andrewbogott> |
Adding back to the grid engine queue: tools-exec-1216 tools-exec-1219 tools-exec-1407 tools-mail tools-services-02 tools-webgrid-generic-1401 tools-webgrid-lighttpd-1202 tools-webgrid-lighttpd-1207 tools-webgrid-lighttpd-1210 tools-webgrid-lighttpd-1402 tools-webgrid-lighttpd-1407 |
[tools] |
| 14:59 |
<andrewbogott> |
rebooting labvirt1003 |
[production] |
| 14:43 |
<andrewbogott> |
killing remaining jobs on tools-exec-1216 tools-exec-1219 tools-exec-1407 tools-mail tools-services-02 tools-webgrid-generic-1401 tools-webgrid-lighttpd-1202 tools-webgrid-lighttpd-1207 tools-webgrid-lighttpd-1210 tools-webgrid-lighttpd-1402 tools-webgrid-lighttpd-1407 |
[tools] |
| 13:53 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1042 (vslow, dump) (duration: 00m 12s) |
[production] |
| 13:13 |
<reedy@tin> |
Synchronized php-1.26wmf18/extensions/CirrusSearch/: Fix ElasticaQuery logspam (duration: 00m 13s) |
[production] |
| 13:06 |
<reedy@tin> |
Synchronized php-1.26wmf18/extensions/GeoData: Fix ElasticaQuery logspam (duration: 00m 13s) |
[production] |
| 13:06 |
<reedy@tin> |
Synchronized php-1.26wmf18/extensions/Flow: Fix ElasticaQuery logspam (duration: 00m 13s) |
[production] |
| 12:30 |
<jynus> |
Restarting db1042 after data import |
[production] |
| 12:11 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Load-balance db1036 roles (duration: 00m 11s) |
[production] |
| 11:57 |
<reedy@tin> |
Synchronized php-1.26wmf18/extensions/Translate: Stop calling deprecated Elastica function (duration: 00m 13s) |
[production] |
| 08:26 |
<akosiaris> |
upgraded and restarted apertium on sca100{1,2} |
[production] |
| 08:11 |
<akosiaris> |
uploaded to apt.wikimedia.org jessie-wikimedia: apertium-apy_0.1+svn~61425-1 |
[production] |
| 07:10 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Fri Aug 14 07:10:37 UTC 2015 (duration 10m 36s) |
[production] |
| 06:34 |
<Jamesofur> |
reset email/password for User:Auréola after multi factor user confirmation. |
[production] |
| 05:21 |
<bd808> |
varnish-fe on deployment-cache-upload04.deployment-prep.eqiad.wmflabs not starting because nginx isn't starting because ssl cert is missing. No port 80 listener to serve images |
[releng] |
| 02:35 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.26wmf18) at 2015-08-14 02:35:19+00:00 |
[production] |
| 02:31 |
<l10nupdate@tin> |
Synchronized php-1.26wmf18/cache/l10n: l10nupdate for 1.26wmf18 (duration: 06m 35s) |
[production] |
| 01:49 |
<matt_flaschen> |
Resumed LQT->Flow conversion of mw:Project:Support_desk on mw1041 |
[production] |
| 01:46 |
<ori@tin> |
Synchronized php-1.26wmf18/includes/OutputPage.php: I5e6c79c70: Optimize the order of styles and scripts in <head> (duration: 00m 12s) |
[production] |
|
2015-08-13
§
|
| 23:27 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/230256 |
[releng] |
| 23:16 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/228477/ and https://gerrit.wikimedia.org/r/#/c/231074/ (duration: 00m 12s) |
[production] |
| 23:15 |
<krenair@tin> |
Synchronized w/static/images/project-logos/mrwikibooks.png: https://gerrit.wikimedia.org/r/#/c/228477/ (duration: 00m 12s) |
[production] |
| 23:10 |
<krenair@tin> |
Synchronized php-1.26wmf18/extensions/Flow: https://gerrit.wikimedia.org/r/#/c/231450/1 (duration: 00m 14s) |
[production] |
| 23:03 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/227330/ (duration: 00m 12s) |
[production] |
| 22:14 |
<Krenair> |
Running refreshLinks --dfn-only in a screen on terbium for T44180 |
[production] |
| 21:47 |
<bd808> |
triggered beta-scap-eqiad jenkins job |
[releng] |
| 21:46 |
<bd808> |
Primed keyholder agent via `sudo -u keyholder env SSH_AUTH_SOCK=/run/keyholder/agent.sock ssh-add /etc/keyholder.d/mwdeploy_rsa` |
[releng] |
| 21:43 |
<ori@tin> |
Synchronized php-1.26wmf18/includes/OutputPage.php: Roll back: Test impact of I5e6c79c (duration: 00m 12s) |
[production] |
| 21:37 |
<ori@tin> |
Synchronized php-1.26wmf18/includes/OutputPage.php: Test impact of I5e6c79c (duration: 00m 12s) |
[production] |
| 21:16 |
<mutante> |
torrus broken - doing https://wikitech.wikimedia.org/wiki/Torrus#Deadlock_problem |
[production] |
| 21:14 |
<mutante> |
service gitblit restart on antimony (maybe that should be paging :) |
[production] |
| 21:06 |
<bd808> |
`sudo /etc/init.d/ganglia-monitor restart` on logstash100[1-6] fixed ganglia data loss |
[production] |
| 20:46 |
<mutante> |
killed ganglia aggregator for logstash on carbon |
[production] |
| 20:40 |
<bd808> |
ganglia not getting elasticsearch jvm data for logstash cluster since 2015-08-13T12:00 -- https://ganglia.wikimedia.org/latest/?c=Logstash+cluster+eqiad&&m=es_heap_used |
[production] |
| 20:21 |
<cscott> |
deployed I2e792ca14a35a79e7846b0ed03a36adf55fe338f to zuul (and reloaded) |
[releng] |
| 19:56 |
<twentyafterfour@tin> |
rebuilt wikiversions.cdb and synchronized wikiversions files: all wikis to 1.26wmf18 |
[production] |
| 19:38 |
<demon@tin> |
Synchronized php-1.26wmf18/extensions/CirrusSearch/: (no message) (duration: 00m 11s) |
[production] |
| 19:35 |
<demon@tin> |
Synchronized php-1.26wmf18/extensions/Graph: (no message) (duration: 00m 10s) |
[production] |
| 19:31 |
<demon@tin> |
Synchronized php-1.26wmf18/extensions/Graph: (no message) (duration: 00m 11s) |
[production] |
| 19:28 |
<cscott> |
deployed 0c0f6e936bacfffde432ecf1e53f73f037ca6c42 to zuul (and jenkins) |
[releng] |
| 18:51 |
<valhallasw`cloud> |
which was resolved by scfc earlier |
[tools] |
| 18:50 |
<valhallasw`cloud> |
tools-exec-1201/Puppet staleness was critical due to an agent lock (Ignoring stale puppet agent lock for pid <br> Run of Puppet configuration client already in progress; skipping (/var/lib/puppet/state/agent_catalog_run.lock exists)) |
[tools] |
| 18:32 |
<ori@tin> |
Synchronized php-1.26wmf18/extensions/SyntaxHighlight_GeSHi/extension.json: If0851400: Fix-up for I2de8a400d: explicitly declare module position (duration: 00m 12s) |
[production] |
| 17:47 |
<kaldari@tin> |
Synchronized wmf-config/InitialiseSettings.php: syncing InitialiseSettings for WikidataPageBanner (duration: 00m 12s) |
[production] |
| 17:46 |
<kaldari@tin> |
Finished scap: (no message) (duration: 50m 05s) |
[production] |
| 17:43 |
<marxarelli> |
Reloading Zuul to deploy I0159f6dba5e187bfc5fe2b680408f35aca6ca2fe |
[releng] |
| 16:55 |
<kaldari@tin> |
Started scap: (no message) |
[production] |