|
2015-12-09
§
|
| 08:15 |
<ori> |
Memory utilization on the job runners began to climb around 2015-12-08T10:00:00+00:00 UTC. To investigate, enabled jemalloc profiling and restarted HHVM on mw1001. |
[production] |
| 07:40 |
<YuviPanda> |
restarted create-dbusers on labstore1001 |
[production] |
| 04:44 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Wed Dec 9 04:44:57 UTC 2015 (duration 1h 50m 43s) |
[production] |
| 02:54 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.8) (duration: 04m 34s) |
[production] |
| 02:34 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.7) (duration: 10m 27s) |
[production] |
| 02:23 |
<ori@tin> |
Synchronized wmf-config/wikitech.php: I4ef826af47: Increase LDAP log verbosity (duration: 00m 44s) |
[production] |
| 02:16 |
<catrope@tin> |
Finished scap: Graph cherry-picks for wmf.8, including i18n changes (duration: 26m 38s) |
[production] |
| 01:49 |
<catrope@tin> |
Started scap: Graph cherry-picks for wmf.8, including i18n changes |
[production] |
| 01:45 |
<catrope@tin> |
Synchronized php-1.27.0-wmf.8/extensions/Gadgets/: SWAT: bump MediaWikiGadgetsDefinitionRepo cache version (duration: 00m 29s) |
[production] |
|
2015-12-08
§
|
| 23:47 |
<thcipriani@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: Train: group0 to 1.27.0-wmf.8 |
[production] |
| 23:43 |
<ori@tin> |
Synchronized php-1.27.0-wmf.8/extensions/MobileFrontend: I7b86a521: Ensure the parser cache varies on images disabled and 'light' images (duration: 00m 32s) |
[production] |
| 23:41 |
<thcipriani@tin> |
Finished scap: testwiki to 1.27.0-wmf.8 and rebuild l10n cache take II (duration: 56m 13s) |
[production] |
| 22:45 |
<thcipriani@tin> |
Started scap: testwiki to 1.27.0-wmf.8 and rebuild l10n cache take II |
[production] |
| 22:24 |
<thcipriani@tin> |
scap failed: CalledProcessError Command '/usr/local/bin/mwscript mergeMessageFileList.php --wiki="cawikibooks" --list-file="/srv/mediawiki-staging/wmf-config/extension-list" --output="/tmp/tmp.d9wYd5Axk0" ' returned non-zero exit status 1 (duration: 01m 01s) |
[production] |
| 22:23 |
<thcipriani@tin> |
Started scap: testwiki to 1.27.0-wmf.8 and rebuild l10n cache |
[production] |
| 22:16 |
<yurik> |
deployed latest kartotherian & tilerator |
[production] |
| 21:09 |
<thcipriani> |
checking out wmf/1.27.0-wmf.8 on tin for train deploy |
[production] |
| 20:51 |
<moritzm> |
moved dns aliases ldap-eqiad.wikimedia.org and ldap-codfw.wikimedia.org to seaborgium/serpens (these are for compat reasons, using ldap-labs.[eqiad|codfw].wikimedia.org is preferred |
[production] |
| 20:50 |
<gwicke> |
restbase: finished deploy of 49fdc615b to all nodes |
[production] |
| 20:37 |
<gwicke> |
restbase: start deploy of 49fdc615b to all nodes |
[production] |
| 20:35 |
<hashar> |
Jenkins: changing LDAP config from ldaps://ldap-eqiad.wikimedia.org:636 to ldaps://ldap-labs.eqiad.wikimedia.org:636 |
[production] |
| 20:34 |
<gwicke> |
restbase: canary deploy of 49fdc615b to restbase1001 |
[production] |
| 20:31 |
<ori@tin> |
Synchronized php-1.27.0-wmf.7/extensions/MobileFrontend: I8a1fb69724b: Vary HTML output by NetSpeed designation (duration: 00m 28s) |
[production] |
| 19:52 |
<akosiaris> |
fixed ldap logging on seaborgium/serpens |
[production] |
| 19:51 |
<ori@tin> |
Synchronized wmf-config/InitialiseSettings.php: Enable ldap log channel (duration: 00m 28s) |
[production] |
| 19:50 |
<cmjohnson1> |
swapping failed disk db1019 |
[production] |
| 18:53 |
<akosiaris> |
running puppet on serpens/seaborgium |
[production] |
| 18:49 |
<paravoid> |
enable ldaps:/// on seaborgium |
[production] |
| 18:49 |
<akosiaris> |
enable ldaps:/// on serpens |
[production] |
| 18:36 |
<demon@tin> |
Synchronized wmf-config/wikitech.php: Point to new ldap servers (duration: 00m 27s) |
[production] |
| 18:25 |
<andrewbogott> |
running puppet on labcontrol1002 |
[production] |
| 18:23 |
<andrewbogott> |
running puppet on labcontrol1001 |
[production] |
| 17:35 |
<legoktm> |
deleted centralauth.localuser row for User:ThanduxoloKennethTwani5092/enwiki because the account doesn't exist (T120655) |
[production] |
| 17:13 |
<moritzm> |
stopping slapd on seaborgium/serpens to refresh LDAP databases with latest export from nembus |
[production] |
| 17:00 |
<andrewbogott> |
changing opendj writability-mode to ‘internal-only’ on nembus and neptunium |
[production] |
| 16:31 |
<thcipriani@tin> |
Synchronized php-1.27.0-wmf.7/extensions/CentralNotice: SWAT: Update CentralNotice [[gerrit:257615]] (duration: 00m 28s) |
[production] |
| 16:19 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Fix typo in namespaces configuration [[gerrit:257487]] (duration: 00m 28s) |
[production] |
| 16:13 |
<thcipriani@tin> |
Synchronized wmf-config/Wikibase.php: SWAT: Wikidata: set maxSerializedEntitySize to 2500 [[gerrit:257318]] (duration: 00m 27s) |
[production] |
| 16:07 |
<godog> |
repool restbase1008 |
[production] |
| 16:06 |
<thcipriani@tin> |
Synchronized wmf-config/CommonSettings.php: SWAT: CX: Use ContentTranslationRESTBase [[gerrit:255102]] (duration: 00m 30s) |
[production] |
| 16:01 |
<mobrovac> |
restbase end deploy of 28bf071 |
[production] |
| 15:22 |
<mobrovac> |
restbase enable puppet in prod |
[production] |
| 15:17 |
<mobrovac> |
restbase start deploy of 28bf071 |
[production] |
| 15:10 |
<mobrovac> |
restbase canary deploy of 28bf071 onto restbase1001 |
[production] |
| 14:19 |
<bblack> |
upgrading openssl package on caches |
[production] |
| 14:16 |
<mobrovac> |
restbase canary deploy of f47405a onto restbase1001 |
[production] |
| 14:09 |
<mobrovac> |
restbase running puppet on rb1001 |
[production] |
| 11:02 |
<godog> |
upgrade diamond to 3.5-5 in codfw |
[production] |
| 10:04 |
<godog> |
start cassandra on restbase1008, bootstrapping |
[production] |
| 09:56 |
<hashar> |
gallium: upgraded python-diamond and java. Restarting Jenkins |
[production] |