2015-12-09
§
|
13:06 |
<hashar> |
restarting Jenkins (upgrading Gearman plugin) |
[production] |
11:51 |
<akosiaris> |
reissue certificates for labs-ldap.{eqiad,codfw}.wikimedia.org with a 2048bit key size |
[production] |
11:29 |
<kart_> |
Update cxserver to c88ef57 |
[production] |
10:45 |
<akosiaris> |
sudo gnt-instance modify -H cpu_type=SandyBridge seaborgium to get aesni and sse cpu flags. rebooting seaborgium to apply those |
[production] |
10:25 |
<akosiaris> |
reboot serpens to add 3 more vCPUs |
[production] |
10:21 |
<akosiaris> |
reboot seaborgium to add 3 more vCPUs |
[production] |
10:04 |
<moritzm> |
restarting slapd on serpens/seaborgium to apply updated indices |
[production] |
10:03 |
<ori> |
running hhvm-collect-heaps in screen on mw1001 with a 600s interval |
[production] |
10:00 |
<akosiaris> |
stopped slapd on seaborgium, run sudo -u openldap slapindex to add the new indices, started slapd |
[production] |
10:00 |
<paravoid> |
manually ran update-ubuntu-mirror twice on carbon to fix mirror errors |
[production] |
09:58 |
<akosiaris> |
stopped slapd on serpens, run sudo -u openldap slapindex to add the new indices, started slapd |
[production] |
08:15 |
<ori> |
Memory utilization on the job runners began to climb around 2015-12-08T10:00:00+00:00 UTC. To investigate, enabled jemalloc profiling and restarted HHVM on mw1001. |
[production] |
07:40 |
<YuviPanda> |
restarted create-dbusers on labstore1001 |
[production] |
04:44 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Wed Dec 9 04:44:57 UTC 2015 (duration 1h 50m 43s) |
[production] |
02:54 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.8) (duration: 04m 34s) |
[production] |
02:34 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.7) (duration: 10m 27s) |
[production] |
02:23 |
<ori@tin> |
Synchronized wmf-config/wikitech.php: I4ef826af47: Increase LDAP log verbosity (duration: 00m 44s) |
[production] |
02:16 |
<catrope@tin> |
Finished scap: Graph cherry-picks for wmf.8, including i18n changes (duration: 26m 38s) |
[production] |
01:49 |
<catrope@tin> |
Started scap: Graph cherry-picks for wmf.8, including i18n changes |
[production] |
01:45 |
<catrope@tin> |
Synchronized php-1.27.0-wmf.8/extensions/Gadgets/: SWAT: bump MediaWikiGadgetsDefinitionRepo cache version (duration: 00m 29s) |
[production] |
2015-12-08
§
|
23:47 |
<thcipriani@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: Train: group0 to 1.27.0-wmf.8 |
[production] |
23:43 |
<ori@tin> |
Synchronized php-1.27.0-wmf.8/extensions/MobileFrontend: I7b86a521: Ensure the parser cache varies on images disabled and 'light' images (duration: 00m 32s) |
[production] |
23:41 |
<thcipriani@tin> |
Finished scap: testwiki to 1.27.0-wmf.8 and rebuild l10n cache take II (duration: 56m 13s) |
[production] |
22:45 |
<thcipriani@tin> |
Started scap: testwiki to 1.27.0-wmf.8 and rebuild l10n cache take II |
[production] |
22:24 |
<thcipriani@tin> |
scap failed: CalledProcessError Command '/usr/local/bin/mwscript mergeMessageFileList.php --wiki="cawikibooks" --list-file="/srv/mediawiki-staging/wmf-config/extension-list" --output="/tmp/tmp.d9wYd5Axk0" ' returned non-zero exit status 1 (duration: 01m 01s) |
[production] |
22:23 |
<thcipriani@tin> |
Started scap: testwiki to 1.27.0-wmf.8 and rebuild l10n cache |
[production] |
22:16 |
<yurik> |
deployed latest kartotherian & tilerator |
[production] |
21:09 |
<thcipriani> |
checking out wmf/1.27.0-wmf.8 on tin for train deploy |
[production] |
20:51 |
<moritzm> |
moved dns aliases ldap-eqiad.wikimedia.org and ldap-codfw.wikimedia.org to seaborgium/serpens (these are for compat reasons, using ldap-labs.[eqiad|codfw].wikimedia.org is preferred |
[production] |
20:50 |
<gwicke> |
restbase: finished deploy of 49fdc615b to all nodes |
[production] |
20:37 |
<gwicke> |
restbase: start deploy of 49fdc615b to all nodes |
[production] |
20:35 |
<hashar> |
Jenkins: changing LDAP config from ldaps://ldap-eqiad.wikimedia.org:636 to ldaps://ldap-labs.eqiad.wikimedia.org:636 |
[production] |
20:34 |
<gwicke> |
restbase: canary deploy of 49fdc615b to restbase1001 |
[production] |
20:31 |
<ori@tin> |
Synchronized php-1.27.0-wmf.7/extensions/MobileFrontend: I8a1fb69724b: Vary HTML output by NetSpeed designation (duration: 00m 28s) |
[production] |
19:52 |
<akosiaris> |
fixed ldap logging on seaborgium/serpens |
[production] |
19:51 |
<ori@tin> |
Synchronized wmf-config/InitialiseSettings.php: Enable ldap log channel (duration: 00m 28s) |
[production] |
19:50 |
<cmjohnson1> |
swapping failed disk db1019 |
[production] |
18:53 |
<akosiaris> |
running puppet on serpens/seaborgium |
[production] |
18:49 |
<paravoid> |
enable ldaps:/// on seaborgium |
[production] |
18:49 |
<akosiaris> |
enable ldaps:/// on serpens |
[production] |
18:36 |
<demon@tin> |
Synchronized wmf-config/wikitech.php: Point to new ldap servers (duration: 00m 27s) |
[production] |
18:25 |
<andrewbogott> |
running puppet on labcontrol1002 |
[production] |
18:23 |
<andrewbogott> |
running puppet on labcontrol1001 |
[production] |
17:35 |
<legoktm> |
deleted centralauth.localuser row for User:ThanduxoloKennethTwani5092/enwiki because the account doesn't exist (T120655) |
[production] |
17:13 |
<moritzm> |
stopping slapd on seaborgium/serpens to refresh LDAP databases with latest export from nembus |
[production] |
17:00 |
<andrewbogott> |
changing opendj writability-mode to ‘internal-only’ on nembus and neptunium |
[production] |
16:31 |
<thcipriani@tin> |
Synchronized php-1.27.0-wmf.7/extensions/CentralNotice: SWAT: Update CentralNotice [[gerrit:257615]] (duration: 00m 28s) |
[production] |
16:19 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Fix typo in namespaces configuration [[gerrit:257487]] (duration: 00m 28s) |
[production] |
16:13 |
<thcipriani@tin> |
Synchronized wmf-config/Wikibase.php: SWAT: Wikidata: set maxSerializedEntitySize to 2500 [[gerrit:257318]] (duration: 00m 27s) |
[production] |
16:07 |
<godog> |
repool restbase1008 |
[production] |