501-550 of 10000 results (22ms)
2017-04-20 §
17:51 <mutante> restarted icinga-wm (ircecho) to pick up config change [production]
17:13 <jynus> stopping replication on db1040 [production]
17:09 <andrewbogott> disabling puppet on serpens, seaborgium, pollux, dubnium, labservices1001, labservices1002 for tentative rollout of https://gerrit.wikimedia.org/r/#/c/348920/ [production]
16:58 <jynus> moving GTID s4 eqiad replicas under db1068 [production]
16:46 <ema> repool varnish-be on cp2017 [production]
16:18 <ema> depool varnish-be on cp2017 [production]
16:08 <elukey> uploaded piwik 2.17.1-1 to jessie-wikimedia main [production]
15:17 <Amir1> deleting duplicate rows in ores_classification dated after revision 775502802 (dated April 15th) (T163337) [production]
15:16 <XioNoX> disabling pybal on lvs2002 for T163323 [production]
14:32 <moritzm> upgrading tor on radium to 0.2.9.10 [production]
14:23 <moritzm> rebooting radium (tor relay) for kernel update to Linux 4.9 [production]
14:09 <moritzm> rebooting osmium for kernel update to Linux 4.9 [production]
14:06 <gehel> rolling restart of kartotherian / tilerator on maps codfw cluster [production]
13:58 <gehel> rolling restart of kartotherian / tilerator on maps eqiad cluster [production]
13:58 <marostegui> Stop MySQL on db1068 and db1081 for maintenance - T163110 [production]
13:57 <jynus> running reset slave all on db2019 [production]
13:53 <gehel> rolling restart of kartotherian / tilerator on maps-test cluster [production]
13:18 <moritzm> restarting hhvm on mw2097/2098 to pick up icu security update [production]
13:11 <elukey> upgrading Piwik to 2.17.1 (brief downtime during the maintenance announced) [production]
12:12 <elukey> restart Yarn Resource manager on analytics1001 (hadoop master) to pick up new JVM settings [production]
12:11 <moritzm> installing icu security updates [production]
11:32 <_joe_> removing hack for jobqueue's refreshlinks T163418 from the jobrunners [production]
11:23 <jynus> changing db2071 to replicate from db2016 [production]
10:32 <moritzm> installing remaining dbus updates from jessie point update [production]
10:07 <elukey> restart Yarn Resource manager on analytics1002 (hadoop master standby) to pick up new JVM settings [production]
09:47 <Amir1> running the cleanup script for ores_classification in enwiki [production]
09:38 <_joe_> live-hack redeployed, running scap pull on codfw jobrunners T163418 [production]
09:38 <_joe_> live-hack redeployed, running scap pull on codfw jobrunners [production]
09:34 <hashar@naos> Synchronized rpc/RunJobs.php: Revert "rpc: raise exception instead of die" - causes monitoring spam (duration: 01m 20s) [production]
09:17 <_joe_> removed the live hack, running scap pull again on mw2154 [production]
09:14 <_joe_> scap pull of live hack for T163418 on mw2154 [production]
08:47 <_joe_> live-patching ./includes/jobqueue/jobs/RefreshLinksJob.php to drop all recursive jobs, T163418 [production]
07:59 <jynus> shutting down db1080 for cloning and upgrade T163413 [production]
07:54 <jynus@naos> Synchronized wmf-config/db-codfw.php: Add db2071, depooled (duration: 00m 53s) [production]
07:53 <jynus@naos> Synchronized wmf-config/db-eqiad.php: Depool db1080 (duration: 01m 02s) [production]
07:53 <marostegui> Deploy alter table enwiki.revision db1065 - https://phabricator.wikimedia.org/T132416 [production]
07:31 <marostegui@naos> Synchronized wmf-config/db-eqiad.php: Depool db1065 - T132416 (duration: 02m 18s) [production]
07:12 <marostegui> Deploy alter table on s4.image on eqiad master db1040 (this will create lag on eqiad - all hosts have been silenced) - https://phabricator.wikimedia.org/T73563 [production]
06:39 <marostegui> Deploy alter table on s4.oldimage on eqiad master db1040 (this will create lag on eqiad - all hosts have been silenced) - T73563 [production]
01:37 <mutante> mw2150 - restarted hhvm (had 'thread leakage' alert) [production]
01:28 <mutante> ran puppet on all (16) Dell R320 via cumin to add CPU frequency check [production]
00:37 <ejegg> updated CiviCRM from 90d679b171ee2791fbc30417265c09cd7140bfc7 to 51dbbad9f7822a7b3df730a2bd92ee3fb176b3ec [production]
2017-04-19 §
23:58 <ejegg> updated payments-wiki from ccfbf98b475c135c1c1eb65ffe7dadaa6882461b to ee7d402216f6eae71cc85137741187ab096ead33 [production]
22:37 <papaul> OS installation on db2071 [production]
21:44 <ejegg> updated SmashPig from 17c56b016a12ff480358481c2b1de26c0acce83d to 200f63eedb05f5e6665d9837bba97e7e7237a41d [production]
21:37 <krinkle@naos> Synchronized php-1.29.0-wmf.20/resources/src/startup.js: I34bbe8edf - Fix js fatal (duration: 01m 20s) [production]
20:08 <ejegg> updated payments-wiki from 5398b23fd3c46c096222c986345bd77f5f813fb6 to ccfbf98b475c135c1c1eb65ffe7dadaa6882461b [production]
19:22 <krinkle@naos> Synchronized php-1.29.0-wmf.20/resources/src/mediawiki/mediawiki.js: Ie50bdda229e48b (duration: 00m 58s) [production]
19:20 <krinkle@naos> Synchronized php-1.29.0-wmf.20/extensions/WikimediaEvents/extension.json: T162604 (duration: 01m 20s) [production]
19:17 <XenoRyet> Updated SmashPig from 3db064d258852b5c55184c991f183ecb3266f0c7 to 17c56b016a12ff480358481c2b1de26c0acce83d [production]