2201-2250 of 10000 results (49ms)
2018-03-05 ยง
16:32 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1069 - T186699 (duration: 00m 57s) [production]
16:24 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1098:3317 after alter table (duration: 00m 57s) [production]
16:00 <elukey> test [production]
15:56 <akosiaris> upload tiller on apt.wikimedia.org Component: main distros: jessie-wikimedia, stretch-wikimedia T189919 [production]
15:56 <akosiaris> upload helm on apt.wikimedia.org Component: main distros: jessie-wikimedia, stretch-wikimedia T189919 [production]
15:55 <urandom> setting trace probability to 0.001 (.1%), eqiad datacenter, restbase cassandra cluster [production]
15:52 <urandom> updating `system_traces` keyspace replication strategy, restbase cassandra cluster [production]
15:51 <mobrovac@tin> Synchronized wmf-config/InitialiseSettings.php: Switch all of the cdnPurge to EventBus, file 2/2 - T188540 (duration: 00m 57s) [production]
15:50 <marostegui> Deploy schema change on dbstore1002 - T187089 T185128 T153182 [production]
15:49 <mobrovac@tin> Synchronized wmf-config/jobqueue.php: Switch all of the cdnPurge to EventBus, file 1/2 - T188540 (duration: 00m 57s) [production]
15:45 <ppchelko@tin> Finished deploy [cpjobqueue/deploy@346a2b6]: Switch all cdnPurge jobs to kafka (duration: 00m 35s) [production]
15:45 <ppchelko@tin> Started deploy [cpjobqueue/deploy@346a2b6]: Switch all cdnPurge jobs to kafka [production]
15:42 <marostegui> stop and poweroff db1069 for rack change - T186699 [production]
15:42 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1069 - T186699 (duration: 00m 57s) [production]
15:41 <elukey> drain + reboot analytics 1055->57 for kernel updates [production]
15:38 <mobrovac@tin> Synchronized wmf-config/InitialiseSettings.php: Switch 50% for refreshLinks to EventBus - T185052 (duration: 00m 57s) [production]
15:31 <ppchelko@tin> Finished deploy [cpjobqueue/deploy@fe5b1f3]: Enable refreshLinks for 50% of the jobs (duration: 00m 39s) [production]
15:31 <ppchelko@tin> Started deploy [cpjobqueue/deploy@fe5b1f3]: Enable refreshLinks for 50% of the jobs [production]
15:28 <marostegui> Mark as failed disk 32:9 on db1068 (s4 primary master) - T188187 [production]
15:20 <mobrovac@tin> Synchronized php-1.31.0-wmf.23/extensions/EventBus/includes/JobExecutor.php: [JobExecutor] Wait for the replicas if the transaction takes too long (duration: 00m 57s) [production]
15:14 <moritzm> rebooting webperf2001 for kernel security update [production]
14:57 <hashar> European SWAT completed [production]
14:57 <hashar@tin> Finished scap: 2017 wikitext editor: Simplify config part 2 (duration: 02m 57s) [production]
14:54 <hashar@tin> Started scap: 2017 wikitext editor: Simplify config part 2 [production]
14:52 <hashar@tin> Synchronized wmf-config/InitialiseSettings.php: Enable translate extension in bdwikimedia - T188853 (duration: 00m 57s) [production]
14:48 <hashar@tin> Synchronized wmf-config/InitialiseSettings.php: Enable translate extension in bdwikimedia - T188853 (duration: 00m 57s) [production]
14:44 <hashar@tin> Synchronized wmf-config/InitialiseSettings.php: Enable rollbacker user right at arwikiversity - T188633 (duration: 00m 57s) [production]
14:41 <hashar@tin> Finished scap: core + Flow, master/replicate race condition - T182358 T184670 (duration: 04m 24s) [production]
14:36 <hashar@tin> Started scap: core + Flow, master/replicate race condition - T182358 T184670 [production]
14:34 <elukey> graphite metrics mw.error.* deprecated in T188749 [production]
14:31 <hashar@tin> Finished scap: Popups: Remove client side formatters in the REST formatter - T183833 (duration: 23m 08s) [production]
14:11 <hashar> mwscript extensions/WikimediaMaintenance/createExtensionTables.php --wiki=bdwikimedia translate # T188853 [production]
14:08 <hashar@tin> Started scap: Popups: Remove client side formatters in the REST formatter - T183833 [production]
14:06 <hashar@tin> scap aborted: Popups: Remove client side formatters in the REST formatter - T183833 (duration: 00m 16s) [production]
14:06 <hashar@tin> Started scap: Popups: Remove client side formatters in the REST formatter - T183833 [production]
13:55 <moritzm> rolling reboot of swift backends in codfw for kernel security update [production]
13:49 <moritzm> rebooting releases2001 for kernel security update [production]
13:37 <moritzm> rebooting neon for kernel security update [production]
13:37 <mobrovac@tin> Started restart [cpjobqueue/deploy@b5255f0]: Force RecordLintJob rebalance in Kakfa - T188870 [production]
13:04 <moritzm> rebooting bast4002 for kernel security update [production]
13:00 <marostegui> Deploy schema change on db1098:3317 - T187089 T185128 T153182 [production]
13:00 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1098:3317 for alter table (duration: 00m 57s) [production]
12:46 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Remove db1011 from config - T184703 (duration: 01m 02s) [production]
12:45 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Remove db1011 from config - T184703 (duration: 01m 02s) [production]
12:40 <moritzm> rebooting bast4001 for kernel security update [production]
12:30 <marostegui> Remove db1011 from tendril as it will be decommissioned - T184703 [production]
12:19 <moritzm> installing libvpx security updates [production]
12:13 <moritzm> installing wavpack security updates [production]
12:08 <moritzm> installing freexl security updates [production]
11:59 <moritzm> upgrading tor on radium [production]