351-400 of 10000 results (50ms)
2018-01-09 §
12:03 <filippo@puppetmaster1001> conftool action : set/pooled=yes; selector: name=restbase2003.codfw.wmnet [production]
11:58 <filippo@puppetmaster1001> conftool action : set/pooled=yes; selector: name=restbase2002.codfw.wmnet [production]
11:56 <godog> roll-restart restbase c3 nodes in codfw/eqiad [production]
11:50 <filippo@puppetmaster1001> conftool action : set/pooled=yes; selector: name=restbase2001.codfw.wmnet [production]
11:43 <moritzm> rebooting app servers mw1238-mw1258 for kernel security update (along with update to HHVM 3.18.6 where applicable) [production]
11:25 <filippo@puppetmaster1001> conftool action : set/pooled=no; selector: name=restbase2001.codfw.wmnet [production]
11:17 <filippo@puppetmaster1001> conftool action : set/pooled=yes; selector: name=restbase2001.codfw.wmnet [production]
11:03 <filippo@puppetmaster1001> conftool action : set/pooled=no; selector: name=restbase2004.codfw.wmnet [production]
11:03 <filippo@puppetmaster1001> conftool action : set/pooled=no; selector: name=restbase2001.codfw.wmnet [production]
11:02 <filippo@puppetmaster1001> conftool action : set/pooled=no; selector: name=restbase2002.codfw.wmnet [production]
11:02 <filippo@puppetmaster1001> conftool action : set/pooled=no; selector: name=restbase2006.codfw.wmnet [production]
11:02 <filippo@puppetmaster1001> conftool action : set/pooled=yes; selector: name=restbase2006.codfw.wmnet [production]
11:02 <filippo@puppetmaster1001> conftool action : set/pooled=yes; selector: name=restbase2004.codfw.wmnet [production]
11:01 <filippo@puppetmaster1001> conftool action : set/pooled=yes; selector: name=restbase2001.codfw.wmnet [production]
10:59 <filippo@puppetmaster1001> conftool action : set/pooled=yes; selector: name=restbase2002.codfw.wmnet [production]
10:07 <ema> cp3041 soft lockup, rebooting [production]
10:03 <elukey> reboot kafka-jumbo1002 for kernel updates [production]
09:59 <ema> failover traffic lvs3002 -> lvs3004 (new kernel) [production]
09:51 <ema> lvs3004: upgrade to latest jessie point release (8.10) T182656 and linux kernel 4.9.65-3+deb9u1~bpo8+2 (KPTI) T184267 [production]
09:35 <elukey> reboot kafka1014 for kernel updates [production]
09:32 <godog> deploy restbase to cassandra 3 nodes [production]
09:11 <godog> roll restart swift in eqiad for kernel upgrade [production]
08:39 <moritzm> rebooting app servers in codfw for kernel security update [production]
08:15 <jynus> stopping dbstore2001:s5 for cloning to s8 [production]
06:32 <_joe_> restarting pdfrender on scb1003 [production]
06:29 <marostegui@tin> Synchronized docroot/noc/conf/s8.dblist: Deploy the dblist files with the correct databases after the split (duration: 00m 48s) [production]
06:27 <marostegui@tin> Synchronized dblists/s8.dblist: Deploy the dblist files with the correct databases after the split (duration: 00m 50s) [production]
06:26 <marostegui@tin> Synchronized dblists/s5.dblist: Deploy the dblist files with the correct databases after the split (duration: 00m 53s) [production]
06:14 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Remove read_only from s5 and s8 T177208 T181645 (duration: 00m 27s) [production]
06:11 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Splitting s5 and s8 T177208 T181645 (duration: 00m 50s) [production]
06:07 <jynus> stopping slave and reseting on db1071 [production]
06:01 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Set s5 on read-only to start failover T177208 T181645 (duration: 00m 50s) [production]
05:12 <marostegui> Start pre-failover tasks T177208 T181645 [production]
02:23 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.15) (duration: 05m 31s) [production]
00:43 <mutante> phabricator servers: upgraded php5-*, openssh [production]
00:17 <mutante> netmon1002/2001 - upgraded php7.0 related packages | krypton (webserver_misc_apps) - upgraded php5 packages [production]
00:08 <mutante> contint1001/2001 - upgraded php5-related packages [production]
00:06 <mutante> releases1001/2001 - upgraded kernel image, planet - upgraded openssl et al [production]
2018-01-08 §
23:56 <mutante> rutherfordium (people.wm.org) - upgrading PHP5 [production]
21:52 <bsitzmann@tin> Finished deploy [mobileapps/deploy@1bfd4b0]: Update mobileapps to d20915c (T184430 T184429) (duration: 05m 33s) [production]
21:47 <bsitzmann@tin> Started deploy [mobileapps/deploy@1bfd4b0]: Update mobileapps to d20915c (T184430 T184429) [production]
21:30 <arlolra> Updated Parsoid to e133312 (T182349, T183893, T159985) [production]
21:22 <arlolra@tin> Finished deploy [parsoid/deploy@1dac474]: Updating Parsoid to e133312 (duration: 10m 31s) [production]
21:11 <arlolra@tin> Started deploy [parsoid/deploy@1dac474]: Updating Parsoid to e133312 [production]
21:05 <mutante> new Wikipedia lanuage: "inh" - recreating/reloading DNS zones to add "inh" (Ingush) from langs.tmpl (T184374) https://wikitech.wikimedia.org/wiki/Add_a_wiki#DNS [production]
20:09 <ejegg> rolled back smashpig payments listener from 0e703f502d to 45aa62650c [production]
19:34 <ottomata> rebooting analytics1002 and then analytics1001 to apply proxyuser changes and kernel update [production]
19:22 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:402643|Remove language button from Wikidata and MediaWiki]] T183665 (duration: 00m 51s) [production]
19:04 <ejegg> updated SmashPig payments listener from 45aa62650c to 0e703f502d [production]
18:15 <jynus@tin> Synchronized wmf-config/db-codfw.php: Depool db2040 (duration: 00m 50s) [production]