4651-4700 of 10000 results (57ms)
2018-01-05 §
09:20 <elukey> drain and reboot analytics1030 for kernel updates [production]
09:11 <godog> reboot ms-be1014 to test update stretch kernel [production]
08:54 <elukey> ran git checkout modules/role/manifests/puppetmaster/standalone.pp on labs-puppetmaster.wikimedia.org to unblock sync from prod [production]
08:39 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1094 - T163190 (duration: 00m 28s) [production]
07:37 <_joe_> rebooting mw1276 toio, kernel upgrade [production]
07:25 <_joe_> rebooting mw1261 [production]
06:49 <marostegui> Stop replication in sync on db1039 and db1098:3317 - T163190 [production]
06:48 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1098:3317 - T163190 (duration: 00m 27s) [production]
06:24 <marostegui> Deploy schema change on db1094 - T174569 [production]
06:23 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1094 - T163190 (duration: 00m 51s) [production]
03:54 <demon@tin> Synchronized wmf-config/InitialiseSettings.php: Undeploy EducationProgram from test2wiki (duration: 00m 48s) [production]
2018-01-04 §
23:30 <apergos> rebooted releases1001 and 2001 (new kernel) [production]
22:09 <moritzm> uploaded linux-meta 1.16 for jessie-wikimedia to apt.wikimedia.org (which installs the new KPTI-enabled kernel with the new ABI) [production]
22:03 <twentyafterfour@tin> rebuilt and synchronized wikiversions files: all wikis to 1.31.0-wmf.15 [production]
22:00 <twentyafterfour> No blockers remain for T180748, proceeding to deploy wmf.15 to all wikis [production]
21:53 <twentyafterfour@tin> Synchronized php-1.31.0-wmf.15/extensions/TitleBlacklist/TitleBlacklistPreAuthenticationProvider.php: Deploy 332fab0d737b5a524abbed7264d64890dd3ce6dc to stop logspam and unblock the train (duration: 01m 02s) [production]
21:37 <moritzm> uploaded linux-4.9.65-3+deb9u1~bpo8+2 for jessie-wikimedia to apt.wikimedia.org (provides KPTI backport) [production]
21:35 <twentyafterfour@tin> Synchronized php-1.31.0-wmf.15/includes/parser/Parser.php: Deploy 601cf9d183b0e5a97d264048efaab71a4a925500 (duration: 01m 03s) [production]
21:33 <twentyafterfour> deploying patches to unblock the train [production]
21:25 <moritzm> reboot multatuli for kernel update [production]
20:06 <twentyafterfour> There are still open blockers for wmf.15 - see T180748 .. attempting to resolve them to unblock the train. [production]
20:03 <twentyafterfour> preparing to deploy the train (filling in for no_justification) [production]
19:51 <joal@tin> Finished deploy [analytics/refinery@a69a2cd]: Regular analytics deploy (duration: 04m 38s) [production]
19:46 <joal@tin> Started deploy [analytics/refinery@a69a2cd]: Regular analytics deploy [production]
18:58 <bsitzmann@tin> Finished deploy [mobileapps/deploy@8bcffa9]: Update mobileapps to a4ba9fd (T182330 T177430 T170690 T182652 T184198) (duration: 06m 01s) [production]
18:52 <bsitzmann@tin> Started deploy [mobileapps/deploy@8bcffa9]: Update mobileapps to a4ba9fd (T182330 T177430 T170690 T182652 T184198) [production]
18:27 <jynus> upgrade and restart labsdb1009 [production]
17:42 <moritzm> upgrading HHVM on eqiad video scalers to 3.18.6 [production]
17:40 <demon@tin> Finished deploy [gerrit/gerrit@1e1a79d]: deploying hooks plugin (duration: 00m 10s) [production]
17:40 <demon@tin> Started deploy [gerrit/gerrit@1e1a79d]: deploying hooks plugin [production]
16:38 <jynus> upgrade and restart db2089 (s5/s6) [production]
16:14 <jynus> upgrade and restart db2087 (s6/s7) [production]
15:44 <jynus> upgrade and restart db2076 [production]
15:36 <jynus> upgrade and restart db2067 [production]
15:31 <demon@tin> Synchronized php-1.31.0-wmf.15/extensions/ActiveAbstract/: unbreak, T184177 (duration: 01m 02s) [production]
15:17 <jynus> upgrade and restart db2060 [production]
15:09 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1101:3317 - T163190 (duration: 01m 02s) [production]
15:03 <moritzm> upgrading HHVM on eqiad image scalers to 3.18.6 [production]
14:54 <jynus> restart db2046 database to move socket location [production]
14:24 <niharika29@tin> Synchronized wmf-config/InitialiseSettings.php: Adding Movepage-summary to wgForceUIMsgAsContentMsg T183848 (duration: 01m 02s) [production]
14:11 <niharika29@tin> Synchronized wmf-config/InitialiseSettings.php: Restrict sending mails to new users T182541 (duration: 01m 02s) [production]
13:43 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1079 - T163190 (duration: 01m 01s) [production]
13:36 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1079 - T163190 (duration: 01m 02s) [production]
13:35 <marostegui> Stop replication in sync db1079 db1101:3317 T163190 [production]
13:17 <moritzm> upgrading HHVM on mw1180-mw1220 to 3.18.6 [production]
12:53 <moritzm> upgrading HHVM on mwdebug* to 3.18.6 [production]
12:45 <mobrovac@tin> Finished deploy [restbase/deploy@66b7efe]: Switch Mathoid to Cassandra 3 and drop Cassandra 2 references - T179419 (duration: 04m 05s) [production]
12:41 <mobrovac@tin> Started deploy [restbase/deploy@66b7efe]: Switch Mathoid to Cassandra 3 and drop Cassandra 2 references - T179419 [production]
12:07 <mobrovac@tin> Finished deploy [mathoid/deploy@c9957ce]: Mathoid v0.7.1 - T172767 (duration: 05m 05s) [production]
12:02 <mobrovac@tin> Started deploy [mathoid/deploy@c9957ce]: Mathoid v0.7.1 - T172767 [production]