2351-2400 of 10000 results (33ms)
2017-11-08 ยง
16:58 <urandom> Restarting Cassandra, restbase1008-[abc] [production]
16:49 <awight@tin> Finished deploy [ores/deploy@82a13ae]: Roll back scb1002 (duration: 02m 37s) [production]
16:47 <awight@tin> Started deploy [ores/deploy@82a13ae]: Roll back scb1002 [production]
16:45 <awight@tin> Finished deploy [ores/deploy@1b0e59f]: Try to purge specter of revscoring 1 (duration: 05m 45s) [production]
16:40 <awight@tin> Started deploy [ores/deploy@1b0e59f]: Try to purge specter of revscoring 1 [production]
16:37 <urandom> Restarting Cassandra, restbase1010-[abc] [production]
16:37 <godog> disregard message about thumbor rolling-restart, upgrade already done and only thumbor1001 rebooted now [production]
16:34 <awight@tin> Finished deploy [ores/deploy@82a13ae]: Fix ORES on scb1002 (duration: 00m 03s) [production]
16:34 <awight@tin> Started deploy [ores/deploy@82a13ae]: Fix ORES on scb1002 [production]
16:29 <godog> roll-restart thumbor in eqiad for kernel upgrade [production]
16:11 <mobrovac@tin> Finished deploy [restbase/deploy@c5dd1e2]: Switch wiktionary definitions to use the next-gen storage, take 2b - T179420 (duration: 07m 22s) [production]
16:04 <mobrovac@tin> Started deploy [restbase/deploy@c5dd1e2]: Switch wiktionary definitions to use the next-gen storage, take 2b - T179420 [production]
16:02 <mobrovac@tin> Finished deploy [restbase/deploy@c5dd1e2]: Switch wiktionary definitions to use the next-gen storage, take 2 - T179420 (duration: 00m 13s) [production]
16:02 <mobrovac@tin> Started deploy [restbase/deploy@c5dd1e2]: Switch wiktionary definitions to use the next-gen storage, take 2 - T179420 [production]
16:01 <otto@tin> Finished deploy [eventlogging/analytics@03285e4]: Reverting EvenCapsule update and fixes, processes got restarted too early (duration: 00m 02s) [production]
16:01 <otto@tin> Started deploy [eventlogging/analytics@03285e4]: Reverting EvenCapsule update and fixes, processes got restarted too early [production]
15:33 <urandom> Decommissioning restbase2001-c.codfw.wmnet (T179422) [production]
15:23 <_joe_> testing changes on rhodium regarding hostprivkey,hostcert [production]
15:21 <ema> eqiad lvs reboots: upgrading kernel to 4.9.51, libssl to 1.0.2m [production]
15:17 <otto@tin> Finished deploy [eventlogging/analytics@02c5a6b]: EventCapsule update and fixes, this is no-op as is. T179625 (duration: 00m 04s) [production]
15:16 <otto@tin> Started deploy [eventlogging/analytics@02c5a6b]: EventCapsule update and fixes, this is no-op as is. T179625 [production]
15:01 <otto@tin> Started restart [eventlogging/eventbus@41e3418]: Bumping worker processes to 16 on all targets: T180017 [production]
14:55 <otto@tin> Started restart [eventlogging/eventbus@41e3418]: Bumping worker processes to 16: T180017 [production]
14:54 <ema> esams lvs reboots: upgrading kernel to 4.9.51, libssl to 1.0.2m [production]
14:54 <otto@tin> Finished deploy [eventlogging/eventbus@41e3418]: (no justification provided) (duration: 00m 12s) [production]
14:54 <otto@tin> Started deploy [eventlogging/eventbus@41e3418]: (no justification provided) [production]
14:41 <ema> powercycle cp1050 (failed reboot) [production]
14:29 <addshore@tin> Synchronized php-1.31.0-wmf.7/docs/uidesign/mediawiki.diff.html: SWAT [[gerrit:389969|Add render moved paragraphs marker in diff view]] PT 2/2 DOCS ONLY (duration: 00m 50s) [production]
14:28 <addshore@tin> Synchronized php-1.31.0-wmf.7/resources/src/mediawiki/mediawiki.diff.styles.css: SWAT [[gerrit:389969|Add render moved paragraphs marker in diff view]] PT 1/2 (duration: 00m 51s) [production]
14:16 <volans> upgrading cumin to v1.3.0 on prod and WMCS cumin masters [production]
14:10 <zfilipin@tin> Synchronized php-1.31.0-wmf.6/extensions/EventBus/EventBus.php: SWAT: [[gerrit:389974|Logging improvements.]] (duration: 00m 52s) [production]
14:08 <ema> codfw lvs reboots: upgrading kernel to 4.9.51, libssl to 1.0.2m [production]
13:03 <hasharAway> Upgrading jenkins on contint1001/contint2001 [production]
12:54 <bblack@puppetmaster1001> conftool action : set/pooled=yes; selector: name=phab2001-vcs.codfw.wmnet [production]
12:53 <bblack> restart pybal on lvs2002 for git-ssh.codfw deploy [production]
12:51 <bblack> restart pybal on lvs2005 for git-ssh.codfw deploy [production]
12:46 <mutante> osmium - re-enabling puppet - temp test is over and will be decom'ed [production]
12:41 <mutante> krypton (misc PHP apps, scholarships.wm, iegreview.wm, grafana, racktables, burrow) rebooting for kernel upgrade [production]
12:35 <mutante> bromine (misc static tistes, annual/transparency/static-bz) - rebooting for kernel upgrade [production]
12:07 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Restore db1051 original weight after maintenance - T178359 (duration: 00m 50s) [production]
12:03 <mutante> alcyone (url-downloader) rebooting for kernel upgrade [production]
11:53 <mutante> netmon1003 (servermon) - rebooting for kernel upgrade [production]
11:48 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase db1051 weight after maintenance - T178359 (duration: 00m 50s) [production]
11:48 <moritzm> installed openjdk-8/openssl updates and new kernels on restbase* [production]
11:15 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase db1051 weight after maintenance - T178359 (duration: 00m 50s) [production]
11:12 <moritzm> installing jenkins security update on releases* [production]
11:10 <moritzm> imported jenkins 2.73.3 to apt.wikimedia.org [production]
10:58 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1051 with low weight after maintenance - T178359 (duration: 01m 01s) [production]
10:57 <ema> ulsfo lvs reboots: upgrading kernel to 4.9.51, libssl to 1.0.2m [production]
10:42 <mutante> actinium - reboot for kernel upgrade (url-downloader) [production]