651-700 of 10000 results (35ms)
2017-09-17 §
09:46 <elukey> restart varnish backend on cp1052 - recurrent mailbox lag [production]
08:11 <elukey> restart varnish backend on cp1053 - recurrent mailbox lag [production]
2017-09-16 §
22:05 <godog> compress older otrs directories to reclaim inodes - T171490 [production]
16:53 <elukey> restart varnish-backend on cp1073 (cache upload) for mailbox lag [production]
15:40 <andrewbogott> rebooting labvirt1017 [production]
15:34 <andrewbogott> rebooting labvirt1015 for T176044 [production]
2017-09-15 §
21:50 <mutante> contint2001 - systemctl start zuul [production]
21:47 <mutante> contint1001 - tmp disable puppet - contint2001 - test zuul unit file (gerrit 359016) [production]
21:43 <demon@tin> Finished deploy [gerrit/gerrit@48ad332]: 2.13.9 -- not being used yet though (duration: 00m 08s) [production]
21:43 <demon@tin> Started deploy [gerrit/gerrit@48ad332]: 2.13.9 -- not being used yet though [production]
15:46 <bblack> cp1049 - backend restart, mailbox lag [production]
15:40 <bblack> cp1099 - backend restart, mailbox lag [production]
15:38 <bblack> cp1072 - backend restart, mailbox lag [production]
15:21 <_joe_> uploaded td-agent-bit (fluentd-bit) to wikimedia-stretch T175527 [production]
13:13 <moritzm> pruned hhvm bytecode cache on mw2256, led to log spam for an undefined variable after being out of service for hardware maintenance [production]
13:10 <jmm@puppetmaster1001> conftool action : set/pooled=yes; selector: mw2256.codfw.wmnet [production]
13:10 <addshore@tin> Synchronized wmf-config/CommonSettings-labs.php: [[gerrit:378235|beta: $wgWikiDiff2MovedParagraphDetectionCutoff = 25]] BETA ONLY 2/2 (duration: 00m 45s) [production]
13:08 <addshore@tin> Synchronized wmf-config/InitialiseSettings-labs.php: [[gerrit:378235|beta: $wgWikiDiff2MovedParagraphDetectionCutoff = 25]] BETA ONLY 1/2 (duration: 00m 47s) [production]
11:22 <jmm@puppetmaster1001> conftool action : set/pooled=no; selector: mw2256.codfw.wmnet [production]
09:10 <moritzm> installing tcpdump security updates on trusty hosts (Debian systems already fixed) [production]
08:54 <moritzm> installing libbluetooth updates [production]
08:03 <jynus> dropping mariadb analytics users on db1031, db1029 [production]
07:49 <Amir1> running maintenance/updateCollation.php --force on Persian (fa) wikis (T173601) [production]
07:38 <gehel> shutting down and masking elasticsearch on elastic1020 - T175951 [production]
07:35 <gehel> depooling elastic1020 - T175951 [production]
07:28 <jmm@puppetmaster1001> conftool action : set/pooled=yes; selector: mw2256.codfw.wmnet [production]
00:46 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool db1100 (duration: 00m 46s) [production]
2017-09-14 §
23:51 <mutante> phabricator - tested gerrit 354247 before merging using apache-fast-test from tin -restarted apache [production]
23:37 <catrope@tin> Synchronized wmf-config/: VRS config for Electron (T175868) (duration: 00m 47s) [production]
23:34 <catrope@tin> Synchronized php-1.30.0-wmf.18/extensions/VisualEditor/lib/ve/src/ui/styles/ve.ui.TableLineContext.css: T169389 (duration: 00m 45s) [production]
23:33 <catrope@tin> Synchronized php-1.30.0-wmf.18/extensions/ContentTranslation/modules/widgets/translator/ext.cx.translator.js: Fix JS error in CX (duration: 00m 46s) [production]
23:29 <catrope@tin> Synchronized wmf-config/CommonSettings.php: Give sysops the flow-create-board right on Flow wikis (T175934) (duration: 00m 45s) [production]
23:27 <catrope@tin> Synchronized wmf-config/InitialiseSettings.php: Give sysops the flow-create-board right on Flow wikis (T175934) (duration: 00m 45s) [production]
23:22 <catrope@tin> Synchronized wmf-config/InitialiseSettings.php: Use RemexHtml on mediawikiwiki and testwiki (T175095) (duration: 00m 46s) [production]
23:19 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=acamar.wikimedia.org [production]
23:18 <mutante> acamar is back up and running - no failed units [production]
23:13 <catrope@tin> Synchronized wmf-config/InitialiseSettings.php: Allow bureaucrats to remove accountcreator on mediawikiwiki (T175903) (duration: 00m 46s) [production]
23:12 <mutante> acamar - staged BIOS upgrade in progress [production]
23:09 <mutante> acamar - done with upgrade - rebooting - it's depooled and removed from resolv.conf - T162850 [production]
22:56 <mutante> depooled acamar (codfw dns recursor) for BIOS upgrade - installing firmware [production]
22:56 <dzahn@neodymium> conftool action : set/pooled=no; selector: name=acamar.* [production]
22:55 <maxsem@tin> Synchronized wmf-config/: Labs only: https://gerrit.wikimedia.org/r/378184 https://gerrit.wikimedia.org/r/378187 (duration: 00m 47s) [production]
22:15 <maxsem@tin> Synchronized wmf-config/InitialiseSettings.php: ACTRIAL going live: https://gerrit.wikimedia.org/r/#/c/378104/ (duration: 00m 46s) [production]
21:22 <maxsem@tin> Synchronized php-1.30.0-wmf.18/extensions/ArticleCreationWorkflow/: https://gerrit.wikimedia.org/r/#/c/378125/ (duration: 00m 47s) [production]
20:34 <demon@tin> Synchronized php-1.30.0-wmf.18/skins/MinervaNeue/resources/skins.minerva.userpage.icons/userpage.svg: I95d76339 (duration: 00m 45s) [production]
20:18 <demon@tin> Synchronized php-1.30.0-wmf.18/includes/api/ApiFeedWatchlist.php: Ibea5bd88 (duration: 00m 46s) [production]
20:04 <demon@tin> Synchronized php-1.30.0-wmf.18/extensions/OAuth/backend/MWOAuthDAO.php: I785230df (duration: 00m 46s) [production]
20:02 <ppchelko@tin> Finished deploy [cpjobqueue/deploy@af9b590]: Emit broker statistics more frequentl (duration: 00m 30s) [production]
20:02 <ppchelko@tin> Started deploy [cpjobqueue/deploy@af9b590]: Emit broker statistics more frequentl [production]
19:58 <dcausse> banning elastic1020 to see if T175951 is caused by mixed versions of the ltr plugin [production]