5651-5700 of 10000 results (60ms)
2017-07-03 §
12:26 <elukey> reimage stat1005 with Debian Stretch [production]
12:03 <moritzm> rebooting scb1004 for kernel update [production]
10:39 <moritzm> rebooting mw1298 for kernel update [production]
09:37 <marostegui> Global rename of Markos90 → Mαρκος - T169396 [production]
09:24 <marostegui> Deploy alter table on s1 directly on codfw master (db2016) and let it replicate - T166204 [production]
09:07 <_joe_> restarting the passenger app on puppetmasters in codfw serially with a sleep of 3 seconds for T169493 [production]
08:58 <_joe_> restarting the passenger app on puppetmaster1002 for T169493 [production]
08:49 <gehel> unbanning elastic1020 from elasticsearch eqiad [production]
08:29 <marostegui> Compress dewiki on dbstore2001 - T168354 [production]
08:25 <gehel> banning elastic1020 from elasticsearch eqiad waiting for its recovery [production]
08:02 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Add comments about db1039 status - T166208 (duration: 02m 49s) [production]
07:51 <marostegui> Deploy alter table db1039 - s7 - T166208 [production]
07:40 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1034 - T166208 (duration: 03m 00s) [production]
07:35 <marostegui> Drop alter table s7 - labsdb1003 - T166208 [production]
07:24 <volans> bounced uwsgi-graphite-web on graphite1003, log stopped since Jul 2 10:23:45 [production]
05:44 <marostegui> Run redact sanitarium on db1069 - T160869 [production]
05:31 <marostegui> Run redact sanitarium on db1095 - T160869 [production]
02:40 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.7) (duration: 14m 45s) [production]
2017-07-02 §
12:44 <ema> powercycle mw2256 https://phabricator.wikimedia.org/P5662 T163346 [production]
2017-07-01 §
13:08 <ppchelko@tin> Finished deploy [restbase/deploy@8ea07d6]: Manual blacklist for russian wiki (duration: 07m 59s) [production]
13:00 <ppchelko@tin> Started deploy [restbase/deploy@8ea07d6]: Manual blacklist for russian wiki [production]
00:54 <mutante> APT - importing php-net-ipv4 to stretch (for librenms) T159756 [production]
2017-06-30 §
23:16 <dzahn@neodymium> conftool action : set/pooled=no; selector: name=mw1196.eqiad.wmnet [production]
23:12 <legoktm@tin> Synchronized wmf-config/InitialiseSettings.php: Limit thanks for new users at pl.wikipedia to 3 per day - T169268 (duration: 02m 49s) [production]
23:05 <mutante> librenms has been deployed on netmon1002 - works on stretch now - except Letsencrypt part, expected. not switched yet [production]
22:42 <mutante> green unicorn now running on cubalibre (this means gunicornd used by the librenms role now works on stretch :) [production]
20:03 <ariel@tin> Finished deploy [dumps/dumps@02c71bc]: permit batching of abstract jobs, fix a dryrun reporting typo, smaller stub/abstract queries (duration: 00m 03s) [production]
20:03 <ariel@tin> Started deploy [dumps/dumps@02c71bc]: permit batching of abstract jobs, fix a dryrun reporting typo, smaller stub/abstract queries [production]
19:41 <cmjohnson1> powering off mw1196 for unresponsive idrac [production]
19:37 <cmjohnson1> powering off mw1191 for unresponsive idrac [production]
19:31 <cmjohnson1> powering off mw1190 to reestablish idrac connection [production]
19:21 <cmjohnson1> mw1182 powering down to due to unresponsive idrac [production]
17:01 <paravoid> rebooting mw1196 [production]
15:39 <gehel> unbanning elastic1019 from cluster and keeping an eye on it [production]
14:51 <gehel> banning elastic1019 from cluster to move heavy shards around [production]
14:16 <bblack> reboot cp4021 [production]
13:39 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1028 - T166208 (duration: 00m 42s) [production]
13:32 <bawolff> Reset 2FA of wikitech [[User:Samtar]] (T169332) [production]
12:47 <jynus> just upgraded wmf-mariadb101-client on mariadb::client hosts [production]
12:26 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Add comments to db1060 about its future usage as a sanitarium master - T153743 (duration: 00m 42s) [production]
12:08 <akosiaris@tin> Synchronized wmf-config/ProductionServices.php: Replace subra/suhail as poolcounters (duration: 00m 43s) [production]
12:07 <akosiaris> replace subra and suhail as poolcounters in codfw [production]
11:22 <_joe_> rebooting copper for kernel upgrade [production]
11:17 <_joe_> purging varnish, varnish-dbg from copper [production]
11:08 <jynus> removing leftover data on tegmen T149557 [production]
10:55 <elukey> deploy kafkatee 0.1.6-1 to oxygen [production]
10:41 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1026 - T168661 (duration: 00m 42s) [production]
10:38 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1026 - T168661 (duration: 00m 42s) [production]
09:54 <elukey> uploaded kafkatee 0.1.6-1 to reprepro - T151748 [production]
09:10 <marostegui> Deploy alter table on s5 all eqiad hosts (primary master not included) - T168661 [production]