9251-9300 of 10000 results (113ms)
2019-09-23 §
11:06 <awight@deploy1001> Synchronized static/images/project-logos: SWAT: [[gerrit:538291|Add localized logos for the Zulu Wikipedia (T233424)]] (duration: 00m 57s) [production]
11:05 <moritzm> uploaded openjdk 8u222-b10-1~deb10u1 to buster-wikimedia/component/jdk8 (bootstrap build, second boron build following) T233604 [production]
10:43 <jdrewniak@deploy1001> Synchronized portals: Wikimedia Portals Update: [[gerrit:538591| Bumping portals to master (T128546)]] (duration: 00m 57s) [production]
10:42 <jdrewniak@deploy1001> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:538591| Bumping portals to master (T128546)]] (duration: 00m 58s) [production]
09:51 <jynus> stopping db2102 mariadb to recover db [production]
09:45 <Urbanecm> mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=loginwiki --logwiki=metawiki 'نعنوعه' 'مريانا_علي' (T233585) [production]
09:44 <Urbanecm> mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=bnwiki --logwiki=metawiki 'Huangzonghao' 'HUANGZONGHAO' (T233585) [production]
09:38 <akosiaris> T218184 upload to apt.wikimedia.org/jessie-wikimedia apertium-dan-nor_1.4.0-1+wmf1, apertium-nno-nob_1.2.0-1+wmf1, apertium-swe-dan_0.8.0-2+wmf1, apertium-swe-nor_0.3.0-2+wmf1 [production]
09:25 <elukey> temporarily disable *drop* timers on an-coord1001 to verify refinery python change with the team [analytics]
09:02 <effie> Disable puppet and rolling restart php-fpm on mw[1312-1317,1339-1347]* - T219150 [production]
08:31 <elukey@deploy1001> Finished deploy [analytics/refinery@a20a647]: Deploy python2 -> python3 fixes (duration: 07m 26s) [production]
08:24 <elukey> deploy refinery to apply all the python2 -> python3 fixes [analytics]
08:24 <elukey@deploy1001> Started deploy [analytics/refinery@a20a647]: Deploy python2 -> python3 fixes [production]
08:21 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1123 after kernel and binlog format change', diff saved to https://phabricator.wikimedia.org/P9148 and previous config saved to /var/cache/conftool/dbconfig/20190923-082119-marostegui.json [production]
07:44 <elukey> restart manually refine_mediawiki_events on an-coord1001 with --since 48 to force the refinement after camus backfilled the missing data [analytics]
07:41 <godog> swift run swiftrepl without deletes eqiad -> codfw [production]
07:41 <elukey> manually applied https://gerrit.wikimedia.org/r/#/c/analytics/refinery/+/538235/ on an-coord1001 [analytics]
07:40 <godog> swift eqiad-prod: continue ms-be1027 decom - T233289 [production]
07:30 <marostegui@cumin1001> dbctl commit (dc=all): 'More traffic to db1123 after kernel and binlog format change', diff saved to https://phabricator.wikimedia.org/P9147 and previous config saved to /var/cache/conftool/dbconfig/20190923-073044-marostegui.json [production]
07:15 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1123 after kernel and binlog format change', diff saved to https://phabricator.wikimedia.org/P9146 and previous config saved to /var/cache/conftool/dbconfig/20190923-071537-marostegui.json [production]
07:08 <marostegui> Stop MySQL on db1123 to reboot to change binlog format and kernel - T230783 [production]
07:06 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1123 to change binlog format T230783', diff saved to https://phabricator.wikimedia.org/P9145 and previous config saved to /var/cache/conftool/dbconfig/20190923-070628-marostegui.json [production]
06:50 <marostegui@cumin1001> dbctl commit (dc=all): 'Change db1123 and db1078 roles, db1078 will serve logpager and recentchanges, db1123 will just serve general traffic', diff saved to https://phabricator.wikimedia.org/P9144 and previous config saved to /var/cache/conftool/dbconfig/20190923-065056-marostegui.json [production]
06:21 <elukey_> restart camus mediawiki_events on an-coord1001 with increased mapreduce heap size [analytics]
06:01 <bd808> Restarted maintain-dbusers process on labstore1004. (T233530) [tools]
05:23 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Remove db1066 from config T233071 (duration: 00m 56s) [production]
05:22 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Remove db1066 from config T233071 (duration: 01m 15s) [production]
2019-09-22 §
19:07 <volans|off> marostegui set s3 master RW [production]
16:48 <Krenair> Changed hieradata on shinken-02 to actually apply https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/530344/ - this should unbreak shinkengen and get it purging deleted hosts and adding new ones again [shinken]
13:35 <Zppix> cleanup ZppixZppixBot-chat.freenode.net.tell.db [tools.zppixbot]
10:13 <wm-bot> <maurelio> Restarting sulwatcher. [tools.stewardbots]
2019-09-21 §
23:05 <Framawiki> Further commits can be listed on github and thus their deployment will probably not be copied here too all the time [tools.totoazero]
23:02 <Framawiki> Deployed ea19353, file restructuring so that the scripts used are in a clean repo cloned from github [tools.totoazero]
19:36 <James_F> Zuul: [WikibaseMediaInfo] Add phan dependency T224772 [releng]
09:00 <fdans> resumed per file mediarequests backfiling coordinator [analytics]
05:42 <shdubsh> re-enable input-kafka-rsyslog-shipper in codfw [production]
05:33 <shdubsh> drop input-kafka-rsyslog-shipper in codfw [production]
02:15 <bblack> dbproxy1017: executing "systemctl reload haproxy" to recover from false healthcheck failure (network issues) on master [production]
02:14 <bblack> dbproxy1016: executing "systemctl reload haproxy" to recover from false healthcheck failure (network issues) on master [production]
01:52 <shdubsh> temporarily removing input-kafka-rsyslog-shipper-eqiad/codfw from logstash2004-5-6 [production]
01:34 <mutante> restarting mobileapps service on scb* [production]
01:34 <mutante> restarted mobileapps service on scb1001 [production]
01:21 <bblack@cumin1001> conftool action : set/pooled=yes; selector: name=cp1087.eqiad.wmnet [production]
01:21 <bblack@cumin1001> conftool action : set/pooled=yes; selector: name=cp1088.eqiad.wmnet [production]
01:21 <bblack> re-pooling cp108[78] in D2 via confctl [production]
01:14 <shdubsh> temporarily removing input-kafka-rsyslog-shipper-eqiad/codfw from logstash1007 [production]
01:08 <shdubsh> removed input-kafka-rsyslog-shipper-eqiad/codfw from logstash inputs logstash1008 and logstash1009 [production]
00:54 <mutante> aqs1009 - systemctl restart aqs [production]
00:54 <mutante> aqs1006 - systemctl restart aqs [production]
00:48 <mutante> aqs1005 - systemctl restart aqs [production]