|
2020-01-16
ยง
|
| 13:48 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1097:3314 db1097:3315', diff saved to https://phabricator.wikimedia.org/P10179 and previous config saved to /var/cache/conftool/dbconfig/20200116-134801-marostegui.json |
[production] |
| 13:37 |
<marostegui> |
Upgrade db1097:3314 db1097:3315 |
[production] |
| 13:35 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1097:3314 db1097:3315', diff saved to https://phabricator.wikimedia.org/P10178 and previous config saved to /var/cache/conftool/dbconfig/20200116-133515-marostegui.json |
[production] |
| 13:30 |
<moritzm> |
restarting Swift frontends to pick up OpenSSL security update |
[production] |
| 13:09 |
<Urbanecm> |
EU SWAT done late |
[production] |
| 13:02 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: aedd2c4: Add HD logos to IS.php (duration: 01m 04s) |
[production] |
| 13:00 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: 940b9a2: Add wgLogoHD entry for fa, te wikiquote & fr wikisource in IS.php (duration: 01m 05s) |
[production] |
| 12:54 |
<urbanecm@deploy1001> |
Synchronized static/images/project-logos/: SWAT: Sync project logos (duration: 01m 06s) |
[production] |
| 12:51 |
<XioNoX> |
remove BGP sessions to AS22652 in eqiad (left the IX) |
[production] |
| 12:45 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Fully repool db1080', diff saved to https://phabricator.wikimedia.org/P10176 and previous config saved to /var/cache/conftool/dbconfig/20200116-124516-marostegui.json |
[production] |
| 12:42 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: 7381446: Add `Tutoriel` namespace for French Wiktionary (T242102) (duration: 01m 04s) |
[production] |
| 12:40 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 12:38 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1080', diff saved to https://phabricator.wikimedia.org/P10175 and previous config saved to /var/cache/conftool/dbconfig/20200116-123841-marostegui.json |
[production] |
| 12:38 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 12:33 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: 65e17eb: Configure GlobalRename blacklist (T101615) (duration: 01m 05s) |
[production] |
| 12:30 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:565073|Stop writing to wb_terms for properties in Test Wikidata (T225054)]] (duration: 01m 05s) |
[production] |
| 12:28 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1080', diff saved to https://phabricator.wikimedia.org/P10174 and previous config saved to /var/cache/conftool/dbconfig/20200116-122806-marostegui.json |
[production] |
| 12:23 |
<effie> |
restart php-fpm on labweb* |
[production] |
| 12:19 |
<Amir1> |
"delete from testwikidatawiki.wb_terms where term_full_entity_id like 'P%'" (T219301 T225054) |
[production] |
| 12:17 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Another sync for the IS.php cache issue (duration: 01m 04s) |
[production] |
| 12:16 |
<effie> |
Updgrade jobrunners to php 7.2.26 and restart - T241222 |
[production] |
| 12:15 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:565073|Stop writing to wb_terms for properties in Test Wikidata (T225054)]] (duration: 01m 04s) |
[production] |
| 12:14 |
<moritzm> |
installing OpenSSL security updates |
[production] |
| 12:10 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:565074|Set read for items in Wikidata for new term store up to Q8M (T225057)]] (duration: 01m 07s) |
[production] |
| 11:59 |
<_joe_> |
delete mediawiki-core images from october 2019 T242775 |
[production] |
| 11:54 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1080', diff saved to https://phabricator.wikimedia.org/P10172 and previous config saved to /var/cache/conftool/dbconfig/20200116-115420-marostegui.json |
[production] |
| 11:28 |
<_joe_> |
uploading docker-report 0.0.3 |
[production] |
| 11:27 |
<akosiaris> |
delete etcd100{4,5,6} from netbox. T239835 |
[production] |
| 11:27 |
<akosiaris> |
delete etcd100{4,5,6} from ganeti01.svc.eqiad.wmnet. T239835 |
[production] |
| 11:22 |
<elukey> |
import packages in stretch-wikimedia's thirdparty/bigtop14 component |
[production] |
| 11:20 |
<akosiaris@cumin1001> |
END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) |
[production] |
| 11:18 |
<volans> |
uploaded spicerack_0.0.29-1_amd64.deb to apt.wikimedia.org stretch-wikimedia |
[production] |
| 11:17 |
<vgutierrez> |
restarting pybal on lvs5001 (high-traffic1) - T242321 |
[production] |
| 11:16 |
<akosiaris@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 11:16 |
<akosiaris@cumin1001> |
END (FAIL) - Cookbook sre.hosts.decommission (exit_code=99) |
[production] |
| 11:16 |
<akosiaris@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 11:13 |
<vgutierrez> |
restarting pybal on lvs5003 (secondary LVS) - T242321 |
[production] |
| 11:10 |
<vgutierrez@puppetmaster1001> |
conftool action : set/pooled=yes:weight=1; selector: service=nginx,name=ncredir5002.eqsin.wmnet |
[production] |
| 11:10 |
<vgutierrez@puppetmaster1001> |
conftool action : set/pooled=yes:weight=1; selector: service=nginx,name=ncredir5001.eqsin.wmnet |
[production] |
| 09:24 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Fully repool db1100', diff saved to https://phabricator.wikimedia.org/P10171 and previous config saved to /var/cache/conftool/dbconfig/20200116-092409-root.json |
[production] |
| 09:18 |
<effie> |
restart php-fpm on mwmaint2001.codfw.wmnet,mwmaint1002.eqiad.wmnet,scandium.eqiad.wmnet |
[production] |
| 09:16 |
<effie> |
Updgrade mwmaint2001.codfw.wmnet,mwmaint1002.eqiad.wmnet,scandium.eqiad.wmnet, to php 7.2.26 - T241222 |
[production] |
| 09:09 |
<effie> |
restart php-fpm on cloudweb2001-dev.wikimedia.org,labweb[1001-1002].wikimedia.org |
[production] |
| 09:02 |
<effie> |
Updgrade cloudweb2001-dev.wikimedia.org,labweb[1001-1002].wikimedia.org to php 7.2.26 - T241222 |
[production] |
| 08:55 |
<ema> |
cp3063: ats-backend-restart to clear things up after traffic_server crash T242952 |
[production] |
| 08:50 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1110', diff saved to https://phabricator.wikimedia.org/P10170 and previous config saved to /var/cache/conftool/dbconfig/20200116-085047-marostegui.json |
[production] |
| 08:39 |
<effie> |
Upgrade deploy*, snapshot* to php 7.2.26 - T241222 |
[production] |
| 08:27 |
<moritzm> |
installing OpenSSL security updates on Parsoid hosts |
[production] |
| 08:20 |
<XioNoX> |
reject RPKI invalids in eqord/eqiad - T220669 |
[production] |
| 08:05 |
<_joe_> |
deleting mediawiki-core docker images from september 2019 from the registry, T242775 |
[production] |