|
2020-02-14
§
|
| 23:42 |
<XenoRyet> |
updated civicrm from cf86495d44 to 8c77e9e915 |
[production] |
| 22:02 |
<Krenair> |
Restarting webservice as everything was waiting and then returning 504 etc |
[tools.openstack-browser] |
| 21:53 |
<andrewbogott> |
moving deployment-puppetdb02 and deployment-puppetmaster03 off of cloudvirt1014 (which will be drained next week anyway) |
[releng] |
| 21:53 |
<andrewbogott> |
moving deployment-puppetdb02 and deployment-puppetmaster03 off of cloudvirt1014 (which will be drained next week anyway) |
[deployment-prep] |
| 21:31 |
<andrewbogott> |
restarting paws-puppetmaster-01 so its clients can connect |
[paws] |
| 21:01 |
<volker-e@deploy1001> |
Finished deploy [design/style-guide@1928c00]: Deploy design/style-guide: (duration: 00m 09s) |
[production] |
| 21:01 |
<volker-e@deploy1001> |
Started deploy [design/style-guide@1928c00]: Deploy design/style-guide: |
[production] |
| 20:33 |
<brennen> |
Updating dev-images docker-pkg files on contint1001 to attempt a rebuild for https://gerrit.wikimedia.org/r/c/releng/dev-images/+/571828 |
[releng] |
| 20:21 |
<reedy@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Prevent some logspam T245280 (duration: 01m 05s) |
[production] |
| 20:18 |
<andrewbogott> |
adding profile::rsyslog::kafka_shipper::kafka_brokers: [] to project-wide puppet setting |
[ores] |
| 20:16 |
<andrewbogott> |
adding profile::ores::logstash_host: localhost to project-wide puppet config |
[ores] |
| 20:09 |
<andrewbogott> |
added profile::prometheus::statsd_exporter::mappings: [] setting to the thanks-be prefix to fix puppet runs |
[monitoring] |
| 20:05 |
<thcipriani> |
deployment-mwmaint01:rm lingering .~tmp~ directories from failed rsync's taking up space |
[releng] |
| 19:31 |
<thcipriani> |
deployment-snapshot01:sudo apt-get clean cleared 1.2G of space |
[releng] |
| 19:27 |
<XenoRyet> |
updated civicrm from 55b2afb6eb to cf86495d44 |
[production] |
| 19:09 |
<jforrester@deploy1001> |
Synchronized php-1.35.0-wmf.19/extensions/Wikibase: T245062 Prevent invalid term languages from cached PrefetchingTermLookup (duration: 01m 09s) |
[production] |
| 17:37 |
<jforrester@deploy1001> |
Unlocked for deployment [ALL REPOSITORIES]: Testing T245062 fix on mwdebug1001 (duration: 03m 05s) |
[production] |
| 17:34 |
<thcipriani> |
reloading zuul to deploy https://gerrit.wikimedia.org/r/571849 |
[releng] |
| 17:33 |
<jforrester@deploy1001> |
Locking from deployment [ALL REPOSITORIES]: Testing T245062 fix on mwdebug1001 (planned duration: 60m 00s) |
[production] |
| 17:23 |
<thcipriani> |
Updating docker-pkg files on contint1001 for https://gerrit.wikimedia.org/r/571849 |
[releng] |
| 17:20 |
<thcipriani> |
updating docker-pkg files on contint1001 for https://gerrit.wikimedia.org/r/571849 |
[releng] |
| 16:11 |
<moritzm> |
installing git-lfs updates from Buster 10.3 point update |
[production] |
| 15:55 |
<moritzm> |
uploaded pypuppetdb 0.3.3-2~wmf+deb10u1 to apt.wikimedia.org |
[production] |
| 15:55 |
<bblack> |
(log(n)) |
[production] |
| 15:54 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db2086:3318 T239453', diff saved to https://phabricator.wikimedia.org/P10414 and previous config saved to /var/cache/conftool/dbconfig/20200214-155443-marostegui.json |
[production] |
| 15:52 |
<moritzm> |
uploaded pypuppetdb 0.3.3-2~wmf+deb9u1 to apt.wikimedia.org |
[production] |
| 15:46 |
<ebernhardson@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Resync initialisesetting to try and pick up previoiusly deployed cirrus query routing changes (duration: 01m 05s) |
[production] |
| 15:42 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 15:42 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 15:32 |
<effie> |
restart mc-gp* for updates |
[production] |
| 15:17 |
<bd808> |
Toil reduction: !log messages now work from the SRE team's Freenode channel. |
[production] |
| 15:14 |
<bd808> |
Restarting bot to pick up config changes for T245242 |
[tools.stashbot] |
| 13:50 |
<gehel> |
restart relforge for JVM upgrade - T245120 |
[production] |
| 10:35 |
<arturo> |
running `root@cloudcontrol2001-dev:~# designate server-create --name ns1.openstack.codfw1dev.wikimediacloud.org.` (T243766) |
[admin] |
| 10:35 |
<vgutierrez> |
revert ats 8.0.6-rc0 experiment on cp40[26,32] |
[production] |
| 10:32 |
<arturo> |
running `root@cloudcontrol1004:~# designate server-create --name ns1.openstack.eqiad1.wikimediacloud.org.` (T243766) |
[admin] |
| 10:32 |
<arturo> |
running `root@cloudcontrol1004:~# designate server-create --name ns0.openstack.eqiad1.wikimediacloud.org.` (T243766) |
[admin] |
| 10:14 |
<vgutierrez> |
rolling restart of ats-be to enable TLSv1.3 against origin servers - T170567 |
[production] |
| 09:34 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1107 after 10.4 testing - T242702', diff saved to https://phabricator.wikimedia.org/P10409 and previous config saved to /var/cache/conftool/dbconfig/20200214-093456-marostegui.json |
[production] |
| 09:32 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 09:32 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 09:25 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 09:25 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 09:25 |
<volans> |
manually absented /usr/local/bin/apt2xml on the 5 hosts with puppet disabled |
[production] |
| 09:15 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 09:15 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 09:12 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 09:12 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 09:05 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |