|
2020-03-30
ยง
|
| 20:32 |
<wm-bot> |
<root> Shutdown webservice. Stuck in CrashLoopBackoff because of bad config from /data/project/wiper-languagetool/run.sh. (java.io.FileNotFoundException: /home/server.properties) |
[tools.wiper-languagetool] |
| 19:55 |
<cmjohnson@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 19:55 |
<cmjohnson@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 19:18 |
<andrewbogott> |
restarting puppetdb on deployment-puppetdb03 and restarted apache2 on deployment-puppetmaster04 but puppet runs still fail everywhere |
[releng] |
| 19:18 |
<andrewbogott> |
restarting puppetdb on deployment-puppetdb03 and restarted apache2 on deployment-puppetmaster04 but puppet runs still fail everywhere |
[deployment-prep] |
| 19:04 |
<andrewbogott> |
setting profile::tlsproxy::envoy::timeout: 60 in project hiera to fix puppet |
[phabricator] |
| 18:28 |
<bstorm_> |
Beginning rolling depool, remount, repool of k8s workers for T248702 |
[tools] |
| 18:22 |
<bstorm_> |
disabled puppet across tools-k8s-worker-[1-55].tools.eqiad.wmflabs T248702 |
[tools] |
| 17:48 |
<James_F> |
Zuul: [operations/software/censorship-monitoring] Switch to custom job T248002 |
[releng] |
| 17:41 |
<James_F> |
Docker: Publishing tox-censorshipmonitoring:0.1.0 T248002 |
[releng] |
| 17:31 |
<James_F> |
jjb: Deployed 'assert-no-mediawiki-errors' to all quibble jobs T246358 |
[releng] |
| 17:12 |
<James_F> |
jjb: Add 'assert-no-mediawiki-errors' to mediawiki-quibble-api-testing-vendor-*-php72-docker as a test T246358 |
[releng] |
| 17:04 |
<James_F> |
jjb: Add 'wikibase-client-docker' to wikibase-*-docker as a test T246358 |
[releng] |
| 16:56 |
<arturo> |
dropping `_psl.toolforge.org` TXT record (T168677) |
[tools] |
| 16:55 |
<arturo> |
dropping `_psl.wmcloud.org` record (T168677) |
[cloudinfra] |
| 16:49 |
<James_F> |
zuul: [operations/puppet] Use buster instead of stretch job |
[releng] |
| 16:44 |
<arturo> |
[codfw1dev] installing package neutron-openvswitch-agent in cloudvirt2002-dev (T248881) |
[admin] |
| 16:42 |
<andrewbogott> |
restarting l3 agents on cloudnets in codfw1dev after applying https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/584188/ |
[admin] |
| 16:37 |
<James_F> |
zuul: [operations/puppet] Add buster as experimental |
[releng] |
| 16:37 |
<James_F> |
https://gerrit.wikimedia.org/r/#/c/584628/ |
[releng] |
| 16:27 |
<James_F> |
jjb: Created operations-puppet-tests-buster-docker |
[releng] |
| 16:25 |
<James_F> |
jjb: Sweitch operations-puppet-wmf-style-guide over to buster |
[releng] |
| 16:17 |
<James_F> |
Docker: Publish operations-puppet:0.7.0 |
[releng] |
| 16:16 |
<James_F> |
T248759 layout: [mediawiki/extensions/ExtTab] Archive |
[releng] |
| 16:07 |
<James_F> |
T242191 layout: [labs/tools/qrcode-generator] Setup gate-and-submit-l10n |
[releng] |
| 15:36 |
<ejegg> |
updated payments listener (standalone SmashPig) from dc0c6b208b to d80e4c5abd |
[production] |
| 15:32 |
<vgutierrez> |
pool cp2033 - T248816 |
[production] |
| 15:27 |
<Jayprakash12345> |
Deploying T242190 |
[tools.qrcode-generator] |
| 15:25 |
<jeh> |
add icinga 2h downtime and soft reset iDRAC on labstore1005.mgmt.eqiad.wmnet T247965 |
[production] |
| 14:58 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 14:57 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) |
[production] |
| 14:57 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 14:55 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 14:53 |
<vgutierrez> |
depool & decommission cp2008 - T248864 |
[production] |
| 14:23 |
<vgutierrez> |
pool cp2032 - T248816 |
[production] |
| 14:17 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) |
[production] |
| 14:17 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 14:01 |
<vgutierrez> |
depool & decommission cp2006 - T248856 |
[production] |
| 13:57 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 13:45 |
<vgutierrez> |
pool cp2031 - T248816 |
[production] |
| 13:09 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 13:07 |
<dzahn@cumin1001> |
END (FAIL) - Cookbook sre.hosts.decommission (exit_code=99) |
[production] |
| 13:07 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 13:06 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 12:56 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) |
[production] |
| 12:56 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 12:53 |
<vgutierrez> |
depool & decommission cp2005 - T248848 |
[production] |
| 12:26 |
<cdanis> |
cdanis@re0.cr2-codfw# set chassis fpc 5 inline-services flex-flow-sizing cdanis@re0.cr2-codfw# commit comment "flex-flow-sizing T248394" |
[production] |
| 12:24 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) |
[production] |
| 12:23 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |