|
2020-05-30
§
|
| 21:52 |
<RhinosF1> |
Maint Complete! |
[tools.zppixbot-test] |
| 21:49 |
<wm-bot> |
<rhinosf1> chmod a+x starter-new.sh |
[tools.zppixbot-test] |
| 21:26 |
<RhinosF1> |
tools.zppixbot-test@tools-sgebastion-07:~/k8s$ take /data/project/zppixbot-test/k8s/starter-new.sh - I hate forklift's file handling at times |
[tools.zppixbot-test] |
| 21:14 |
<RhinosF1> |
tools.zppixbot-test tools.zppixbot-test@tools-sgebastion-07:~/.sopel$ kubectl scale --replicas=1 deployment.apps/sopeltest.bot |
[tools.zppixbot-test] |
| 21:01 |
<RhinosF1> |
rename starter.sh to starter-old and create starter-new - move zppixbot-test to use it for the deployment |
[tools.zppixbot-test] |
| 21:00 |
<RhinosF1> |
switch that to sopeltest.bot |
[tools.zppixbot-test] |
| 20:59 |
<RhinosF1> |
tools.zppixbot-test@tools-sgebastion-07:~/.sopel$ kubectl scale --replicas=0 deployment.apps/zppixbot-test |
[tools.zppixbot-test] |
| 16:53 |
<Reedy> |
Reloading Zuul to deploy https://gerrit.wikimedia.org/r/599963 |
[releng] |
| 14:30 |
<wm-bot> |
<lucaswerkmeister> deployed ff77d74e3f (add somevalue depicts statements) |
[tools.wd-image-positions] |
| 13:18 |
<Amir1> |
ladsgroup@deployment-deploy01:/srv/mediawiki/php-master$ mwscript maintenance/createAndPromote.php --wiki=fawiki --bureaucrat --force --interface-admin --sysop Ladsgroup (Part of T253291) |
[releng] |
| 08:15 |
<elukey> |
manual reset-failed of monitor_refine_mediawiki_job_events_failure_flags |
[analytics] |
|
2020-05-29
§
|
| 23:42 |
<bstorm_> |
stopped puppet and restarting mariadb on clouddb1002 after filtering out a table T253738 |
[clouddb-services] |
| 22:46 |
<James_F> |
Zuul: Archive mediawiki/extensions/PopupPages T251000 |
[releng] |
| 22:32 |
<bstorm_> |
updated views on labsdb1010 T252219 |
[production] |
| 22:10 |
<bd808> |
Rebooting mwv-builder-03.mediawiki-vagrant.eqiad.wmflabs |
[mediawiki-vagrant] |
| 22:10 |
<wm-bot> |
<rhinosf1> dropped old logs |
[tools.zppixbot-test] |
| 22:07 |
<wm-bot> |
<rhinosf1> purge old *.*db files, tar+gzip logs/* and nuke the pycahce's |
[tools.zppixbot-test] |
| 21:24 |
<wm-bot> |
<rhinosf1> sync done |
[tools.zppixbot] |
| 21:23 |
<wm-bot> |
<rhinosf1> syncing to deploy 599873 -- T233993 |
[tools.zppixbot] |
| 20:55 |
<bstorm_> |
updating views on labsdb1011 T252219 |
[production] |
| 19:39 |
<bstorm_> |
switch deployment to the openresty version to try it out T252217 |
[tools.paws-public] |
| 19:37 |
<bstorm_> |
adding docker image for paws-public docker-registry.tools.wmflabs.org/paws-public-nginx:openresty T252217 |
[tools] |
| 19:27 |
<ryankemper> |
Successfully finished a rolling restart of the `cloudelastic` clusters (chi, psi, omega) as part of elasticsearch plugins upgrade. Host and service checks re-enabled. |
[production] |
| 18:42 |
<hauskatze> |
gerrit: replication start mediawiki/extensions/WikiShare --wait refs. T250400 |
[releng] |
| 18:17 |
<hauskatze> |
GitHub: Deleted mirror wikimedia/mediawiki-extensions-PopupPages refs. T251000 |
[releng] |
| 18:12 |
<bstorm_> |
applied in-place fix for non-ASCII usernames and applied this to my own version of the image T252217 |
[tools.paws-public] |
| 17:28 |
<bstorm_> |
updating views on labsdb1009 T252219 |
[production] |
| 16:50 |
<ryankemper> |
Performing a rolling restart of the `cloudelastic` clusters (chi, psi, omega) as part of elasticsearch plugins upgrade. Host and service checks disabled. |
[production] |
| 16:00 |
<bstorm_> |
Updating views on labsdb1012 T252219 |
[production] |
| 15:59 |
<ryankemper> |
Concluded rolling restart of the `relforge` clusters as part of elasticsearch plugins upgrade. Both hosts `relforge1001` and `relforge1002` are back up. Downtime lifted. |
[production] |
| 15:29 |
<ryankemper> |
Performing a rolling restart of the `relforge` clusters as part of elasticsearch plugins upgrade |
[production] |
| 14:59 |
<cdanis> |
disabling puppet on netflow* to deploy Ic71e96f0 T253128 |
[production] |
| 14:47 |
<akosiaris@deploy1001> |
helmfile [CODFW] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . |
[production] |
| 14:47 |
<akosiaris@deploy1001> |
helmfile [CODFW] Ran 'sync' command on namespace 'kube-system' for release 'coredns' . |
[production] |
| 14:41 |
<akosiaris@deploy1001> |
helmfile [EQIAD] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . |
[production] |
| 14:41 |
<akosiaris@deploy1001> |
helmfile [EQIAD] Ran 'sync' command on namespace 'kube-system' for release 'coredns' . |
[production] |
| 14:36 |
<hashar> |
Built Successfully tagged docker-registry.discovery.wmnet/releng/java8:0.6.4 |
[releng] |
| 14:35 |
<akosiaris@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . |
[production] |
| 14:35 |
<akosiaris@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'kube-system' for release 'coredns' . |
[production] |
| 14:27 |
<hnowlan@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 14:24 |
<hnowlan@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 14:15 |
<mdholloway> |
ran extensions/MachineVision/maintenance/removeBlacklistedSuggestions.php on commonswiki (T253821) |
[production] |
| 13:19 |
<elukey> |
re-run druid webrequest hourly 29/05T11 (failed due to a host reimage in progress) |
[analytics] |
| 12:49 |
<hnowlan> |
reimaging restbase2009 after disk replacement |
[production] |
| 12:37 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 12:35 |
<elukey@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 12:19 |
<elukey> |
reimage druid1001 to Debian Buster |
[analytics] |
| 12:15 |
<godog> |
roll-restart to upgrade thanos to 0.13.0rc0 - T252186 T233956 |
[production] |
| 11:32 |
<moritzm> |
installing cups security updates (client-side libs/tools) |
[production] |
| 11:01 |
<ema> |
upload prometheus-rdkafka-exporter 0.2 to buster-wikimedia T253551 |
[production] |