1201-1250 of 10000 results (52ms)
2020-03-23 §
08:07 <marostegui> Start m1 and m2 on db1117 [production]
08:04 <marostegui> Stop m1 and m2 on db1117 to transfer them to db1077 - this will trigger dbproxies IRC alert [production]
08:03 <moritzm> installing python-cryptography bug fix updates from Stretch point release [production]
07:46 <marostegui> Stop MySQL on db1077 (non used) for 10.4 upgrade and gtid_domain_id on multisource T149418 [production]
2020-03-22 §
23:19 <reedy@deploy1001> Synchronized wmf-config/InitialiseSettings-labs.php: T248274 (duration: 01m 19s) [production]
04:37 <gehel@cumin1001> END (FAIL) - Cookbook sre.wdqs.data-reload (exit_code=99) [production]
2020-03-21 §
14:29 <wm-bot> <lucaswerkmeister> deployed 52678de195 (handle missing/invalid titles and langcode improvement) [tools.wd-image-positions]
14:23 <andrewbogott> restarting apache2 on labweb1001 and 1002 [admin]
14:17 <joal> Restart wikidata_item_page_link job with manual fix - review to be confirmed [analytics]
14:06 <joal> Kill buggy wikidata_item_page_link job [analytics]
2020-03-20 §
23:16 <dzahn@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
23:04 <dzahn@cumin1001> START - Cookbook sre.ganeti.makevm [production]
22:43 <Krinkle> Click "Disable Publishing" for extension-TitleBlacklist, T243175, T143162 [releng]
22:22 <James_F> Zuul: Unanchor the train-deploy-notes job regex filter 582111 T243330 [releng]
21:06 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
21:04 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
21:01 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
20:59 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
20:59 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
20:59 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
20:57 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
20:56 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
20:55 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
20:53 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
20:41 <dzahn@cumin1001> conftool action : set/pooled=inactive; selector: name=mw124[4-9].eqiad.wmnet [production]
20:40 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:40 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:40 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:40 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:40 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:39 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:37 <dzahn@cumin1001> conftool action : set/pooled=inactive; selector: name=mw123[0-1].eqiad.wmnet [production]
20:32 <dzahn@cumin1001> conftool action : set/pooled=inactive; selector: name=mw122[7-9].eqiad.wmnet [production]
20:18 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw124[4-9].eqiad.wmnet [production]
20:18 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw123[0-1].eqiad.wmnet [production]
20:18 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw122[7-9].eqiad.wmnet [production]
18:07 <James_F> jjb: Manually disabled wikimedia-portals-build cronjob. T213806 [releng]
18:06 <James_F> jjb: Manually disabled DockerJessie boxes for T239981 [releng]
18:03 <brennen> Updating dev-images docker-pkg files on contint1001 for T248178 [releng]
16:04 <jeh> truncate jembot/error.log T247315 [tools.jembot]
15:44 <hashar@deploy1001> Synchronized php-1.35.0-wmf.24/includes/ActorMigration.php: Avoid upsert() log warning spam in ActorMigration due to unique key array format - T248147 (duration: 01m 01s) [production]
15:07 <bstorm_> replacing the toollabs::legacy roles with wmcs::toolserver_legacy [toolserver-legacy]
14:58 <jeh> delete cloudvps project and VMs T241719 [icingaduty]
14:03 <jeh> upgrade paws-puppetmaster-01 to v5 T241719 [paws]
13:43 <jeh> upgrade puppetmaster to v5 T241719 [clouddb-services]
13:34 <hnowlan@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
13:33 <hnowlan@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
13:33 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
12:16 <marostegui@cumin1001> dbctl commit (dc=all): 'Decrease db1087, vslow host weight in main, given that the CPU across s8 is now doing a lot better', diff saved to https://phabricator.wikimedia.org/P10741 and previous config saved to /var/cache/conftool/dbconfig/20200320-121628-marostegui.json [production]
11:52 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]