|
2020-06-01
ยง
|
| 23:51 |
<bstorm_> |
refreshed certs for the custom webhook controllers on the k8s cluster T250874 |
[tools] |
| 21:37 |
<RhinosF1> |
ran https://www.irccloud.com/pastebin/2BfVYNV2/sqltorestoreekmobile to add ek back |
[tools.zppixbot-test] |
| 21:33 |
<RhinosF1> |
run https://www.irccloud.com/pastebin/hfjuh6gG/deleteusersql |
[tools.zppixbot-test] |
| 21:15 |
<RhinosF1> |
.sopel/welcome.db>CREATE TABLE chanops ( id INTEGER PRIMARY key autoincrement, nick VARCHAR(20), chan VARCHAR(20) ); for T254166 |
[tools.zppixbot] |
| 21:13 |
<RhinosF1> |
.sopel/welcome.db>CREATE TABLE chanops ( id INTEGER PRIMARY key autoincrement, nick VARCHAR(20), chan VARCHAR(20) ); for T254166 |
[tools.zppixbot-test] |
| 21:11 |
<RhinosF1> |
add *.db to sopel/.gitignore |
[tools.zppixbot-test] |
| 21:10 |
<RhinosF1> |
add *.db to sopel/.gitignore |
[tools.zppixbot] |
| 20:49 |
<James_F> |
Zuul: Disabled new mediawiki-quibble-apitests-vendor-docker for Math as it doesn't pass T254031 |
[releng] |
| 20:31 |
<James_F> |
Zuul: EventBus now depends on EventStreamConfig for non-phan too T229863 |
[releng] |
| 20:14 |
<shdubsh> |
downgrade mtail to rc5 in ulsfo -- T254192 |
[production] |
| 20:12 |
<XioNoX> |
enable IX4/6 on cr4-ulsfo - T237575 |
[production] |
| 19:57 |
<XioNoX> |
disable IX4/6 on cr4-ulsfo - T237575 |
[production] |
| 19:55 |
<XioNoX> |
fail vrrp over cr3-ulsfo - T237575 |
[production] |
| 19:44 |
<shdubsh> |
restart atsmtail in eqsin |
[production] |
| 18:51 |
<bstorm_> |
restarting mariadb on clouddb1002 T253738 |
[clouddb-services] |
| 18:21 |
<ppchelko@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:570395|Enable kask-transition for all wikis]] (duration: 01m 00s) |
[production] |
| 17:59 |
<XioNoX> |
offline cr1-codfw:fpc0 - T254110 |
[production] |
| 17:47 |
<James_F> |
Zuul: EventBus now depends on EventStreamConfig T229863 |
[releng] |
| 17:47 |
<XioNoX> |
turn online cr1-codfw:fpc0 - T254110 |
[production] |
| 17:46 |
<shdubsh> |
update mtail in ulsfo caching hosts. restarting atsmtail and varnishmtail |
[production] |
| 17:31 |
<mutante> |
backup1001 - queued job 42 - gerrit backup after renaming of the file set and addition of LFS data (T254155, T254162) it is incremental, the full one already ran |
[production] |
| 17:02 |
<James_F> |
layout: Add CI for operations/debs/kubeyaml using debian-glue |
[releng] |
| 16:49 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: EventLogging - fix searchsatisfaction schema URI - testwiki only - T249261 (duration: 00m 59s) |
[production] |
| 16:48 |
<otto@deploy1001> |
sync-file aborted: EventLogging - fix searchsatisfaction schema URI - testwiki only - T249261 (duration: 00m 02s) |
[production] |
| 16:39 |
<bstorm_> |
running view updates on db1141 T252219 |
[production] |
| 14:54 |
<elukey> |
stop all timers on an-launcher1001, prep step for reboot |
[analytics] |
| 14:53 |
<elukey> |
ganeti: increase memory available for an-launcher1001 from 8g to 12g - T254125 |
[production] |
| 14:44 |
<volans> |
deploying ulsfo mgmt DNS records automatically generated by Netbox ( operations/dns/+/585545/ ) - T233183 |
[production] |
| 13:30 |
<RhinosF1> |
ran select nick_id from nick_values where value < 1546300800 and key = "seen_timestamp" on default.db to generate P11346 for T254154 |
[tools.zppixbot] |
| 12:54 |
<elukey> |
/user/dedcode/.Trash/* -skipTrash |
[analytics] |
| 12:40 |
<RhinosF1> |
deleting 54 orphan accounts that don't have any attached values |
[tools.zppixbot] |
| 12:00 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Fully repool db1142, db1147 T252512', diff saved to https://phabricator.wikimedia.org/P11345 and previous config saved to /var/cache/conftool/dbconfig/20200601-120000-marostegui.json |
[production] |
| 11:44 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1142, db1147 T252512', diff saved to https://phabricator.wikimedia.org/P11344 and previous config saved to /var/cache/conftool/dbconfig/20200601-114440-marostegui.json |
[production] |
| 11:30 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1142, db1147 T252512', diff saved to https://phabricator.wikimedia.org/P11343 and previous config saved to /var/cache/conftool/dbconfig/20200601-113032-marostegui.json |
[production] |
| 10:49 |
<jdrewniak@deploy1001> |
Synchronized portals: Wikimedia Portals Update: [[gerrit:601328| Bumping portals to master (601328)]] (duration: 00m 59s) |
[production] |
| 10:48 |
<jdrewniak@deploy1001> |
Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:601328| Bumping portals to master (601328)]] (duration: 01m 03s) |
[production] |
| 10:28 |
<Reedy> |
webservice restart |
[tools.meta] |
| 10:08 |
<RhinosF1> |
END MAINT -- T254046 |
[tools.zppixbot] |
| 10:00 |
<RhinosF1> |
sopel.bot re-created for T254046 |
[tools.zppixbot] |
| 09:56 |
<RhinosF1> |
webservice --backend=kubernetes php7.2 start --canonical for T254046 |
[tools.zppixbot] |
| 09:55 |
<RhinosF1> |
revert sitenotice for T254046 |
[tools.zppixbot] |
| 09:45 |
<RhinosF1> |
empty pycache and switch to new deployment config |
[tools.zppixbot] |
| 09:37 |
<volans@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 09:34 |
<RhinosF1> |
tar+gzip sopel logs, empty non sopel rubbish |
[tools.zppixbot] |
| 09:31 |
<RhinosF1> |
cleaned known_users |
[tools.zppixbot] |
| 09:30 |
<volans@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 09:27 |
<RhinosF1> |
cleaned up channel_values |
[tools.zppixbot] |
| 09:26 |
<jynus> |
reenabling puppet on all db/es/pc hosts after deploy of gerrit:599596 |
[production] |
| 09:26 |
<RhinosF1> |
dropped channels noot watched from seen database |
[tools.zppixbot] |
| 09:22 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1142, db1147 T252512', diff saved to https://phabricator.wikimedia.org/P11342 and previous config saved to /var/cache/conftool/dbconfig/20200601-092220-marostegui.json |
[production] |