751-800 of 10000 results (62ms)
2020-02-01 §
13:00 <effie> depool scb2003 [production]
12:21 <effie> depool mw1273 [production]
01:03 <eileen> process-control config revision is c3c8bde761 [production]
00:50 <eileen> civicrm revision changed from fcc5673ee7 to ee9edf8137, config revision is 2a61da0ace [production]
2020-01-31 §
22:25 <eileen> civicrm revision changed from ac730a6bcb to fcc5673ee7, config revision is 2a61da0ace [production]
22:14 <bstorm_> repooled labsdb1011 now that view work is done [production]
22:00 <eileen> process-control config revision is 2a61da0ace disabled process-control [production]
21:59 <bstorm_> depooled labsdb1011 [production]
21:32 <bstorm_> updated views on labsdb1010 [production]
21:22 <bstorm_> updated views on labsdb1009 [production]
21:21 <bstorm_> updated actor views on labsdb1012 [production]
18:17 <bblack> repool cp4032 (buster) [production]
18:17 <bblack@cumin1001> conftool action : set/pooled=yes; selector: name=cp4032.ulsfo.wmnet [production]
18:14 <bblack> repool cp4029 [production]
18:13 <bblack> restarted ats-tls and varnish-fe on cp4029 [production]
18:05 <bblack> depool varnish-fe on cp4029 [production]
18:03 <bblack> depool ats-tls on cp4029 [production]
16:59 <marostegui> Re-enable notifications on the dbstore1005:3318 check T243871 [production]
09:18 <addshore> addshore@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/rebuildPropertyTerms.php --wiki=wikidatawiki --sleep 4 --batch-size=25 # In a screen for T219301 [production]
03:22 <mutante> powercycling crashed cp3063 [production]
01:09 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@322ee4c]: Update mobileapps to 3eec28d (duration: 06m 53s) [production]
01:02 <mholloway-shell@deploy1001> Started deploy [mobileapps/deploy@322ee4c]: Update mobileapps to 3eec28d [production]
00:41 <mutante> contint1001/contint2001 - upgrading jenkins to 2.219 [production]
00:36 <mutante> releases2001: upgrading jenkins to 2.219; install1002: import jenkins 2.219 into jessie-wikimedia APT repo [production]
00:31 <mutante> importing jenkins 2.219 to stretch-wikimedia APT repo; releases1001: upgrading jenkins to 2.219 [production]
2020-01-30 §
19:37 <mutante> copying /var/log/apache2 to /root on all eqiad mw appservers to preserve logs [production]
18:07 <vgutierrez> depool cp4032 and perform a rolling restart of varnish-fe at cp4027-cp4031 - T243634 [production]
17:51 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.16/extensions/Wikibase/lib/includes/Store/Sql/Terms/FingerprintableEntityTermStoreTrait.php: wbterms: Fix incorrect deletion of rows in findActuallyUnusedTermIds (T243944) (duration: 01m 06s) [production]
17:49 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.16/extensions/Wikibase/repo/maintenance/rebuildItemTerms.php: wbterms: Write only to the new term store in rebuildItemTerms (T243944) (duration: 01m 09s) [production]
17:03 <vgutierrez> repooling cp4032 - T243634 [production]
17:02 <vgutierrez> restarting varnish-frontend on cp4031 before it crashes - T243634 [production]
16:26 <vgutierrez> manually refreshing OCSP stapling response for non-canonical-redirects-3 - T243948 [production]
12:22 <arturo> add prometheus 2.7.1+ds-3+k8s+buster to buster-wikimedia T238096 (basically a rebuild from stretch) [production]
06:23 <vgutierrez> restarting varnish-frontend on cp4030 before it crashes - T243634 [production]
06:21 <vgutierrez> depool cp4032 - T243634 [production]
05:12 <vgutierrez> restarting varnish-frontend and repooling cp4029 - T243634 [production]
05:00 <vgutierrez> depooling cp4029 [production]
2020-01-29 §
23:37 <marostegui> Remove partitions from db2087:3317 - T239453 [production]
18:17 <XioNoX> move knams netflow sampling to cr3-knams [production]
17:19 <krinkle@deploy1001> Synchronized wmf-config/etcd.php: Ice8dad2 (duration: 01m 10s) [production]
01:11 <vgutierrez> varnish-frontend restarted on cp4031 [production]
01:09 <vgutierrez> repool cp4031 [production]
01:05 <marostegui> Disable notifications for dbstore1005:3318 slave lag - T243871 [production]
01:03 <vgutierrez> depool cp4031 [production]
00:35 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1097:3314 T239453', diff saved to https://phabricator.wikimedia.org/P10289 and previous config saved to /var/cache/conftool/dbconfig/20200129-003507-marostegui.json [production]
00:22 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1097:3314 T239453', diff saved to https://phabricator.wikimedia.org/P10288 and previous config saved to /var/cache/conftool/dbconfig/20200129-002203-marostegui.json [production]
2020-01-28 §
23:53 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1097:3314 T239453', diff saved to https://phabricator.wikimedia.org/P10287 and previous config saved to /var/cache/conftool/dbconfig/20200128-235336-marostegui.json [production]
23:46 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1097:3314 T239453', diff saved to https://phabricator.wikimedia.org/P10286 and previous config saved to /var/cache/conftool/dbconfig/20200128-234601-marostegui.json [production]
23:42 <marostegui@cumin1001> dbctl commit (dc=all): 'Start repooling db1084 with its original weight', diff saved to https://phabricator.wikimedia.org/P10285 and previous config saved to /var/cache/conftool/dbconfig/20200128-234219-marostegui.json [production]
23:40 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1121 T232446', diff saved to https://phabricator.wikimedia.org/P10284 and previous config saved to /var/cache/conftool/dbconfig/20200128-234037-marostegui.json [production]