|
2018-04-24
§
|
| 06:56 |
<elukey> |
restart zookeeper on conf200[123] for openjdk upgrades |
[production] |
| 06:55 |
<joal> |
Reindextion job: https://hue.wikimedia.org/oozie/list_oozie_coordinator/0033855-180330093100664-oozie-oozi-C/ |
[analytics] |
| 06:54 |
<joal> |
Manually reindexing all of mediawiki-history for snapshot 2018-03 after having messed it with job testing |
[analytics] |
| 06:41 |
<moritzm> |
installing poppler security updates |
[production] |
| 06:35 |
<marostegui> |
Deploy schema change on db1093 - T191519 T188299 T190148 |
[production] |
| 06:34 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1093 for alter table (duration: 00m 59s) |
[production] |
| 05:21 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1096:3316 after alter table (duration: 00m 59s) |
[production] |
| 05:03 |
<_joe_> |
rebuilding the docker base images |
[production] |
| 04:35 |
<mutante> |
repooled mw2224, reinstalling mw2225 through mw2228 |
[production] |
| 03:08 |
<mutante> |
reinstalling mw2224.codfw.wmnet with wmf-auto-reimage |
[production] |
| 02:55 |
<l10nupdate@tin> |
scap sync-l10n completed (1.31.0-wmf.30) (duration: 10m 37s) |
[production] |
| 01:55 |
<cwd> |
payments, civi, and alerts re-enabled |
[production] |
| 01:11 |
<ejegg> |
re-enabled fundraising jobs |
[production] |
| 01:09 |
<ejegg> |
updated fundraising python tools from f3ed1d05b8 to 3754f32ab6 |
[production] |
| 00:18 |
<mutante> |
removing travel@ and travelapproval@ exim aliases, moving to OIT/Google (T127549) |
[production] |
|
2018-04-23
§
|
| 23:51 |
<eileen> |
civicrm revision changed from 347e613aa5 to 142edbb90b, config revision is 07dee62bff |
[production] |
| 23:35 |
<catrope@tin> |
Synchronized wmf-config/InitialiseSettings.php: Enable non-static internationalized maps on test2wiki (duration: 00m 59s) |
[production] |
| 23:32 |
<catrope@tin> |
Synchronized php-1.31.0-wmf.30/extensions/Thanks/includes/EchoCoreThanksPresentationModel.php: Fix fatal error in Thanks notifications (T192711) (duration: 00m 58s) |
[production] |
| 23:29 |
<eileen> |
civicrm revision changed from b1e7ccfc4d to 347e613aa5, config revision is 07dee62bff |
[production] |
| 23:27 |
<ejegg> |
cleared out /srv/jenkins-workspace/workspace on jenkins-1003 |
[releng] |
| 23:15 |
<XioNoX> |
changed AMS-IX peering mode to default (filter on radb+rpki) |
[production] |
| 23:13 |
<cwd> |
disabled most (all?) frack alerts |
[production] |
| 23:11 |
<ebernhardson> |
restart elasticsearch on elastic1031 to apply numa settings |
[production] |
| 22:56 |
<XioNoX> |
disabling flapping VCP on asw1-eqsin - T192125 |
[production] |
| 22:50 |
<zhuyifei1999_> |
Does quarry only have an effective concurrency limit of 3, despite having a few dozen celery worker processes?! |
[quarry] |
| 22:46 |
<zhuyifei1999_> |
behaving abnormally. https://quarry.wmflabs.org/query/26629 has been queued for 16 mins... (hopefully) have some time to investigate |
[quarry] |
| 22:37 |
<mutante> |
phab1001 - deleting duplicate cronjob for public_taskdump.py (the one that did not output to /dev/null) (T188149) |
[production] |
| 22:21 |
<ebernhardson> |
restart elasticsearch on elastic1030 to apply numa settings |
[production] |
| 22:12 |
<ebernhardson> |
restart elasticsearch on elastic1029 to apply numa settings |
[production] |
| 21:49 |
<ebernhardson> |
restart elasticsearch on elastic1028 to apply numa settings |
[production] |
| 21:40 |
<ejegg> |
updated fundraising python tools from 7c5c7a5f9e to f3ed1d05b8 |
[production] |
| 21:39 |
<ejegg> |
updated SmashPig from 1ebee97a45 to a4de12d415 |
[production] |
| 21:36 |
<ebernhardson> |
restart elasticsearch on elastic1024 to apply numa settings |
[production] |
| 21:25 |
<ebernhardson> |
restart elasticsearch on elastic1025 to apply numa settings |
[production] |
| 21:20 |
<thcipriani> |
cleaned up 1.5G of space on deployment-tin:/tmp hopefully fixes beta-scap-eqiad |
[releng] |
| 20:53 |
<XioNoX> |
redirect text-lb.eqiad pings to ping1001 on cr1/2-eqiad (24h tests) - T190090 |
[production] |
| 20:47 |
<ppchelko@tin> |
Finished deploy [restbase/deploy@228caf8]: Log the lack of the index entries, take 2 (duration: 03m 55s) |
[production] |
| 20:43 |
<ppchelko@tin> |
Started deploy [restbase/deploy@228caf8]: Log the lack of the index entries, take 2 |
[production] |
| 20:43 |
<ppchelko@tin> |
Finished deploy [restbase/deploy@228caf8]: Log the lack of the index entries (duration: 14m 19s) |
[production] |
| 20:41 |
<milimetric> |
deployed a version of wikistats with all but reading metrics disabled to stop showing bad data |
[analytics] |
| 20:40 |
<thcipriani@tin> |
rebuilt and synchronized wikiversions files: All wikis to 1.31.0-wmf.30 |
[production] |
| 20:32 |
<mholloway-shell@tin> |
Finished deploy [mobileapps/deploy@5650605]: Update mobileapps to b011b2a (duration: 05m 56s) |
[production] |
| 20:29 |
<mdholloway> |
deployed to BC: [mobileapps/deploy@5650605]: Update mobileapps to b011b2a |
[releng] |
| 20:29 |
<ppchelko@tin> |
Started deploy [restbase/deploy@228caf8]: Log the lack of the index entries |
[production] |
| 20:26 |
<mholloway-shell@tin> |
Started deploy [mobileapps/deploy@5650605]: Update mobileapps to b011b2a |
[production] |
| 20:14 |
<Dereckson> |
Purged all languages messages from the cache, for gorwiki (rebuildmessages.php, T189127) |
[production] |
| 19:49 |
<vgutierrez> |
Repool (Re-enable BGP) in lvs5001 - T191897 |
[production] |
| 19:34 |
<elukey> |
deploy https://gerrit.wikimedia.org/r/428331 for Pivot |
[analytics] |
| 19:34 |
<elukey@tin> |
Finished deploy [analytics/pivot/deploy@cb9ddee]: Fix 0.10.0 compatibility - T164008 (duration: 00m 17s) |
[production] |
| 19:34 |
<elukey@tin> |
Started deploy [analytics/pivot/deploy@cb9ddee]: Fix 0.10.0 compatibility - T164008 |
[production] |