1751-1800 of 10000 results (75ms)
2019-12-29 §
02:11 <bd808> Getting weird results from py3.7 deployment. Reverting to py3.5 [tools.fourohfour]
02:06 <bd808> Migrating from Python 3.5 to Python 3.7 [tools.fourohfour]
01:38 <Krenair> Cordoned tools-worker-1012 and deleted pods associated with dplbot and dewikigreetbot as well as my own testing one, host seems to be under heavy load - T241523 [tools]
2019-12-28 §
23:55 <legoktm> deleting extdist-01 instance (T236532) [extdist]
23:52 <legoktm> point extdist.wmflabs.org at extdist-04 (stretch based) [extdist]
23:49 <legoktm> deleting upgrader-04 instance (T236559) [library-upgrader]
22:54 <ebernhardson@deploy1001> Synchronized wmf-config/InitialiseSettings.php: cirrus: re-sync move more_like traffic to codfw (duration: 00m 54s) [production]
21:54 <ebernhardson@deploy1001> Synchronized wmf-config/InitialiseSettings.php: cirrus: Move more_like traffic to codfw (duration: 00m 55s) [production]
21:35 <ebernhardson@deploy1001> Synchronized wmf-config/CirrusSearch-common.php: Reduce query load on cirrus elastic clusters (duration: 00m 55s) [production]
21:13 <ebernhardson@deploy1001> Synchronized wmf-config/CirrusSearch-common.php: Reduce query load on cirrus elastic clusters (duration: 00m 58s) [production]
14:58 <hauskatze> maurelio@deployment-deploy01:~$ mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=deploymentwiki --logwiki=deploymentwiki 'HoseaSeverson6' 'Random spammer username' | T241294 [releng]
14:23 <Urbanecm> urbanecm@deployment-deploy01:~$ mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=arwiki --logwiki=deploymentwiki 'Riley Huntley' '~riley' (T241294) [releng]
14:20 <Urbanecm> urbanecm@deployment-deploy01:~$ mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=enwiki --logwiki=deploymentwiki 'DannyS712 tes' 'DannyS712 test' (T241294) [releng]
13:13 <hauskatze> maurelio@deployment-deploy01:~$ foreachwiki maintenance/emptyUserGroup.php petitiondata # T241504 [releng]
2019-12-27 §
22:17 <Jayprakash12345> Deploying T241489 T241491 [tools.bookreader]
19:51 <gehel> restarted blazegraph on wdqs1007 [production]
19:45 <gehel> depool wdqs1007 - checking what is wrong with updater [production]
19:26 <gehel> restarting elasticsearch on elastic1038 - high load [production]
19:23 <gehel> restarting elasticsearch on elastic1036 - high load [production]
15:35 <jynus> upgrade and restart dbprov1002 [production]
15:06 <Krenair> Killed a "python parse_page.py outreachy" process by aikochou that was hogging IO on tools-sgebastion-07 [tools]
15:02 <Krenair> Killed a "php test5.php" process that was hogging IO on tools-sgebastion-07 [tools.superyetkin]
12:23 <hauskatze> Rebooting deployment-cpjobqueue [releng]
12:23 <hauskatze> Rebooting deployment-cpjobqueue [deployment-prep]
12:16 <jynus> upgrade and restart dbprov1001 [production]
11:13 <andrewbogott> migrating deployment-aqs03 to cloudvirt1009 in response to T241313 [releng]
11:13 <andrewbogott> migrating deployment-aqs03 to cloudvirt1009 in response to T241313 [deployment-prep]
11:12 <andrewbogott> migrating osmit-test to cloudvirt1009 in response to T241313 [osmit]
11:07 <andrewbogott> migrating cyberbot-db-01 to cloudvirt1009 in response to T241313 [cyberbot]
11:05 <arturo> import openstack pike packages into thirdparty/openstack-pike-stretch in install1002 (T241347) [production]
10:55 <arturo> import gpg key 0x56056AB2FEE4EECB in install1002 for openstack packages (T241347) [production]
10:51 <jynus> upgrade and restart dbprov2002 [production]
09:30 <jynus> upgrade and restart dbprov2001 [production]
02:16 <Krenair> app was serving 500s, deleted pod and it's back [tools.extreg-wos]
2019-12-26 §
18:55 <Jayprakash12345> Checkout /lang/file_name endpoint (T240744) [tools.bookreader]
12:08 <Krenair> projectadmin on deployment-prep for MarcoAurelio see discussion at https://gerrit.wikimedia.org/r/560607 [releng]
2019-12-25 §
22:22 <Jayprakash12345> Setup cronjob for active_user stats (T241430) [tools.indic-wsstats]
22:21 <Jayprakash12345> Added /activeuser endpoint (T241430) [tools.indic-wsstats]
16:07 <zhuyifei1999_> pkilled 5 `python pwb.py` processes belonging to `tools.kaleem-bot` on tools-sgebastion-07 [tools]
10:13 <arturo> icinga downtime for 30 minutes the whole cloud* lab* fleet to merge https://gerrit.wikimedia.org/r/c/operations/puppet/+/560575 (will restart some openstack components) [admin]
10:12 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:12 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:12 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:11 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime [production]
2019-12-24 §
23:12 <Jayprakash12345> Added Hindi Wikisource (T241431) [tools.indic-wsstats]
15:49 <wm-bot> <lucaswerkmeister> deployed 68501a00a4 (be more forgiving on CSRF errors) [tools.speedpatrolling]
15:33 <gehel@cumin1001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
15:13 <arturo> icinga downtime all the lab* fleet for nova password change for 1h [admin]
15:13 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:13 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime [production]