1101-1150 of 10000 results (73ms)
2019-12-31 §
08:25 <marostegui> Upgrade db2128 [production]
08:24 <marostegui> Upgrade db1107 from 10.4.10 to 10.4.11 [production]
07:46 <marostegui> Upgrade db2126 db2125 db2108 db2107 [production]
07:11 <marostegui> Restart wikibugs - T241109 [production]
03:20 <legoktm> running `/usr/bin/python3 /srv/extdist/nightly.py --all` in screen on extdist-04 to rebuild tarballs for T241542 [extdist]
2019-12-30 §
18:35 <Cam11598> 10:34:57 AM 88B2DC← 25B100+ 88B2DCCVNBot12 left (~CVNBot12@cvn/bot/cvn-bots2): "Rebooting by order of Cam11598 ..." [cvn]
16:08 <Jaypraka_> Hot fix to load commons file from local URL [tools.bookreader]
16:00 <ema> cp1083: restart ats-tls and varnish-fe after crashes - T241593 [production]
13:48 <joal> rerun webrequest-load-wf-text-2019-12-30-8 with updated error-thresholds [analytics]
11:45 <arturo> importing more packages into stretch-wikimedia/thirdparty/openstack-pike-stretch (T241347) [production]
05:02 <andrewbogott> moving tools-worker-1012 to cloudvirt1024 for T241523 [tools]
04:49 <andrewbogott> draining and rebooting tools-worker-1031, its drive is full [tools]
2019-12-29 §
22:29 <gehel> repooling wdqs1007 [production]
21:25 <Cam11598> CVNbot12 restarted [cvn]
20:34 <hauskatze> github: Mirror deleted: "wikimedia/analytics-limn-edit-data" (T228982) [releng]
20:19 <hauskatze> github: Mirror deleted: "wikimedia/analytics-limn-flow-data" (T228981) [releng]
20:18 <hauskatze> github: Mirror deleted: "wikimedia/analytics-limn-flow-data" (T229981) [releng]
17:58 <sbassett@deploy1001> Synchronized php-1.35.0-wmf.11/extensions/EventBus/includes/EventFactory.php: Security fix for T241410 (duration: 00m 56s) [production]
11:13 <ema> restarted wikibugs to fix phab irc notifications [production]
10:57 <ema> repool cp3061 T238305 [production]
10:07 <elukey> powercycle cp3061 - mgmt serial console not showing a working tty, no ssh [production]
10:06 <elukey@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp3061.esams.wmnet [production]
05:22 <bd808> Migrated to py37 after figuring out that errors were unrelated to python version change [tools.fourohfour]
04:37 <bd808> Creating custom ingress to try to fix T241525 [tools.fourohfour]
04:10 <bd808> Stop/Start for debugging T241525 [tools.bash]
04:01 <bd808> Stop/Start for debugging T241525 [tools.stashbot]
03:42 <bd808> Stop/Start cycle of webservice to see if it changes the active nginx ingress rules (T241525) [tools.replag]
03:41 <Cam11598> 7:40:35 PM <ChanServ> Flags +AV were set on RileyHuntley in #cvn-unifications. [cvn]
02:18 <bd808> Weird behavior exists with py3.5 as well. Will open task and investigate further. [tools.fourohfour]
02:11 <bd808> Getting weird results from py3.7 deployment. Reverting to py3.5 [tools.fourohfour]
02:06 <bd808> Migrating from Python 3.5 to Python 3.7 [tools.fourohfour]
01:38 <Krenair> Cordoned tools-worker-1012 and deleted pods associated with dplbot and dewikigreetbot as well as my own testing one, host seems to be under heavy load - T241523 [tools]
2019-12-28 §
23:55 <legoktm> deleting extdist-01 instance (T236532) [extdist]
23:52 <legoktm> point extdist.wmflabs.org at extdist-04 (stretch based) [extdist]
23:49 <legoktm> deleting upgrader-04 instance (T236559) [library-upgrader]
22:54 <ebernhardson@deploy1001> Synchronized wmf-config/InitialiseSettings.php: cirrus: re-sync move more_like traffic to codfw (duration: 00m 54s) [production]
21:54 <ebernhardson@deploy1001> Synchronized wmf-config/InitialiseSettings.php: cirrus: Move more_like traffic to codfw (duration: 00m 55s) [production]
21:35 <ebernhardson@deploy1001> Synchronized wmf-config/CirrusSearch-common.php: Reduce query load on cirrus elastic clusters (duration: 00m 55s) [production]
21:13 <ebernhardson@deploy1001> Synchronized wmf-config/CirrusSearch-common.php: Reduce query load on cirrus elastic clusters (duration: 00m 58s) [production]
14:58 <hauskatze> maurelio@deployment-deploy01:~$ mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=deploymentwiki --logwiki=deploymentwiki 'HoseaSeverson6' 'Random spammer username' | T241294 [releng]
14:23 <Urbanecm> urbanecm@deployment-deploy01:~$ mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=arwiki --logwiki=deploymentwiki 'Riley Huntley' '~riley' (T241294) [releng]
14:20 <Urbanecm> urbanecm@deployment-deploy01:~$ mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=enwiki --logwiki=deploymentwiki 'DannyS712 tes' 'DannyS712 test' (T241294) [releng]
13:13 <hauskatze> maurelio@deployment-deploy01:~$ foreachwiki maintenance/emptyUserGroup.php petitiondata # T241504 [releng]
2019-12-27 §
22:17 <Jayprakash12345> Deploying T241489 T241491 [tools.bookreader]
19:51 <gehel> restarted blazegraph on wdqs1007 [production]
19:45 <gehel> depool wdqs1007 - checking what is wrong with updater [production]
19:26 <gehel> restarting elasticsearch on elastic1038 - high load [production]
19:23 <gehel> restarting elasticsearch on elastic1036 - high load [production]
15:35 <jynus> upgrade and restart dbprov1002 [production]
15:06 <Krenair> Killed a "python parse_page.py outreachy" process by aikochou that was hogging IO on tools-sgebastion-07 [tools]