Tootfinder

Well that was a #MastoAdmin problem if I ever saw one.
I just found some update involving libjemalloc and glibc somehow managed to break the Ruby installation my Mastodon instance uses so badly, Puma stopped working and then Bundler kept failing because of old gems that wouldn't work with the new glibc.

#FediBlock That_Damn_Frank@beige.party: redirecting conversations in weird political directions without consent OR CWs, and then complaining, shifting blame, and calling people fascists when politely asked to stop
#MastoAdmin

#FediBlock That_Damn_Frank@beige.party: redirecting conversations in weird political directions without consent OR CWs, and then complaining, shifting blame, and calling people fascists when politely asked to stop
#MastoAdmin

phpc.social is now running Mastodon 4.6.4, released a couple hours ago.
#MastoAdmin

RE: #mastoAdmin

#mastoadmin

soc.saiyajin.space is now running mastodon 4.6.4 which was released 1 hour ago to fix several security issues #MastoAdmin

Guys I think I really did fix it this time! #selfhost #mastoadmin
It has been solid and responsive on #newOldiMac since switching colima from Apple's vz system to qemu.

Na... wer von Euch hat erst die DB Migration beim #Mastodon update vergessen? #MastoAdmin

#FediBlock @…
every single comment of theirs I have seen has been negative. i cannot find a single post they have upvoted. that cannot be a healthy way to live one’s life
#MastoAdmin

Es scheint als wären durch das Update auf Mastodon 4.6.0 meine Favoriten verlorengegangen. Nicht schlimm, aber fällt mir grad auf. Die Lesezeichen sind immerhin noch da.
#mastoadmin

Made it to 4.6.0.beta.1 and nothing seems destroyed. #mastoadmin

If your first follow is Holos Discover I think you MIGHT be a bot. I wonder what they are doing?
#mastoAdmin

Milo @milo@ostkind.social betreibt neben dem Bluesky-Account @staatsfeind.redflag.ps jetzt im Fediverse eine eigene Instanz: ostkind.social. Milo gehört auf Bluesky zu dem Trupp autoritärer Kommunist*innen und linker Antisemit*innen. ostkind.social hätte anscheinend gerne einen Sozialismus Š la DDR zurück. Einmal komplette Instanz blocken.
Freundschaft ✌️😃
#MastoAdmin #FediBlock https://ostkind.social/about

phpc.social is now running Mastodon 4.5.10, released ~10 minutes ago. #mastoAdmin

Weiterhin gibt es unsere #PeerTube Instanz
#mastoadmin game erstmal auf den neuesten Stand bringen. Also alle Tipps zu Konfiguration oder Wünsche gerne an mich direkt, per Mail, DM, ...

bam. Looks like #newOldiMac is back up this time using qemu instead of vz underneath colima. We'll see if this helps with stability!
#selfhost #mastoadmin

Earlier it was Tencent. Now it's Baidu (202.46.48.0/20) getting an iptables block from phpc.social because I like having decentralized social media reachable more than I like them scraping it for their LLMs or whatever (sorry Alibaba, had "Qwen" here a second ago, but I'll block y'all too if you try this crap).
#mastoadmin

I got this account that signs up over and over again with the display name:
KaJuan Marcell Horton
anyone else know what's up with that?
#mastoAdmin

Still up!
Have now split Colima into two contexts. One for the streams and one for docker. Not sure if that is the most efficient. But it’s working!
#newOldiMac #selfhost #mastoadmin

This page could be updated sometime.
#mastoadmin

colima seems to be dealing with the traffic a lot better now that it's using qemu. Might also be doing diskIO better as it's using a different driver for that as well.
The mastodon client seems more responsive.
The database is already using 6.4GB of 8GB! Usually it barely got over 2.5GB before crashing.
I am forever optimistic for what I find in the morning! : )
Goodnight sweet mastonauts!
#newOldiMac #selfhost #mastoadmin

Not sure what is going on at OVH but they sent me four identical invoices for my Mastodon object storage priced at $4.22 except for the invoice reference, billed them all as $16.88, then refunded $4.22 three separate times.
#OVH #OVHCloud #MastoAdmin

Tencent (43.173.128.0/18) decided to scrape phpc.social, badly, slowing things down for everyone else.
That IP range has now been blocked. Sorry for everyone having to endure slow performance of late.
#MastoAdmin

welp.
#footiMac remains in a state. If you are reading this, that is a small victory :)
I tried a few things but it remains burdened by I/O activity.
it was still overwhelmed even when I shut down mastodon and nginx so I think it is either the constant sftp traffic or something related to the update to Trixie that I am as yet unaware of.
Regardless, I am taking the opportunity to create docker containers on another machine for postgres and redis to live on.
I'm now waiting for a database dump to complete so that I can try migrating those services over and leaving footiMac to only do nginx and sidekiq
Probably work on it some more tomorrow. Until then this account will be up and down. But at least I'm learning and that's what I like to do.
#mastoadmin

phpc.social is now running on Mastodon 4.5.11, released ~4.5 hours ago.
#mastoAdmin

phpc.social is now running Mastodon 4.6.3, released ~3.5 hours ago.
#MastoAdmin

still 🆙
#selfhost #mastoadmin #colima #docker

🔴#2MR live
17.30 – 18.00 next up: #democracy-strenghening #SocialMedia Technologies for Tomorrow
Livestream:
👉 #3QVideo
· host: @… #science communicator at @…
Program:
👉 #SocialMedia #Fediverse #Mastodon #FediAdmin #MastoAdmin #Tech #CivicTech #fedidev

dare I say the #footiMac #newOldiMac combo are currently delivering snappy mastodon performance.
#mastoAdmin #selfhost

ok. credit where credit is due.
Mastodon is pretty good at coming back after being restored from backup... again... and... again... lol…
I lost a few posts from the past 24 hours but, learning. Right?
Off to re-apply the v4.6 update and then do ANOTHER backup so I at least don't have to do that again next time.
#mastodon #mastoadmin

ok, really for sure this time.
i think it's going to be stable.
I think.
#mastoAdmin #selfhost #newOldimac #colima #docker

Edit: question answered successfully! Ty!
OK folks, I need some #docker advice for those gurus out there. A boost would be appreciated to get it in front of knowledgeable eyes.
I have a container running postgresql for mastodon. I would like to tweak the conf file for postgresql now that I have things going.
What is the safest way to do this on a running container?
Can I stop the instance with docker stop and then restart it and it will simply see the new postgresql.conf specified in the original docker run command?
I'm getting more comfortable with docker.. but not *that* comfortable, so I'm still worried that if I restart it'll break somehow lol.
I want to make sure I do this right so I don't wreck what appears to be a running and reasonably happy container :)
I'm running docker in a colima virtual machine on macOS.
#mastoAdmin #docker #colima #postgresql

making a script to backup the postgresql and redis docker containers... so I can have this run everyday to ensure I don't lose anything if/when docker collapses.
I also noticed that the docker containers all use UTC time, which is annoying, and who knows maybe that has something to do with the instability? so i synced it to America/Vancouver
Also... I know "America" is the continent, not the country in this context. But there is more than one Vancouver on the American continent. Canada/Vancouver would be better, no?
#random #selfhost #mastoadmin #docker #colima

this is the longest that my #selfhost instance has been online in 5 days lol. Starting to feel confident. Probably jinxing it…
#mastoadmin #colima #macos #docker #jinx

ok. docker backup script is solid.
it will:
1) mastodon db dumped in container and copied outside
2) redis file saved in and outside
3) both containers snapshotted and saved outside.
#selfhost #mastoadmin #colima #macos #docker #jinx

#mastoadmin question. Seeing this in my admin console:
"No Sidekiq process running for the fasp queue(s). Please review your Sidekiq configuration”

success.
docker restart does not jeopardize anything as long as a volume is specified at runtime to preserve the data.
successfully restarted with new conf file and we're now green across the board and hopefully tuned for the slightly larger resources available from #newOldiMac
#docker #mastoAdmin #docker #colima #postgresql #selfhost

I think it is funny, ironic, nerdy, and meta (the proper literal sense) that I have maxed out the 2017 iMac by wanting to install btop while watching it be maxed out on htop.
And yet... it's still posting this, so if stuff doesn't break down now, surely it never will? Even the swap is having a moment. Ooof. I need to be nicer to my machines. lol
#newOldimac #selfhost #mastoAdmin #footiMac #docker #colima #homebrew

just tweaked/upped web concurrrency and max threads settings in my .env.production settings for Mastodon to give #footiMac a few more processes to handle requests and things are humming along nicely.
I think a big takeway for me on this #selfhost journey is that except on the very smallest one person and minimal followers instance, the database (and possibly redis) function should always be on a different machine or container from mastodon.
#footiMac was clearly having real trouble handling the database activity once it got busy. Even with an SSD now with two bad blocks (which may have been caused by that over-activity), it is way more stable.
#newOldiMac #docker #mastoAdmin #colima #iMac

It's a day later and #footiMac and #newOldiMac are still up and running. Disk usage is stable. Current RAM usage for the database has gone up to 3GB from 1GB since 9PM last night. I'd like to know why. It's not any busier.
I'm running the backup script then later today I'll see if I can investigate more on why the RAM usage fluctuates so much.
I would like to know why it is more stable. Is it because I've simply given it enough room to expand and contract in the colima VM?
Is it because I set the clocks to the same timezone?
Inquiring minds... but I am happy that it is happy. And I have learned a lot and gotten more comfortable with docker. Which has been a goal almost since I joined Mastodon in Nov 2022.
I’m hoping to look for a new macMini now to replace #newOldiMac. If I can get that an SSD to replace the failing SSD in #footiMac and a large HDD for backup that'd be great.
#docker #mastoAdmin #colima #iMac

ok. *this time* i think my #selfhost is going to be stable or at least self-recoverable. Both #footiMac and #newOldiMac are now set to periodically restart to catch any times when the become unresponsive or colima dies.
#mastoadmin