Great work, team. Happy Halloween! 👻

This is honestly hilarious 🤣

Ruud is the MVP of the Fediverse 🥳

I appreciate the concern, but we are doing this because we enjoy doing it and our skill sets allow us to contribute. These are exciting times, even with the issues we are working through :) No worries.

FYI, this is due to a confluence of issues.

• We are the largest instance with the highest active user count - and by a good margin.
• We are dealing with a premature software base that was not designed to handle this load. For example, the way the ActivityPub Federation queues are handled are not conducive to high volume requests. Failed messages stay in queue for 60 seconds before they retry once, and if that attempt fails it sits in queue for one hour before attempting to retry. These queued messages sit in memory the whole time. It’s not great, and there isn’t much we can currently do to change this, other than to manually defederate from ‘dead’ servers in order to drop the number of items stuck in queue that are never going to get a response. Not an elegant solution by any means, and one we will go back and address when future tools are in place, but we have seen significant improvement because of this.
• We have attempted contacting Lemmy devs for some insight/assistance with this, but have not heard back yet, at this time. Much of this is in their hands.
• We were able to confirm receipt of our federation messages (from lemmy.world) to other instance admins instances at lemm.ee and discuss.as200950.com. As such we do know that federation is working at least to some degree, but it is obviously still in need of some work. As mentioned above, we have reached out to the Lemmy devs, who are instance owners of Lemmy.ml, to collaborate. I cannot confirm if they are getting our federation at this time. Hopefully in coming Lemmy releases this becomes easier to analyze without needing direct server access to both instances servers.

As you can see, we are trying to juggle several different parameters here to try and provide the best experience we can, with the tools we have at our disposal. You may consider raising an issue on their GitHub about this to try to get more visibility to them from affected users.

Just to be clear, are you saying that when you go to your profile page, the sublemmys that you have ‘subscription pending’ for do not show up there??

The other thing to note with this bug, at least in my experience and what I have seen, even if it shows pending it will still show up in your ‘Subscribed’ feed. So while visually it is inaccurate, it seems to actually function properly. To be seen if the upgrade to 0.18.1 has any effect.

The Lemmyverse site is good. There is also https://browse.feddit.de which I have used to find a few smaller communities from instances that don’t show up on my own home instance (Lemmy.world). Then I can search the specific community name on lemmy.world which makes it visible for anyone else on my instance to find going forward from the main community search.

Thanks for posting this over here. I otherwise wouldn’t have known this was going on. As I used a mostly lurker account for game day threads I wasn’t going to bother with a data request. It’s a whole different story if we can inundate them though. Request submitted. o7

This.

Bravo to you. This was absolutely the right call and I hope you let it rot if there isn’t a massive change of direction. Frankly, for me, even if they do roll things back I am still done with them. P2P is how the internet should be (funny considering torrenting has been a thing for how long now?) and thankfully we have guys like you to step up and help get this off the ground. Thanks!