Game crashes when trying to join server.

[RainHub23]

I have a Bisect Hosting Server that me and my friend play on, but every time I try to join the server, it will first throw me an error saying: Internal Exception: io.nettyhandler.codec.DecoderException: java.langIllegalStateException:
Attempted to load a modifier before dynamic modifiers are loaded. Trying to join the server a second time, will sometimes bring me into the server for a very brief moment, afterwards it will lock up and then stop responding, sending me back to the launcher with the error code -805306369 and telling me to allocate more ram. I have tried Updating my drivers, allocating more RAM and checking my JVM arguments, repairing the installation, updating Lithium, and Checking for PUP's and adware, nothing ended up working. I know my server is not the problem because my friend can join fine, I've had this issue for days and it is genuinely frustrating me. Only way I can get it to work is by deleting and then reinstalling the modpack, and SOMETIMES it will let me in.