Weeks-long service degradation affecting many customers in SF Bay area
So I'd been using U-Verse fiber for about a year now with no real complaints (apart from the price relative to e.g. PAXIO, but good luck getting that in an apartment complex south of Emeryville)...but in mid/late November I noticed that some sites were starting to have difficulty loading, especially over TLS. The issue was intermittent so I didn't take much note at first, but as it dragged on and got worse I started looking into it.
According to some server logs I have on a remote VPS I sync with, the issue started on Nov 15 when TLS connections would somewhat frequently have issues establishing the connection. As I dug deeper, I discovered that there was packet corruption between my home and my VPS, with symptoms such as a single bit in the DH key exchange getting flipped, invalidating the whole handshake. As I poked at the issue more and more it became apparently that the issue only occurred on certain routes, meaning that it wasn't just affecting me, but would also affect anyone hitting that route. I dug deeper and discovered that everyone I knew who also had AT&T Fiber in the area has been having this same issue. I called AT&T and reported that some sites, like Twitter's CDN (pbs.twimg.com) and Wikipedia (dyna.wikimedia.org) were having this issue too. They sent out a tech who...did nothing. Showed up, determined the issue wasn't coming from inside my apartment, and left without even informing me they'd shown up. So I hoped it would get better soon.
Anyway that was a week ago and I've been being tossed around from people on the phone who sympathize but can't do much to techs and supervisors who run tests within AT&T's network and say it's fine so the problem must be on my end, without even listening to me saying the problem is when traffic LEAVES or ENTERS their network (AS7018) to other networks (e.g. AS2914 is particularly impacted, but it doesn't seem to be the only one). They keep saying things about speed tests, which are irrelevant, and that they can connect to me fine, which is also irrelevant. They won't listen no matter who I try to talk to, and I'm running out of people I can contact.
One tech insisted on replacing my RG with an identical one (but it was brand new!!!) and of course this did nothing other than give me an hour of completely broken service until it got back up to the same heavily-broken state it was in before. This specific tech was especially bad, refused to even listen to anything I said and was very concerned about my Wi-Fi coverage (I usually use Ethernet), and that having another port used on my switch would "drain" my bandwidth (which doesn't even mean anything). He didn't seem to even comprehend the issues I was having at all, making things substantially worse for an hour or so in the process by screwing around with my network. I've never been so glad for a tech to leave without having even fixed anything, and he had the audacity to ask for a good review even after failing to establish basic communication with me. Sorry Raul V, you're not getting a good review.
I've posted about it on Twitter a few times and other people have chimed in and said the issue is affecting them too. In fact, more are more people are finding my posts and replying that they have the same issues. I keep telling them to also contact AT&T but most of them either don't or put in least effort contact and give up after having trouble reaching anyone who's even affiliated with U-Verse tech support. It's been a slow trickle since I don't have much visibility, but I have had at least a dozen other people reach out and corroborated that they're experiencing the same issue. How can I actually get AT&T to listen so their now 3 weeks of severely impacted service for what appears to be everyone in the SF Bay Area on their service will stop having this issue?
I'm familiar with people having this sort of next-level nightmare dealing with Comcast tech support, but I switched to AT&T in part so I wouldn't have to deal with that, and yet this ongoing debacle far exceeds any problem I ever had when I've used Comcast. I'm sorely tempted to switch back even though my speeds would be worse (upstream matters too!), my and my bill would be higher if I paid to remove the data cap (that I would exceed regularly just by doing backups). AT&T just doesn't seem to even care to acknowledge there's an issue here, much less actually look into it. How is this acceptable service? It's impacted my ability to do my job from home, my ability to stream using sites like Hulu, my ability to do video chats during lockdown, and a lot more, and I've been banging my head against it for three weeks while AT&T refuses to lift a finger unless it's to audaciously point the blame back at me, the person who is paying them to provide a service that I assumed they would care to keep at least somewhat maintained, and had had no issues for a year until something randomly broke for a bunch of people at once. They can't even seem to figure out there is a genuine partial service degradation somewhere in the area. I am sorely disappointed by the lack of professionalism in how this has been handled.