Now, it looks like we know why, or should we say who the abuse was coming from.
Enter: Lady Gaga fans. Earlier this year, Ed did an interview with Zoe Low from Beats 1 Radio, where he described the path he wants his career to take.
While doing so, he mentioned other celebs... without naming names, and what fans picked up from it was that he was shading Lady Gaga.
"I do not want to be the kind of artist who has had two successful albums and then feels invincible," Ed explained.
"I have to know when to listen to people, or I'll end up like those artists you've interviewed in recent years. You've seen them become the biggest artists in the world, and then suddenly they will say, 'I know everything!' And just after, they are no longer at the top.
"The smartest thing to do is listen to people who know I do not want to do the Super Bowl years later, after my biggest success, just to prove I'm still relevant."
Ed spoke to The Sun on the weekend, and explained that Gaga's fans came for him.
"Lady Gaga’s fanbase read an interview in which they assumed I was talking about her and they all f*ing hate," he said, adding: "And it wasn’t anything to do with that at all."
Now, the queen Gagz has come and defended Ed on Instagram, with the sweetest message.
"What an incredible talented artist I LOVE ED @teddysphotos deserves all our love and respect like all humans do. I wish all people on the internet would be positive and loving and apart of creating an online community that is kind and empowering, not hateful and mean. No reason to tear down an artist simply because they are on top. Work harder to be kinder everybody. That should be your first duty to humanity." she captioned the adorable selfie.
Once again, Lady Gaga has proven that she will always fight hate with love. Bless her.