A source close to the 38-year-old rapper tells ET that Kanye did in fact threaten to walk off the program when he found out that part of his set had been taken down before showtime.
"This is the seventh time Kanye West has appeared on SNL, they know he is very particular," the source says. "The SNL lighting director/designer, on his own, decided to dismantle half of Kanye's set because he didn't like it. The set was dismantled in a way it couldn't be put back together on time. Kanye found out 30 minutes before showtime that this had happened."
"Kanye was very upset about the situation, and did threaten to walk off the show," the source continues.
Kanye's original set included a single LED screen with mirrored siding attached to it, and according to the source, SNL show producers were very "apologetic" about the situation.
The source also denies SNL cast member Aidy Bryant's recent claim that the rapper tried to pull up his wife, Kim Kardashian, on stage during the dress rehearsal, despite her unwillingness.
"At dress rehearsal, he brought Kim up on stage for goodnights, and she was, kind of, like, nervous, like, 'Why am I here? This is not my show, I shouldn't be up here,'" Bryant told Watch What Happens Live host Andy Cohen. "And then she went and stood down weirdly in front of the audience. ... She was up there in her floor-length fur coat."
But the source says Kardashian was absolutely not at the dress rehearsal.
Kanye has been on the receiving end of plenty of negative press recently, thanks to bizarre twitter rants and Taylor Swift slamming him during her GRAMMY acceptance speech for Album of the Year. Taylor's call-out was in response to Kanye's controversial track, "Famous," off his new album, The Life of Pablo, in which he takes credit for the "Out of the Woods" singer's success, rapping, "I feel like me and Taylor might still have sex. I made that b**ch famous."
On Wednesday, Kanye seemed to acknowledge all of the recent criticism, tweeting, "My number one enemy has been my ego... there is only one throne and that's God's ..."
However, he deleted the tweet shortly after.
Interestingly enough, he has stayed silent on Taylor's big diss.
More on AOL Entertainment:
George Gaynes, 'Police Academy' and 'Punky Brewster' actor, dies at 98
Sia and her weird giant bow wig join James Corden for 'Carpool Karaoke' (Video)
Woman taking a stealth photo of Taylor Swift at Grammys goes viral