While Lori was just two pounds shy of 300 pounds, Ed was shaken when his scale tipped above 300.
"Getting up the stairs in my house was difficult. I'm a food addict. I look at myself the same way as an alocholic," Lori explains.
She admits that when she cooked, it was fatty, creamy, highly processed foods. She admits, "I thought I was being healthy by serving salad, but we would drown it in ranch dressing."
Ed was the first to make a lifestyle change -- and then Lori got on board.
"It took me about two years to lose 150 pounds, and I've kept the weight off for about two and a half years," Lori says.
It wasn't long until Ed and Lori's teenage son Kyle decided he wanted in, too:
"...It was much easier knowing they had the same goal as I did ...Seeing the great success they were having, I only wanted to join in and share it."
Nowadays, Lori cooks a lot of fresh vegetables and whole foods, Ed brings packed lunches to work and Kyle is a bodybuilder.
Losing 380 pounds as a family even caught the attention of Dr. Oz, who told them, "I get my inspiration from you."
Not to mention that the Olson family even had to reintroduce themselves to family members who no longer recognized them.
Related: See the weight loss transformations of some notable celebrities:
Most notable celebrity weight loss transformations
Family works together to lose 380 total pounds
John Goodman - 1991
Cheerful John Goodman in a scene from the film 'Barton Fink', 1991. (Photo by 20th Century-Fox/Getty Images)
John Goodman - 2015
John Goodman attends the 'Trumbo' Accenture Gala during the BFI London Film Festival at Odeon Leicester Square on October 8, 2015 in London, England. (Photo by Mark Cuthbert/UK Press via Getty Images)
Khloe Kardashian - 2007
Khloe Kardashian at the 'Keeping Up With The Kardashians' premiere party on October 9, 2007 in West Hollywood, California. (Photo by Jeff Vespa/WireImage)
Khloe Kardashian - 2015
Khloe Kardashian appears At ULTA Beauty's West Hills Store To Promote Kardashian Beauty Hair Care And Styling Line at ULTA Beauty on April 2, 2015 in West Hills, California. (Photo by Frazer Harrison/Getty Images)
Jennifer Hudson - 2010
Jennifer Hudson during 'A Fine Romance' Gala Benefiting the Motion Picture and Television Fund - Arrivals at Sunset Gower Studios in Hollywood, California, United States. (Photo by Jon Kopaloff/FilmMagic)
Jennifer Hudson - 2015
SingerJennifer Hudson attends the Marchesa fashion show during Spring 2016 New York Fashion Week at St. Regis Hotel on September 16, 2015 in New York City. (Photo by Gary Gershoff/WireImage)
Jonah Hill - 2006
Jonah Hill during Universal Pictures Presents the World Premiere of 'Miami Vice' at Mann Village Theater in Westwood, California, United States. (Photo by E. Charbonneau/WireImage)
Jonah Hill - 2012
Actor Jonah Hill attends the premiere of 'The Watch' at Grauman's Chinese Theatre on July 23, 2012 in Hollywood, California. (Photo by Jason LaVeris/FilmMagic)
Kelly Osbourne - 2002
Kelly Osbourne, daughter of rocker Ozzy Osbourne at St Martin's Lane Hotel, London, August 21, 2002. Kelly, along with brother Jack, mother Sharon and father Ozzy, are the stars of their own reality television show, 'The Osbournes'. (Photo by Gareth Davies/Getty Images)
Kelly Osbourne - 2015
Special guest Kelly Osbourne celebrates the opening of the new Cost Plus World Market Chelsea, New York store on August 18, 2015 in New York City. (Photo by Jamie McCarthy/Getty Images for World Market)
Chaz Bono - 2010
Chaz Bono arrives at the 21st Annual GLAAD Media Awards held at Hyatt Regency Century Plaza on April 17, 2010 in Century City, California. (Photo by Angela Weiss/Getty Images)
Chaz Bono - 2015
Chaz Bono visit 'Extra' at Universal Studios Hollywood on July 28, 2015 in Universal City, California. (Photo by Noel Vasquez/Getty Images)