Teddy Bear Bowers was born last month with rare heart condition Atrioventricular Septal Defect (AVSD).
His parents Xena Maud and Michael Bowers, originally from Childwall, Liverpool, were given the option to terminate their pregnancy when scans showed the defect at 20 weeks.
But, as Liverpool Echo reports, the couple were determined to give Teddy a fighting chance.
However, the tot passed away at eight days old in Michael's arms as he sang Liverpool's famous song.
The big Liverpool FC fan told of his heartbreak today.
He and charity Forget Me Not hospice painted memory rocks with Teddy's birthday on, and hid them around the city.
They've asked people to then relocate them around the country.
Michael said: "It was never an option for us to terminate and we were always in the mind that we would give him a chance in life.
"We wanted to meet our son and it was going to be on Teddy's terms when he wanted to go."
Teddy was born on August 2 and his parents hoped surgery would be the best option for him.
But two days later they were devastated to learn the holes in the chamber of his heart were inoperable.
Michael and Xena, who now live in Bradford, West Yorkshire, explained during the Liverpool's first match of the season on August 9 against Norwich City, it was like little Teddy was watching.
"We were watching the match in the hospice with all our family, which was invaded by Scousers and it was like Teddy was watching.
"When Liverpool scored the second goal he put his hand up as if he was celebrating and he knew," Michael continued.
Forget Me Not, based in Huddersfield, West Yorkshire, offered the family a place days after Teddy was born.
Michael said: "When we heard about the hospice we were devastated because in your mind you think it is a place where you go to die.
"But it's a place where Teddy lived and was Teddy's true home."