Freeman, who ran for a touchdown early in the game, scrambled for a huge first down on the winning drive as the Buccaneers (3-1) won their third consecutive game.
The Colts fell to 0-4 for the first time since 1998, Peyton Manning's rookie season. Manning has watched all four games, unable to play because of a neck injury.
Curtis Painter started this one, filling in for injured backup Kerry Collins and played better than most expected. Painter threw for 281 yards and two touchdowns, both long ones to Pierre Garcon. He wasn't nearly as effective down the stretch.
Indianapolis defensive tackle Eric Foster was carted off the field after injuring his right leg late in the second quarter.
The injury occurred with 52 seconds remaining in the half and the Colts leading 10-7. Foster got tangled up with the pile while trying to assist on a tackle and remained down after the play. He was immediately attended to by the training staff and fitted with an air cast.
He could be seen waving briefly to the crowd as the cart drove into the tunnel.
Foster, out of Rutgers, is in his fourth season and entered the game with 12 tackles.