The Jaguars cut Ivory last week.
Ivory, who turns 30 next month, rushed for 382 yards and a touchdown on 112 carries. He has rushed for 4,852 yards in eight NFL seasons.
The Browns could lose running back Isaiah Crowell in free agency.
Ivory could have more visits before he decides where he wants to spent next season.