Keep track of medical expenses. William Cheeks, president, ABBA Associates Inc., says that he has a perfect credit score of 850 because he worked at a credit monitoring agency for decades and he knows the system. Cheeks says erroneous medical bills can decrease your credit score. “Over 50 percent of collection items are health-care related,” Cheeks says. “Get to the doctor, get to whomever (is in charge of billing) and make sure that you address it. If the unpaid bill is an error or an insurance omission, it can be removed.”