You should get the paint removed regardless. Sounds like it may be log siding. If you don’t have the means or funding to remove it then I would recommend applying a couple of coats of Sherwin Williams Woodscape solid over it. They have a rainbow of colors that should fit your needs.