Would a bird field guide to Thailand pretty much cover the Malaysian peninsula as well or is it worth getting a guide specifically for the Malaysian peninsula?
The Robson fieldguide to Southeast Asia is what you want. It covers the entire area but is light enough to carry easily. You will be somewhat lacking trying to use a Thailand guide for Malaysian birds - there is quite a bit of overlap, but a lot of species do not occur far enough up the peninsula to be included in a Thailand guide. https://www.amazon.com/Field-Guide-Birds-South-East-Asia/dp/1472916697