I kinda like this guy BUT he is short!!!?

So ive been on a few dates with my coworker and basically i think he is ok. BUT he is freaking short!! ugh! I want my men to be tall and have a lean body and he is the opposite he is short and a bit chubby and has a square boxy shape to him that is a turn off!~ I dont know what to do? he is about 2-3 inches shorter than me and i am 5'6- 5'7 I am seriously thinking of telling him that I want to be just friends!? I already told him that I still have strong feelings for my ex. and he was ok with that. But I dont know if I want to pursue this further. Because not only is he short. He has bad BO and he lives in a tinie tiny apartment basically in a shack. He invited me over and the place was a mess!!! Dirty dishes, messy bed, no where to sit, no basic cable, no stove. I told him he lives like a caveman! and to top it all off he has NO friends!! and hasnt had a girlfriend in 4 years. He told me he is from Missouri and when he got here 4 years ago with his ex she dumped him within a month and took all his money. And he hasnt made any friends because he doesnt trust anyone cause all his former friends backstabbed him. Ugh I just dont know what to do? Should I end it? Should I just remain his friend and hangout every now and then? someone give me your best advice! thanks!