Late to the party, but thought for the images that it would be good (though less sexy) to do direct feature engineering with the image data. You could pull out various image features such as brightness, contrast, primary colour and leverage object detection to see what is in the photo, e.g. chair, person, face, building. These could be useful features to input to the xgboost model.