You can configure the PDF Catalog product image sizes in WordPress Settings > Media:
You can define different image sizes for the Grid and List.
The default settings (the settings visible on the screenshot) are recommended to fit everything nicely into the PDF page. However, you are free to adjust it to your needs.
After each image size change, you must regenerate the thumbnails to apply the changes to existing images.