This may be caused by choosing the wrong printer.
(When you select "Print" inside the report, a window will appear to select a printer.)
Check which printer you selected and that it supports A4 printing.
Additionally, you may want to check what is selected as the default printer under Control Panel - Printers in Windows. Make sure that there's actually a printer in there and nothing else like the "Microsoft Print to PDF" option.