I want to hide the + button at the bottom right

Yes, you can.
From the settings screen, tap "Calendar Settings" and turn off "Show Add Event Button".