Yes, you can. From the settings screen, tap "Calendar Settings" → "Event Label Format" → "Labels Only". Then, from the settings screen, tap "Calendar Settings" → "Manage Calendars".
Tap the calendar whose color you want to change, select "Black" (or "White") under "Text Color", and tap "Save".