You can control which calendars affect your availability in Settings > Calendars Affecting Availability.
If you’re sharing calendars with co-workers or family members, you may want to disable the shared calendars so that the events on those shared calendars don’t block your free time.
By default, all read-only calendars are disabled but you can enable them if you want.