Hi,
the ad force is a low number but that does not mater,
it is how much you object is moving per frame that might cause not seeing a collider.
What kind of colliders are you using on the character and on the floors?
(box,sphere,edge...)
Maybe you can use a "raycast" upwards before jumping and when there is an obstacle don't do the add force?