Thanks for the suggestion, mdot!
I came up with a solution that suits my needs, and thought I'd share it here in case someone else is doing something similar:
Instead of a raycast, I created a really skinny, long box collider that extends 40 units out. Instead of tracking a ray cast hit, I'm using trigger enter/exit. Works perfectly for my purposes here.