VVVV is a powerful free software, it almost can do everything include connect arudion, capture color tempurature, wet ,hot, or tracking color, get outline,
i think that why we not just create some action can tranfer the data(color vector2 vector3 ,text or what),
so we can use vvvv's power to get data , and drive unity3d to create some amazing effect(unity3d is more better in 3d effect),
maybe udp? so we can open the vvvv and our unitypacked exe, use vvvv do the video tracking, and using unity's 3d amazing effect to follow it, and its all real time!