first let us know which controller you are planning to use?
I have implemented the same system with ARM9.
I had cross-compiled mjpg streamer algorithm from UBUNTU to ARM-LINUX GCC. After that I interfaced USB CAM and streamed the images to HTML PAGE by means of WI-FI. I had also put 6 buttons on HTML for following purposes. UP, DOWN, LEFT, RIGHT, SHOOT ON and SHOOT OFF.
Are you planning for a similar one ?