Version 81 (modified by sc, 12 years ago) (diff)


How To Use Puzzlebox Brainstorms Software


Puzzlebox Brainstorms software is undergoing rapid development, including more convenient packaging and reduce hardware and software requirements. This document will be updated periodically to reflect advances in development and packaging.

The current version of Puzzlebox Brainstorms software allows a user of a Windows or Linux PC to connect to and control a basic LEGO Mindstorms NXT robot over Bluetooth. This control can be via mouse, keyboard, or an EEG headset such as the Emotiv EPOC to steer and drive the robot in various directions. Optionally, a mobile handset such as the Nokia n900 can be placed on the robot in order to provide the user a live video stream from the robot's perspective for remote tele-operation, and/or control the robot using a wireless or mobile data link connect (thereby extending beyond the limits of a Bluetooth connection).

Future targets for development are described on the project Roadmap.



Installing and Running Software


Client Interface

Control Via Emotiv EPOC EEG Headset

Remote Live Video Streaming From LEGO Mindstorms NXT Robot's Perspective

Currently a combination of mplayer and VNC is used to remotely view a live video stream from the LEGO Mindstorms NXT robot's perspective. mplayer is used to locally display a live video feed on the Nokia n900's screen, which is then viewed remotely over the local Wifi network via VNC. This is neither an ideal nor efficient method, but has been demonstrated to work better over a local Wifi connection than a purely Internet-based solution such as Qik.

  • First launch the "x11vnc" application on the Nokia n900

No image "n900-6-x11vnc.jpg" attached to HowToUseBrainstormsSoftware]

  • Next connect to Nokia n900 using the VNC Viewer application from a computer such as a Windows PC.
  • Slide the camera lens cover open on the rear of the Nokia n900, then exit the "Camera" application which launches automatically, making sure to leave the lens cover open.
  • Launch a new "X Terminal" application or SSH into the Nokia n900
  • Run the following mplayer command: "mplayer -vo x11 -fs tv:// -tv driver=v4l2:device=/dev/video0" (note that changing "/dev/video0" to "/dev/video1" will switch to displaying the forward-facing camera, though its resolution is considerably lower and the image quality is comparably quite poor)

No image "n900-7-mplayer_camera.jpg" attached to HowToUseBrainstormsSoftware

  • A live view from the LEGO Mindstorms NXT robot's perspective should now be visible in the VNC Viewer application.

No image "n900-8-remote_live_streaming.jpg" attached to HowToUseBrainstormsSoftware