- \n
- 1x MLX90640 Thermal Sensor<\/li>\n
- 1x Waveshare RP2040 Zero<\/li>\n
- 1x HT7333 LDO<\/li>\n
- 2x SMD Capacitor 10 uF<\/li>\n
- 2x SMD Resistor 2.2k Ohm<\/li>\n<\/ul>\n
All in all about 30 Euros<\/p>\n
Schematic<\/h2>\n
![\"\"](\"https:\/\/i0.wp.com\/www.nico-maas.de\/wordpress\/wp-content\/uploads\/thermalCameraSchematic.png?resize=1024%2C524&ssl=1\")
<\/a><\/p>\nNothing really surprising - a HT7333 with some filter caps to allow for a clean power source, two pull-up resistors to allow for the high-speed, 1 MHz communication via the i2c bus. Keep the i2c wires between RP2040 Zero and the sensor as short as possible and pull-up the i2c SDA\/SCL lines directly at the sensor.<\/p>\n
Operation modes<\/h2>\n
There are two operation modes here, you can either choose to use the sensor with the Adafruit and Sparkfun example, which will just write a (very long) ASCII line consiting of 768 comma seperated float values per frame, delimited by \\n. This will also work with a Processing example to showcase the picture (about 4 FPS).
\nThe alternative to that, would be using another approach, packing the 768 temperature values not in a data intensive ASCII line, but send them via SLIP protocol to the computer. The processing example is not available for that, but I got some other Python code in the making (about 7.5 FPS).<\/p>\nSerial<\/h3>\n
Firmware (Serial)<\/h4>\n
Programmed via Arduino using the Arduino-Pico framework, using the Adafruit_MLX90640 library ( https:\/\/github.com\/adafruit\/Adafruit_MLX90640<\/a> ) - please be aware that 1 MHz I2C operations and mlx.setRefreshRate(MLX90640_32_HZ) will only work with extremely short wires!<\/p>\n
#include\n\nAdafruit_MLX90640 mlx;\nfloat frame[32*24]; \/\/ buffer for full frame of temperatures\n\n\/\/ uncomment *one* of the below\n#define PRINT_TEMPERATURES\n\/\/#define PRINT_ASCIIART\n\nvoid setup() {\n while (!Serial) delay(10);\n Serial.begin(115200);\n delay(100);\n\n \/\/Serial.println(\"Adafruit MLX90640 Simple Test\");\n if (! mlx.begin(MLX90640_I2CADDR_DEFAULT, &Wire)) {\n Serial.println(\"MLX90640 not found!\");\n while (1) delay(10);\n }\n \/*\n Serial.println(\"Found Adafruit MLX90640\");\n\n Serial.print(\"Serial number: \");\n Serial.print(mlx.serialNumber[0], HEX);\n Serial.print(mlx.serialNumber[1], HEX);\n Serial.println(mlx.serialNumber[2], HEX);\n *\/\n\n \/\/mlx.setMode(MLX90640_INTERLEAVED);\n mlx.setMode(MLX90640_CHESS);\n\/*\n Serial.print(\"Current mode: \");\n if (mlx.getMode() == MLX90640_CHESS) {\n Serial.println(\"Chess\");\n } else {\n Serial.println(\"Interleave\"); \n }\n*\/\n\n\/\/ mlx.setResolution(MLX90640_ADC_18BIT); \/\/default\n mlx.setResolution(MLX90640_ADC_19BIT);\n \/*Serial.print(\"Current resolution: \");\n mlx90640_resolution_t res = mlx.getResolution();\n switch (res) {\n case MLX90640_ADC_16BIT: Serial.println(\"16 bit\"); break;\n case MLX90640_ADC_17BIT: Serial.println(\"17 bit\"); break;\n case MLX90640_ADC_18BIT: Serial.println(\"18 bit\"); break;\n case MLX90640_ADC_19BIT: Serial.println(\"19 bit\"); break;\n }\n*\/\n\n \/\/mlx.setRefreshRate(MLX90640_2_HZ);\n \/\/mlx.setRefreshRate(MLX90640_8_HZ);\n mlx.setRefreshRate(MLX90640_32_HZ);\n\n \/*Serial.print(\"Current frame rate: \");\n mlx90640_refreshrate_t rate = mlx.getRefreshRate();\n switch (rate) {\n case MLX90640_0_5_HZ: Serial.println(\"0.5 Hz\"); break;\n case MLX90640_1_HZ: Serial.println(\"1 Hz\"); break; \n case MLX90640_2_HZ: Serial.println(\"2 Hz\"); break;\n case MLX90640_4_HZ: Serial.println(\"4 Hz\"); break;\n case MLX90640_8_HZ: Serial.println(\"8 Hz\"); break;\n case MLX90640_16_HZ: Serial.println(\"16 Hz\"); break;\n case MLX90640_32_HZ: Serial.println(\"32 Hz\"); break;\n case MLX90640_64_HZ: Serial.println(\"64 Hz\"); break;\n }\n *\/\n\n \/\/Wire.setClock(400000); \/\/ max 1 MHz\nWire.setClock(1000000); \/\/ max 1 MHz\n\/\/ Wire.setClock(3400000); \/\/ max 1 MHz\n\n}\n\nvoid loop() {\n \/\/delay(500);\n\n if (mlx.getFrame(frame) != 0) {\n \/\/Serial.println(\"Failed\");\n return;\n }\n\n \/\/Serial.println();\n \/\/Serial.println();\n for (uint8_t h=0; h<24; h++) {\n for (uint8_t w=0; w<32; w++) {\n float t = frame[h*32 + w];\n#ifdef PRINT_TEMPERATURES\n Serial.print(t, 1);\n Serial.print(\",\");\n#endif\n#ifdef PRINT_ASCIIART\n char c = '&';\n if (t < 20) c = ' ';\n else if (t < 23) c = '.';\n else if (t < 25) c = '-';\n else if (t < 27) c = '*';\n else if (t < 29) c = '+';\n else if (t < 31) c = 'x';\n else if (t < 33) c = '%';\n else if (t < 35) c = '#';\n else if (t < 37) c = 'X';\n Serial.print(c);\n#endif\n }\n \/\/Serial.println();\n }\n Serial.println();\n \/\/Serial.write('\\n'); \/\/10\n}<\/code><\/pre>\n Software (Serial)<\/h4>\n
To read the data from the sensor, the SparkFun Processing example ( https:\/\/learn.sparkfun.com\/tutorials\/qwiic-ir-array-mlx90640-hookup-guide\/all#example-code<\/a> ) can be used.
\nAlternatively, you can use Python 3.x and pyserial, giving back a list of thermal readings which can then be drawn into pictures.<\/p>\nimport serial\nimport re\nser = serial.Serial('COM12', 115200, timeout=2)\nwhile True:\n line = ser.readline().decode('ascii') # read a '\\n' terminated line\n thermalData = re.split('\\,', line[:-3]) # last ,\\n needs to go!\n print(thermalData)<\/code><\/pre>\nSLIP<\/h3>\n
Firmware (SLIP)<\/h4>\n
Programmed via Arduino using the Arduino-Pico framework, using the Adafruit_MLX90640 library ( https:\/\/github.com\/adafruit\/Adafruit_MLX90640<\/a> ) as well as PacketSerial ( https:\/\/github.com\/bakercp\/PacketSerial<\/a> ) - please be aware that 1 MHz I2C operations and mlx.setRefreshRate(MLX90640_32_HZ) will only work with extremely short wires!<\/p>\n
#include\nSLIPPacketSerial packetSerial;\n\n#include \nAdafruit_MLX90640 mlx;\nfloat frame[32*24]; \/\/ buffer for full frame of temperatures\n\nvoid setup() {\n while (!Serial) delay(10);\n Serial.begin(460800);\n Serial.setTimeout(100);\n packetSerial.setStream(&Serial); \n delay(100);\n\n if (! mlx.begin(MLX90640_I2CADDR_DEFAULT, &Wire)) {\n \/\/Serial.println(\"MLX90640 not found!\");\n while (1) delay(10);\n }\n \/*\n Serial.println(\"Found Adafruit MLX90640\");\n Serial.print(\"Serial number: \");\n Serial.print(mlx.serialNumber[0], HEX);\n Serial.print(mlx.serialNumber[1], HEX);\n Serial.println(mlx.serialNumber[2], HEX);\n *\/\n\n \/\/mlx.setMode(MLX90640_INTERLEAVED);\n mlx.setMode(MLX90640_CHESS);\n\n\/\/ mlx.setResolution(MLX90640_ADC_18BIT); \/\/default\n mlx.setResolution(MLX90640_ADC_19BIT);\n\n \/\/mlx.setRefreshRate(MLX90640_2_HZ);\n \/\/mlx.setRefreshRate(MLX90640_8_HZ);\n mlx.setRefreshRate(MLX90640_32_HZ);\n\n \/\/Wire.setClock(400000);\n Wire.setClock(1000000); \/\/ max 1 MHz\n}\n\nvoid loop() {\n packetSerial.update();\n if (mlx.getFrame(frame) != 0) {\n \/\/Serial.println(\"Failed\");\n return;\n } else {\n packetSerial.send((uint8_t*)&frame, sizeof(frame)); \n }\n}<\/code><\/pre>\n Software (SLIP)<\/h4>\n
Using Python 3.x, pyserial and sliplib, giving back a list of thermal readings which can then be drawn into pictures<\/p>\n
import serial\nimport sliplib\nimport time\nimport struct\nser = serial.Serial('COM12', 115200, timeout=2)\nwhile True:\n bytesToRead = ser.inWaiting()\n if (bytesToRead!=0):\n readData = ser.read(bytesToRead)\n decodedData = sliplib.decode(readData)\n if decodedData != b'':\n thermalData = []\n for i in range(0, len(decodedData), 4):\n thermalData.append(struct.unpack('f', decodedData[i:i+4])[0])\n print(thermalData)\n # ca. 7.41 Frames raw\n else:\n time.sleep(0.07)<\/code><\/pre>\nFinishing up<\/h2>\n
After connecting everything, I finished the build up by printing a small PLA housing and even printed a TPU cap for the lense itself, so that (via friction fit) the sensor could be just thrown into the toolbox and still would be protected from dust and other issues. Could the finish be gotten more pretty? Yes. Did this hinder its function? Not at all, it already helped me fix up a defective turingPi2 \ud83d\ude42 (maybe something for the next post).<\/p>\n
Optimisation<\/h2>\n
As usual in engineering, some problems can be solved by throwing money at them. In this case, a Teensy 4.x as a processor could significantly increase the data throughput. However, I did not want to pair a 40 Euro MCU with a 25 Euro Sensor - be it for costs and footprints sake - and opted in for the 2.5 Euro RP2040 Zero. Still, performance can be improved over my first optimisation using SLIP - by just using the second core of the RP2040. Ideally you would multi-thread the application, having the first core always retriving new data, while the second core packs it into SLIP packets and sends them on their way. This should be fairly easy and might result in more fps :).<\/p>\n
Photos<\/h2>\n
![\"\"](\"https:\/\/i0.wp.com\/www.nico-maas.de\/wordpress\/wp-content\/uploads\/thermalCameraSchematic.png?ssl=1\")
<\/a><\/p>\n