Widgets

The NTK widgets are easy-to-use components that process information. You connect them together so that data flows from one to the next. Widgets allow you to see the data they are processing, and make adjustments to how that data is processed, all while the project is running live with real inputs and outputs.

Input-Output

  • AnalogIn
  • Read a sensor value from an analog input
  • AnalogOut
  • Set the level of a PWM digital output
  • DigitalIn
  • Read a sensor value from a digital input
  • DigitalOut
  • Set a digital output to HIGH or LOW
  • Display
  • Show up to three lines of text or numbers on an OLED screen
  • Encoder
  • Count the clicks of a rotary encoder knob, up or down, from any starting value
  • GroveIn
  • Read sensor value(s) from a Grove sensor connected to your device
  • Neopixel
  • Drive a strip or ring of addressable RGB LEDs with a choice of patterns
  • Servo
  • Set the position of a servo

Network

  • CloudIn
  • Subscribe to data changes from an MQTT host
  • CloudOut
  • Send data periodically to an MQTT data broker
  • OSCIn
  • Read a value from an OSC sender using the same message
  • OscOut
  • Sends a value to an OSC receiver at the specified IP address and port with a specific message format
  • Webhook
  • Sends a webhook URL to a cloud service

Media

  • Audio
  • Control audio play/pause, volume, speed
  • Data
  • Output text or numeric data in a sequence
  • Image
  • Control image X and Y position, Opacity, Width
  • Text
  • Display text - control X, Y, Opacity
  • Video
  • Control video play/pause, speed, and time position

UI

  • Button
  • Generate data from on-screen button
  • HTML
  • Place custom HTML on the display and manipulate it
  • Keyboard
  • Responds to keys pressed on the keyboard
  • Knob
  • Generate data from on-screen knob

Animation

  • Pulse
  • Periodically output fixed or random values
  • Scene
  • Play a little story across up to four outputs, written as a short script
  • Sequence
  • Outputs a sequence of values transitioning from one number to another
  • Tween
  • Outputs a stream of values transitioning from one number to another

Logic

  • Boolean
  • Determine if any or all inputs have a high value.
  • Cases
  • Sort one input into cases - "too dark", "just right", "too bright", or between 300 and 700, greater than 700, otherwise - and send each case out of its own outlet.
  • Code
  • Add custom Javascript with four inputs and four outputs
  • Concat
  • Joins (concatenates) up to four inputs into one string
  • Count
  • Count the number of times an input value rises
  • Gate
  • Use input to decide when other inputs pass through the widget
  • IfThen
  • Compare input to a number or text to decide what to output
  • Mix
  • Mix up to four inputs into a single output
  • Process
  • Invert, smooth, or add easing
  • Splitter
  • Split input into four outputs

AI

  • Decide
  • Decide reads a piece of text and answers a few questions about it, faster than LLMs
  • FaceTrack
  • Use the camera to detect and track the position of a face
  • Gesture
  • Recognize a recorded pattern of input values
  • LLM
  • Send a prompt to a large language model (local or remote), with optional reference text file
  • ObjectRecog
  • Recognizes objects in your webcam
  • PoseRecog
  • Recognize a trained hand or body pose using the webcam
  • SpeechIn
  • Recognize audio speech and turn it into text
  • SpeechOut
  • Synthesize audio speech from text input