Robotic Projection Mapping With KUKA KR AGILUS: How Moving Projectors Create Dynamic Visuals

Robotic projection mapping with KUKA KR AGILUS uses a compact six-axis industrial robot to move a projector, mirror, lens, camera, or light source through programmed positions while digital content remains coordinated with the physical scene. The robot adds controlled spatial movement to a technique that normally depends on fixed projectors.

This makes it possible to change the projection angle during a performance, redirect an image between surfaces, reveal different parts of an object, or synchronise light with music, choreography, scenery, and audience interaction.

The robot does not create a successful mapping installation by itself. The complete system must connect robot motion, optical calibration, three-dimensional geometry, media playback, content rendering, cable management, safety, and physical staging.

What Is Robotic Projection Mapping?

Projection mapping uses digital images or animation to transform a physical surface into a visual display. Instead of projecting only onto a conventional flat screen, the content is adapted to the geometry of objects, sculptures, scenery, interiors, or architectural surfaces.

Robotic projection mapping introduces controlled mechanical movement into this relationship.

An industrial arm can move:

• the complete projector;
• a mirror that redirects a stationary projection beam;
• a lens or optical filter;
• a camera used for tracking or calibration;
• a light source;
• the physical object receiving the projection;
• a screen or reflective surface.

The robot’s movement becomes another design variable. The projected image can change because the digital content changes, because the optical equipment moves, because the projection surface moves, or because several of these events occur together.

Why Use a Robot Instead of a Fixed Projector?

A fixed projector can produce highly complex visual content, but its optical position remains constant. A robot allows that position and orientation to change according to a programmed sequence.

This can support:

• projection onto several surfaces from one moving optical system;
• dynamic changes in perspective;
• controlled movement around sculptures or scenic objects;
• temporary illumination of selected spatial regions;
• projection that follows a moving object;
• coordination with performers or stage machinery;
• transitions between projection, shadow, reflection, and direct light;
• precisely repeated movement across several performances.

The robot is most useful when physical movement contributes meaningfully to the visual concept. Moving a projector without a clear spatial or narrative purpose adds complexity without necessarily improving the installation.

What the KUKA KR AGILUS Contributes

The KUKA KR AGILUS is a family of compact six-axis industrial robots developed for fast and precise automation in restricted spaces.

Characteristics relevant to projection installations can include:

• six-axis positioning and orientation;
• a compact physical footprint;
• several installation positions;
• repeatable programmed motion;
• integration with industrial controllers and external systems;
• versions with different payloads and reaches;
• offline programming and simulation support.

The exact KR AGILUS variant matters. The family includes different generations and configurations, and their payload, reach, repeatability, environmental protection, controller, and mounting options are not identical.

A project should therefore specify a complete robot designation rather than state only that it uses a “KR AGILUS.”

Projector, Mirror, or Moving Surface?

There are several ways to introduce robotic motion into projection mapping. Moving the complete projector is only one option.

Design principle: when the projector is too heavy for the selected robot or requires substantial cooling and cabling, moving a mirror or optical component may be more practical.

Why Projector Payload Must Be Calculated Carefully

Robot payload is not limited to the published weight of the projector.

The complete wrist load may include:

• the projector;
• custom mounting brackets;
• protective housing;
• power and data connectors;
• cable-support equipment;
• optical accessories;
• cooling or ventilation components;
• safety retainers;
• tracking markers or calibration targets.

The centre of gravity is also critical. A projector mounted far from the robot flange creates a larger wrist moment than the same mass located close to the flange.

The selected load must remain within the permitted mass, centre-of-gravity, and inertia limits of the exact robot model.

A projector that is technically lighter than the robot’s nominal payload may still be unsuitable because of its dimensions, offset, inertia, cable forces, or required movement speed.

Reach Is Not the Same as a Usable Projection Volume

The manufacturer’s maximum reach describes the robot’s geometric capability under defined conditions. The usable mapping area is usually smaller.

It can be reduced by:

• projector or mirror dimensions;
• required distance from the target surface;
• focus range;
• minimum and maximum throw distance;
• robot joint limits;
• singularities;
• cable and hose movement;
• surrounding scenery;
• performer and audience safety zones;
• the need to maintain uninterrupted visibility.

A compact robot may be appropriate for installations, galleries, tabletop objects, scenic elements, or localised projection movement.

Large building façades may require a robot with more reach, a linear track, a robotic positioner, several robots, or a stationary projection architecture.

How Moving the Projector Changes the Image

A digital image mapped correctly from one projector position will not generally remain aligned after the projector moves.

Movement changes:

• perspective;
• image scale;
• keystone distortion;
• throw distance;
• focus;
• brightness per unit area;
• occlusion;
• shadow position;
• which surfaces remain visible to the projector.

The media system must compensate for these changes if the visual content is expected to remain attached to the physical geometry.

This compensation can be achieved through:

• pre-rendered content for known robot poses;
• real-time rendering from the current projector position;
• calibration data linking robot coordinates to the virtual scene;
• camera-based correction;
• projection matrices updated from robot-position data;
• content transitions designed specifically around movement.

Without this layer, the robot may move accurately while the projected image slides, stretches, loses focus, or leaves the intended surface.

The Coordinate Systems Behind Robotic Mapping

A robotic projection installation may contain several coordinate systems:

• the robot base frame;
• the robot flange frame;
• the projector or mirror tool frame;
• the camera frame;
• the projection surface frame;
• the three-dimensional scene model;
• the media-server virtual camera;
• external tracking coordinates.

These systems must be related mathematically.

For example, the robot controller may know the pose of its flange, but the media server needs the optical origin and orientation of the projector lens. The difference between the flange and lens must be measured and stored as a tool transformation.

If that relationship is inaccurate, image alignment errors will change as the robot moves.

How a Robotic Projection System Is Calibrated

Calibration creates a reliable relationship between the digital and physical environment.

A complete process may include:

1. Robot Verification: confirm mastering, base position, and mechanical condition.
2. Tool Calibration: determine the position and orientation of the projector lens, mirror, or optical centre relative to the robot flange.
3. Surface Measurement: scan or model the receiving geometry.
4. Camera Calibration: determine the camera’s lens and spatial parameters when vision is used.
5. Projector Calibration: determine focal behaviour, optical centre, resolution, and projection geometry.
6. Coordinate Registration: align robot, surface, camera, and virtual-scene coordinates.
7. Pose Testing: project known patterns at representative robot positions.
8. Error Measurement: compare expected and observed image locations.
9. Correction: update transforms, warping, robot frames, or rendering parameters.
10. Final Validation: test the full movement sequence under show conditions.

Calibration should be repeated when the robot base, tool mount, projector, lens, mirror, scenery, or receiving surface changes.

Repeatability Does Not Guarantee Projection Accuracy

Robot repeatability describes the ability to return consistently to a programmed pose. It does not describe the final alignment of the projected image.

Projection accuracy also depends on:

• robot mastering;
• tool-frame calibration;
• projector lens geometry;
• mount stiffness;
• mechanical vibration;
• focus stability;
• thermal effects inside the projector;
• surface measurement;
• media-server calculations;
• tracking latency;
• network and timing behaviour.

A robot can reproduce the same physical pose while the projected image remains incorrectly calibrated.

System quality must therefore be evaluated at the visible image, not inferred solely from the robot specification.

How KUKA.Sim Supports the Robot Layer

KUKA.Sim can be used to create and evaluate a virtual representation of the robotic installation.

Within the robot layer, simulation can support:

• reachability checks;
• collision detection;
• tool-orientation review;
• robot-position analysis;
• evaluation of wall, ceiling, or floor mounting;
• testing of scenic geometry;
• offline path development;
• cycle and sequence analysis;
• safe approach and departure movements.

Robot simulation does not replace projection-mapping software. It does not automatically calculate visual warping, lens behaviour, projector brightness, focus, or media-server content.

The robot simulation and media simulation must exchange or share the necessary pose and geometry information.

Pre-Rendered Content Versus Real-Time Rendering

The correct approach depends on whether the movement is fixed, rehearsed, interactive, or continuously changing.

How Robot Motion and Media Playback Are Synchronised

The robot controller and media server must share a reliable timing strategy.

Possible methods include:

• digital input and output signals;
• PLC coordination;
• show-control cues;
• timecode;
• network messages;
• position-based triggers;
• predefined robot-program events;
• real-time pose streaming where supported and validated.

The media may need to respond to:

• the start of robot movement;
• arrival at a calibrated pose;
• the robot’s current position;
• the state of another scenic system;
• music or performance timecode;
• audience or performer tracking.

The show must also define what happens when one system is delayed, paused, stopped, or loses communication.

A visually precise sequence can fail if the robot and media playback drift apart.

Why Projector Vibration Matters

Projection systems magnify small physical movement. Vibration that appears minor at the robot wrist can become visible as image shake on a distant surface.

Potential sources include:

• rapid robot acceleration;
• abrupt stopping;
• flexible mounting brackets;
• projector mass located far from the flange;
• robot posture near the edge of its working envelope;
• cable forces;
• mechanical backlash or wear;
• external stage vibration.

Image stability may require:

• slower acceleration;
• smoother path blending;
• a more rigid mount;
• a lighter optical configuration;
• movement only between projection states;
• a pause before visual content becomes visible;
• using a mirror instead of moving the full projector.

The fastest available robot motion is rarely the most useful motion for projection mapping.

Focus, Brightness, and Throw Distance

A projector has an optical operating range. Moving it changes the relationship between the lens and the projection surface.

The project must evaluate:

• minimum and maximum throw distance;
• lens type;
• focus range;
• image size;
• brightness loss over larger areas;
• surface reflectivity;
• ambient light;
• viewing angle;
• depth variation across irregular geometry.

A robot path may be mechanically valid but optically unusable because the image is outside the focus range or too dim at a particular pose.

Robot feasibility and optical feasibility must be evaluated together.

Cable and Cooling Management

A robot-mounted projector requires continuous electrical power and usually a video or network connection.

Cables must not:

• restrict robot motion;
• exceed their bend radius;
• enter a pinch point;
• pull on the projector mount;
• interfere with performers or scenery;
• become disconnected during repeated movement;
• create uncontrolled forces at the wrist.

Wireless video can reduce one cable requirement but does not eliminate projector power, latency, reliability, or bandwidth concerns.

Projector ventilation must also remain unobstructed at every robot pose. Enclosing the unit in a custom housing can affect cooling and should be assessed technically.

Robot-Mounted Mirrors as an Alternative

A moving mirror can redirect a beam from a stationary projector while reducing the mass carried by the robot.

This architecture may provide:

• higher projector brightness without exceeding the robot payload;
• simpler projector power and cooling;
• lower moving mass;
• faster optical redirection;
• separation between the robot and expensive projection hardware.

It introduces its own constraints:

• the reflected image changes orientation;
• small angular errors produce large positional changes at distance;
• mirror stiffness and flatness affect image quality;
• the beam path must remain unobstructed;
• reflected light may enter unsafe or unintended areas;
• calibration must include the reflective transformation.

A mirror system can be technically elegant, but it is not automatically simpler.

Projection Mapping on Moving Objects

The robot does not always need to move the projector. It may move the object receiving the projection.

Examples include:

• a rotating sculptural surface;
• a screen that changes orientation;
• a moving architectural model;
• a mirror or translucent panel;
• a scenic object carried through a performance;
• several objects assembled into different configurations.

If the object pose is known from the robot program, the media system can update the projected content accordingly.

This architecture may preserve a stable projector while making the physical canvas dynamic.

The payload and safety requirements can be greater because the robot may carry a larger object close to performers or audiences.

Interactive Robotic Projection Mapping

Interactive installations use live information to influence robot movement, digital content, or both.

Inputs may come from:

• audience-position tracking;
• performer motion capture;
• camera analysis;
• sound;
• touch or force sensors;
• environmental data;
• online datasets;
• manual show control.

The response should remain inside defined limits.

For example, visitor movement may select between several validated robot poses or modify a small movement parameter. It should not generate unrestricted robot trajectories without collision checking, speed limits, and safety controls.

Interaction design must define:

• which inputs are accepted;
• how they modify the installation;
• the maximum robot speed and movement range;
• what happens when tracking is lost;
• how conflicting inputs are resolved;
• how the system returns to a safe state.

Using Projection Mapping With Dance and Performance

Robotic projection can be coordinated with human performance when the machine and performer share a carefully designed spatial sequence.

The production team may synchronise:

• robot movement;
• projected visuals;
• performer positions;
• music and timecode;
• stage lighting;
• scenic automation;
• camera movement;
• video playback.

The robot should not depend on a performer arriving at an exact location unless the choreography, tracking, operating limits, and safe fallback have been validated.

The system must distinguish between artistic timing and safety control. A missed cue may be acceptable creatively; an unsafe robot trajectory is not.

Architectural and Public-Space Projection

Projection mapping on buildings or public structures introduces additional scale and environmental constraints.

These may include:

• long projection distances;
• large high-output projectors;
• weather exposure;
• uneven or historic surfaces;
• restricted installation positions;
• public access;
• temporary structural supports;
• local permissions;
• night-time visibility;
• protection of cultural or architectural fabric.

A compact KR AGILUS may be useful for moving a mirror, camera, small projector, optical element, or architectural model within a larger installation.

It should not be assumed suitable for carrying every large venue projector. High-output units may exceed the available payload or create impractical wrist loads.

What Makes a KR AGILUS Variant Suitable?

Robot selection should begin with the optical and spatial requirements.

The assessment should include:

• complete tool payload;
• tool centre of gravity and inertia;
• required reach;
• installation position;
• movement speed and smoothness;
• required repeatability;
• controller generation;
• available I/O and communication;
• offline-programming compatibility;
• cable-routing options;
• environmental conditions;
• mechanical and service condition.

The smallest suitable robot generally simplifies installation, safety zones, infrastructure, and visual integration.

Oversizing the robot can increase floor-space, guarding, structural, transport, and commissioning requirements without improving the visual result.

Can a Refurbished KUKA KR AGILUS Be Used?

A refurbished KUKA KR AGILUS can potentially support projection mapping when its condition, controller, payload, reach, interfaces, and programming workflow match the installation.

The evaluation should verify:

• the exact model and controller;
• mechanical condition;
• gearbox backlash;
• brakes, motors, encoders, and cables;
• mastering and repeatability;
• available I/O and communication options;
• KUKA.Sim or offline-programming compatibility;
• system backups;
• safety configuration;
• spare-parts and technical-support availability.

A used robot that moves successfully during a basic test may still be unsuitable for projection if vibration, calibration drift, controller limitations, or unsupported software affect the installation.

RHTS provides new and refurbished industrial robots that can be evaluated for projection, camera movement, interactive installations, and creative automation.

Safety in Robotic Projection Installations

An industrial robot remains hazardous equipment when installed in a gallery, theatre, festival, or public space.

The safety assessment should consider:

• robot speed and moving mass;
• projector, mirror, or scenic payload;
• sharp or fragile optical components;
• falling-object risk;
• performer and audience proximity;
• temporary installation structures;
• cable movement;
• loss of media or tracking communication;
• manual setup and maintenance;
• unexpected audience behaviour;
• emergency stopping and safe restart.

Depending on the installation, controls may include:

• physical guarding;
• safety scanners;
• restricted operating zones;
• reduced-speed modes;
• mechanical secondary retention for mounted equipment;
• defined show sequences;
• emergency-stop stations;
• trained operators;
• pre-show inspection.

Safety principle: visual interaction should never depend on allowing unvalidated robot movement near an audience.

What Are the Main Limitations?

• Moving the projector changes the image geometry. Mapping must update with robot pose or be designed around fixed calibrated positions.
• Compact robots have limited payload and reach. Many professional projectors may be too heavy or physically large.
• Image vibration can expose small mechanical movement. Motion profiles and mounting stiffness require careful control.
• Focus and brightness can change throughout the path. Mechanically reachable positions may be optically unsuitable.
• Cables can restrict movement. Power, data, and cooling requirements must be engineered.
• Robot repeatability is only one part of alignment. Optical and coordinate calibration determine visible accuracy.
• Real-time rendering increases system complexity. Tracking, networking, rendering, and robot data must remain synchronised.
• Interactive operation requires strict limits. Audience data cannot be allowed to generate unsafe movement.
• Public installations require substantial safety infrastructure. The robot cannot be treated as ordinary stage equipment.
• The robotic element must justify its complexity. A fixed projector may be better when physical optical movement adds no meaningful value.

How to Evaluate a Robotic Projection-Mapping Project

If the optical architecture and calibration strategy are not defined, choosing the robot model is premature.

Frequently Asked Questions

What Is Robotic Projection Mapping?

Robotic projection mapping uses an industrial robot to move a projector, mirror, optical element, camera, light source, or projection surface while digital content remains coordinated with the physical scene.

Why Use KUKA KR AGILUS for Projection Mapping?

The KR AGILUS family provides compact six-axis movement, several installation options, repeatable positioning, and integration with KUKA controllers and simulation tools.

Can a KR AGILUS Carry Any Projector?

No. Suitability depends on the exact robot variant and the complete weight, centre of gravity, inertia, dimensions, mounting hardware, and cables of the projector system.

Can the Robot Move a Mirror Instead of the Projector?

Yes. A robot-mounted mirror can redirect light from a stationary projector and may reduce moving payload, but it requires precise optical calibration and beam-safety control.

Does the Projection Remain Aligned While the Robot Moves?

Not automatically. Projector movement changes perspective, scale, focus, and distortion. The content must be recalculated, switched between calibrated poses, or corrected using tracking and real-time rendering.

Can KUKA.Sim Create the Projection Mapping?

KUKA.Sim can support robot simulation, offline programming, reachability analysis, and collision detection. Projection warping, optical calibration, and media rendering require additional tools.

Can the Installation Respond to an Audience?

Yes, when sensor data modifies prevalidated robot or media parameters inside a controlled operating envelope. Unrestricted audience-generated robot movement would create serious safety risks.

Can a Refurbished KR AGILUS Be Used?

Potentially, when the robot’s mechanical condition, controller, reach, payload, communication options, software compatibility, and safety configuration match the project.

Is Robot Repeatability the Same as Projection Accuracy?

No. Visible image accuracy also depends on robot and tool calibration, lens geometry, surface measurement, mounting rigidity, rendering, timing, and tracking.

Robotic Mapping Connects Physical Motion With Digital Perspective

Robotic projection mapping with KUKA KR AGILUS can turn the optical position itself into part of an installation’s visual language.

The robot can move a projector, redirect light through a mirror, reposition a receiving surface, or coordinate a camera with a changing spatial scene. These possibilities extend mapping beyond content displayed from one fixed point.

But the creative effect depends on a technically disciplined system. Robot movement must remain connected to projector geometry, surface calibration, rendering, timing, focus, brightness, cable management, and safety.

The KR AGILUS contributes compact and repeatable six-axis motion. It does not independently solve the optical or media architecture.

The strongest projects use robotics because movement changes how light, image, object, and audience relate in physical space—not simply because a moving industrial arm creates spectacle.

Explore related applications in the Robot Art & Architecture section or read how industrial robots are used in film and live shows.

Artists, theatres, studios, museums, and integrators can also contact RHTS with the intended optical payload, movement range, surface dimensions, installation environment, and interaction requirements for an initial robot-platform assessment.