MotionSmith LensArt for Unreal Engine — Documentation
Unreal Engine 5.8 · Windows
LensArt documentation
Set up your backend, bake the first camera projection, then follow the Studio controls in panel order. Select any screenshot to inspect it in the full-resolution viewer.
Install & connect
Install the plugin, connect a backend and run the first projection.
Requirements. Unreal Editor 5.8 on Windows (Win64), the MotionSmith LensArt plugin, and a working WebUI / Forge or ComfyUI backend. Enable the plugin in your project and restart the editor if prompted. The first setup may download the plugin’s Python dependencies.
Your first projection
- Start a backend. In Scene → AI Server, choose it and click Connect.
- Select a mesh actor and confirm its UV channel in Selected Target.
- Frame the mesh in the viewport, then use Camera → Add from View.
- In Generate, choose a checkpoint, enter a prompt and use Match Camera for the output aspect.
- Choose Projections Masking for the active camera. Click Generate & Apply, then check the bake and camera history.
Install — Backends & Models
Open Edit → Editor Preferences → Plugins → MotionSmith LensArt. Under Install — Backends & Models, use Install WebUI or Install ComfyUI if you need a local runtime. If you already run a backend, configure its launch path and port instead. Set Models Folder, refresh the checklist, then select and download the missing models for your chosen workflow. A model marked Installed still needs to be visible to the running server.
LensArt Studio header
Open Tools → MotionSmith LensArt in Unreal Editor. The Studio panel is dockable. The server controls on Scene can start or stop a configured local backend. The adjacent C buttons toggle the corresponding console.
Studio tab order
The main Studio reads left to right: Scene, Lighting, Camera, Generate, Surface, Anime. The Anime tab gathers toon shading, ink, manga tools, the live anime viewport and anime rendering. Open LensArt Mode from the editor’s Modes selector for viewport painting.
Scene
Connect the backend, select the meshes that receive the projection and prepare UVs or ground.
AI Server
Choose WebUI / SD-Forge (REST API) or ComfyUI (API Graph). Enter the backend’s host and port, then click Connect to load model lists. For a local install start with 127.0.0.1 and port 7860 for WebUI / Forge or 8188 for ComfyUI. A green connection status confirms the server answered.
Target Meshes
Select one or more mesh actors in the level before generating. The list under Target Meshes shows the current selection. Smart UV creates UV0 on a copy of an untextured Static Mesh. Reset Texture restores the original materials and keeps generated assets on disk.
Selected Target
Set UV Channel, Texture Size and UDIM (Virtual Texture) for the selected actor. Choose a channel with a usable unwrap for projection. Object Prompt is useful when Complete Scene needs a different description for each actor. The current target’s textures and masks appear in its properties.
Import UV Maps
Import Base Color or Import Normal Map to start from textures you already have. Supply a single image or a numbered UDIM set such as Wall.1001.png and Wall.1002.png.
Ground
For an HDRI floor that catches shadows, set up an environment in Lighting first and enable Project HDRI on Ground. For a tileable material, select floor meshes or a Landscape, choose Ground Type and Surface Condition or enter a prompt and an optional Negative Prompt, then click Generate Ground. Tile Size is in metres. Tune Pattern Rotation, Normal Strength, Roughness and Anti-Tiling after generation. Blend to HDRI fades the distant floor into the backdrop. Apply to Selected reuses the last ground material.
Generate & Apply
Generate & Apply runs the chosen workflow for the active camera or relevant multi-view set and bakes onto the selected LensArt targets. Export Input Maps saves the current camera’s guidance inputs for inspection. Studio Light provides a neutral preview rig.
Lighting
Set the level’s look, light rig and environment before generating or evaluating materials.
Cinematic Look
Enable Cinematic Look to apply the LensArt post-process volume. Choose Look Preset and tune Look Intensity before changing exposure, bloom, vignette, grain or chromatic aberration. Volumetric Fog and Light Shafts are available in the same group.
Scene Lighting
Choose a lighting preset and tune the key light’s direction, intensity, colour and source angle, plus ambient fill and rim. Key Light and Rim Light can be switched off individually. Fog Density above 0 adds LensArt height fog and hides the level’s own fog. Apply Lighting updates the LensArt light actors. Enable Apply Lighting to Generation when the render should guide generation, and adjust Light-Guided Denoise or Auto-Inject Lighting Prompts as needed.
Environment / HDRI
Generate Environment creates a 360° background and a cubemap for the sky and lighting. From File loads an HDR environment. From View captures from the active camera’s position. Brightness, Yaw and HDR Highlight Boost control its presentation. Steps, CFG, seed and upscaler follow the selected model; the negative prompt is used by SDXL, SD 1.5 and SD 3.5 and is disabled for FLUX and CFG 1 models. Enable Send to AI with Camera View when you want the environment to influence the generation input. None clears the active environment.
Camera
Frame the target, manage projection cameras and control how images are baked into UVs.
Projection Cameras
Frame a mesh in the viewport and click Add from View. Create Four Views builds or updates front, right, back and left cameras. Match View moves the selected camera to the current viewport pose. Look Through Camera toggles camera piloting. Use the arrows or camera list to change the active camera.
Selected Camera Properties
Inspect the camera’s source image, weight, opacity and projection controls. Edit Externally opens the source in your configured editor. Apply External Edit reloads the edited PNG and bakes it. Last Generation Pose restores the camera pose associated with its latest result.
Camera Control
Frame Target fits the selected mesh without changing the viewing angle. Switch between Perspective and Orthographic while keeping the frame width at the target distance. Orbit, distance, zoom and aspect are under Selected Camera Properties.
Lens and Sensor
Expand Lens and Sensor for Unreal’s Cine Camera settings, including focal length, filmback and camera controls. Match the generation aspect to the camera framing before the first bake.
Projection Settings
Bake Active Camera writes its source image into the selected target UVs. Blend All Cameras combines enabled cameras with an image and a positive weight. Dilate 8 px or 16 px extends colour into empty texels around UV islands.
Multi-Camera Rig
Choose a rig of 1, 2, 4, 6 or 12 cameras, then Create Rig around the target. Set the ring angles, rotation, aspect and tile size for the coverage you need. Fit to Target recalculates the rig bounds. Rig Blend Sharpness and Rig Edge Fade control how neighbouring camera projections blend into each other. Remove Rig deletes the rig cameras.
Generate
Choose model settings, control the image with scene maps and manage projection results.
Quick Setup
Choose a model family to load its recommended settings from the connected server. The panel offers Flux 1, Flux Schnell, SDXL, SD 3.5, SD 1.5, Qwen-Image and Z-Image. Check that the selected model is available before generating.
Model and Sampling
Select the checkpoint, VAE or text encoder modules, sampler and scheduler. Up to three LoRA slots have independent weights. Refresh Models after installing models or changing the server configuration.
ComfyUI Model Overrides
For the built-in ComfyUI graph, Automatic follows the checkpoint setup. When using a standalone Diffusion Model (UNet), also choose a compatible VAE and text encoders. Weight Dtype applies to the UNet loader. FreeU is for SD / SDXL. Choose the Anti-Shade Engine for the ComfyUI Anti-Shade workflow.
Generation
Describe the surface, material and detail in Positive Prompt. Use Negative Prompt to discourage unwanted lighting or artifacts when your model supports it. Set Steps, CFG and Seed. Disable Random Seed for controlled comparisons. Prompt Preset, Style, Face Guard and Matte Albedo adjust the conditioning for suitable models. Save Current Prompt stores your own prompts under My Prompts in the Prompt Preset menu.
Workflow Mode
Choose a mode based on what should change. Re-do controls how strongly generation replaces the input. Inpaint Color Influence controls how much the colour guide steers the result. Invert Mask Polarity reverses the mask. Maximum Quality (4x AA) increases sampling work. Use Align Camera to View and Frame Margin when you need automatic framing.
When to use each workflow mode
- Projections Masking
- Generate for the active camera and update its contribution while preserving the other camera masks.
- Total Object Single
- Generate for the visible target from one camera. Re-do affects existing painted regions.
- Total Object Multi-Angle
- Use multiple camera views for broader coverage. Use 4 Cardinal Views for front, right, back and left coverage when enabled.
- Inpaint (Color)
- Regenerate a painted region using the colour guide.
- Inpaint (No-Color)
- Regenerate the area marked by the soft mask.
- Where Empty
- Fill unpainted texels while preserving existing coverage.
- Anti-Shade (ComfyUI)
- Use the configured Anti-Shade engine to reduce baked lighting in the camera view.
Resolution and Aspect Ratio
Set output width and height or select an aspect preset. Match Camera uses the active camera’s aspect. The presets maintain a model-appropriate pixel budget and round dimensions to multiples of 64. Enable Tile where the backend workflow supports it.
LensArt Ultra Skin Detailer
Choose a preset compatible with the checkpoint family. Select or download its LoRA and tune Model Strength and CLIP Strength. Apply Matte Skin Prompt changes the prompt guidance. Override CFG / Guidance is available for manual control.
ADetailer
Enable ADetailer for a detector-based refinement pass when the chosen backend and workflow support it. Set Detector Model and ADetailer Denoise. Lower denoise retains more of the existing result.
Lighting Separation
Adjust Shading Strength when working with lighting-guided generation. The lighting guidance switch is also exposed under Lighting → Scene Lighting.
Upscale and Refiner · Hires Fix
Enable Upscale and select Hires Fix for a second pass on WebUI or ComfyUI. Choose the upscaler, multiplier, denoise and second-pass steps. A compatible refiner can be enabled with its own checkpoint and switch point.
Upscale and Refiner · Ultimate SD Upscale
Ultimate SD Upscale is a ComfyUI tiled workflow. Select an available upscale model and tune scale, tile size, overlap and seam correction as needed. Start with a smaller result to check that the required nodes and model are present.
Depth Map Settings
Tune Bright, Contrast, Blur, Edge and Blur Edge for the generated depth input. Inspect the map in Preview Inputs before changing the prompt if guidance looks wrong.
ControlNet 0 · Depth
Each ControlNet slot has its own source, compatible model, Preprocess, Start, End, Weight and input resolution. P, B and C prioritise the prompt, balance it with guidance or prioritise ControlNet. LOW selects low-VRAM mode. Start and End set the part of the sampling pass influenced by the slot.
ControlNet 1 and 2 · Normal and Inpaint
Up to three slots can use depth, normal, RGB, inpaint or style inputs. Select a model appropriate for both the input type and checkpoint family. Use lower input resolution when memory is limited, then inspect the preview.
Reference, IP-Adapter and previews
Choose IP-Adapter Style Image and use IP-Adapter to configure style guidance. The panel uses Redux for FLUX on ComfyUI and IP-Adapter for supported SD / SDXL graphs. Reference configures Forge’s model-free style reference. Preview Inputs and Hide Preview control the active camera’s guidance preview.
Panorama (360°)
Set a center and six cameras, then generate or apply a 2:1 panorama. Repair Seam targets the wraparound boundary. Repair Poles targets the zenith and nadir. Export 360° Depth saves the equirectangular depth input. Use Lighting → Environment / HDRI for the level’s sky and light cubemap.
Workflow Template (ComfyUI API JSON)
Use a ComfyUI API-format JSON workflow. Embed Workflow in Level stores the template with the level. Use Default Workflow restores the built-in graph. For masked generation, check that the selected graph can accept the required image and mask inputs. Save or load project defaults and use Free ComfyUI VRAM to unload models when needed.
Prompt Archive
Save reusable positive and negative prompts under an Entry Name. Use Category / Name for grouped entries. Import and export CSV with title, category, prompt and negative_prompt columns.
Scene and Candidates
Scene Context can include the surrounding scene in the generation input. Increase Candidate Count to review alternatives. Select a result and use Apply Candidate to bake it, or Discard Candidates to clear the pending set.
Scene Context with two candidates
This example enables Scene Context and requests two candidates. Complete Scene runs targets one after another using their individual object prompts.
Generated Views
Review results by camera. Empty thumbnails indicate that the camera has no generated image yet.
Generation History (Active Camera)
Use restores a result with its saved camera pose and mask and rebakes it. PNG saves a copy, and X removes a history entry. Mirror Right Views to Left flips the right-side results onto their matching left-side rig cameras and blends the rig.
Projection Layers
Inspect the selected target’s projection stack. Index 0 is the bottom layer. Reset Layer Settings returns that layer to its recorded bake settings. Remove Layer rebuilds the stack without the selected layer.
Surface
Assign material regions, build PBR maps, place decals and export the finished asset.
Surface Generation
Select wall meshes, choose a Surface Type and Condition, review the prompt and click Generate Surface. LensArt projects the tileable PBR material in world space for vertical surfaces without requiring mesh UVs. Adjust scale, rotation and offsets to align the pattern.
Material Slots
Use Box Select or Brush Select, then Create Material Slot on a Static Mesh copy. Box Select can include hidden camera-facing faces. Shift adds and Ctrl removes. In Brush Select, Shift-click selects the flat area under the cursor. Selections use existing triangles. Name the slot when you create it, or use Rename Material later. Choose Bake Material Slot to target a named region. Automatic uses the base slot on meshes with LensArt regions.
Material
Choose from 20 Material Presets and 8 Material Types that instantly apply tailored shader configurations and baseline physical properties directly onto the target mesh in real time. Fine-tune the selected target’s tint, brightness, contrast, saturation, unpainted colour, metallic, roughness and specular with immediate live feedback.
Detail Normal adds a tiled micro-normal layer with dedicated tiling and strength controls. Advanced emissive parameters drive glowing light strips and digital screens using threshold and saturation gating. After a PBR material is bound, roughness and metallic come from the packed ORM map or integrate with live slider overrides.
Material Type
Choose the shader behaviour for the selected target. The list includes PBR (Opaque), Masked (Cutout), Clear Coat, Subsurface, Glass (Translucent), Unlit / Emissive, Toon (Anime Cel) and Parallax Depth.
Material Presets
Pick a starting point such as Painted Metal, Varnished Wood, Clear Glass or Water Surface. The preset sets the material type and its starting values. Fine-tune the selected target using the Material controls.
PBR Maps (CHORD)
Point Surface ComfyUI Host and Port at a server with CHORD, refresh the model list and select CHORD Model. Generate PBR derives normal, roughness, metallic and optional height from the current texture. Convert Normal to DirectX matches Unreal’s normal orientation when needed. Pack ORM combines AO, roughness and metallic in RGB. Bind PBR Material assigns the material.
Emissive Map
Extract Emissive selects bright, saturated texture areas. Refine the selection with Brightness, Min Saturation, Softness, Strength and Colour Filter. Paint a No-Color mask to add or remove specific areas. Adjust Emissive Map Intensity in Material. For UDIM targets the map is saved and exported.
Albedo (Delight)
Generate Albedo removes baked lighting from the texture. Use CHORD or configure the FLUX.2 Klein 9B UNet, Text Encoder, VAE and LoRA on the Surface ComfyUI server. Blend controls the contribution of the corrected albedo.
Decal
Open or generate a decal image. Adjust opacity, size, position and background tolerance, then Position Decal in the active camera. Upscale Decal enlarges the decal image on a ComfyUI server. Apply Decal places a full-resolution Decal Actor in the level. Paint with Decal uses it as a stamp. Save Decal Material creates a reusable Unreal Deferred Decal material from the image alpha.
Decal categories
Filter the decal prompt list by category, such as industrial, tactical, fantasy, automotive or character marks.
Decal prompt presets
Choose a Prompt Preset to fill the decal prompt, then edit it for the asset. Select a compatible decal LoRA and checkpoint, or use the current Generate checkpoint.
Weathering & Wear Slider
Choose a weathering preset and compatible LoRA, then set Wear / Aging. Use Prompt Suffix to add the optional positive and negative weathering guidance. Apply Wear processes the target texture.
AO (Ambient Occlusion)
Set ray count and distance, then Bake AO to update the packed ORM. Apply AO to Texture can darken base colour. Empty Areas Only fills unpainted texels with grey AO. Studio Lights adds a neutral rig for inspection.
Project Files and Export
Import or export an .artbrush project with textures and projection cameras. Import the mesh upright at its intended scale so camera placement lines up. GLB embeds tile 1001 and writes additional UDIM tiles as PNG. OBJ exports MTL and base colour, and FBX uses Unreal’s exporter with a separate base-colour PNG. Choose an output folder and export the requested maps or all outputs.
LensArt Mode · Paint
Use viewport brushes for direct edits or guide a new masked generation.
Comprehensive Texture Paint Guide. For detailed documentation on brush presets, stylus pressure and tilt dynamics, stroke stabilization, symmetry mirroring, and multi-channel PBR painting, explore the MotionSmith LensArt Texture Paint Guide →
LensArt Mode tabs
Open LensArt Mode in Unreal’s Modes selector. Its toolkit shows Texture Paint, Inpaint No-Color and Inpaint Color in this order. Select a target mesh and use Navigate to return to regular viewport navigation.
Texture Paint (Direct Painting)
Brush (Color) paints directly onto the texture. Erase Paint reveals the projection beneath the stroke. Erase Last Generation and Restore Last Generation toggle the last generated result locally. Ctrl-click sets the source for Clone. Image Stamp, Fill UV Island and Eyedropper handle repeated details, UV islands and colour sampling.
Painting and generation. Texture Paint changes the texture itself, just like a generated image. A later Projections Masking run projects a new image over its view, paint included. Total Object Single (and Total Object Multi-Angle on WebUI / Forge) renders the current texture with your paint and regenerates it by the Re-do amount: a low Re-do keeps your colours and shapes and blends them in, a high Re-do reinterprets them. A typical loop: generate, fix details with the brush, then run Total Object Single with a low Re-do.
Brush shortcuts. Choosing an Inpaint workflow mode or a Paint tab opens LensArt Mode with that tab’s brush; any other workflow mode returns to Navigate. X switches to Erase Last Generation (or back to Restore Last Generation) after a generation, otherwise to the paired eraser. [ / ] shrink or grow the brush; Shift+Alt + drag changes size (horizontal) and hardness (vertical); Shift+Alt + wheel changes size. Shift + right drag rotates the LensArt key light when Scene Lighting is on.
Texture Paint · Brush Settings
Set Radius (cm), Hardness, Opacity, Spacing and Color. Assign Stamp Image before using Image Stamp. Enable pressure for Size or Opacity when using a supported stylus. Left-drag paints, Alt navigates and X switches to the paired eraser.
History (Undo / Redo)
Use Undo (Ctrl+Z) and Redo (Ctrl+Y) for painting changes. The History group appears in each painting subpage.
Inpaint No-Color (Soft Mask)
Use Paint Mask, Erase Mask or UV Island Fill to mark an area for regeneration. Choose Generate → Workflow Mode → Inpaint (No-Color) for the generation pass.
Inpaint No-Color · Brush Settings
Use soft edges to blend the regenerated area into the surrounding texture. Re-do (%) sets the amount of change in the inpaint pass.
Mask Operations
Clear, invert or fill the visible mask. Select Faces and From Selected Faces build the mask from selected triangles. Transfer to Camera converts the UV-space mask for the active camera view.
Inpaint Color (Color Guidance)
Paint a colour guide with Color Paint, or sample a colour with Eyedropper. Choose Generate → Workflow Mode → Inpaint (Color) and run Generate & Apply. The guide conditions the generated colour in the marked area.
Inpaint Color · Brush Settings
Set brush size, softness, opacity and spacing. Color Influence adjusts how strongly the guide steers the new texture. Re-do (%) controls how much the masked area changes.
Color Layer Operations
Clear, invert or fill the visible guide, build it from selected faces or Transfer to Camera to use the active camera’s projection.
Anime
Find the controls for cel shading, manga painting, viewport preview, character continuity and rendering. Read the LensArt Anime Studio workflow.
Anime Look, Lighting and Toon Shading
Select the targets and use Make Anime to apply the anime look. Choose a lighting preset, then adjust shadow thresholds, edge softness, highlights and rim light while viewing the shot. Back to PBR returns the selected target to that material workflow.
Anime Lighting Presets
Choose a lighting preset as a starting point. Compare the shadow and rim on the character before tuning the sun and toon colours.
Anime Face & Hair
Use Face Smoothing to shape face shadows and Face Forward (Local) to orient them. Adjust Hair Shine, Shift and Width on the hair target. The shine direction relies on mesh tangents.
Ramp Editor
Set Ramp Amount to control how strongly the ramp influences shading. Move or recolour the stops to shape the transition from shadow to light.
Ramp Presets
Start with a two-tone or three-tone ramp for discrete lighting bands. Compare those with a softer preset using the same shot lighting.
Ink & Outline Painter
Choose Paint Outline Width to vary the outline locally, or use Ink Brush and Soft Ink Brush for drawn marks. Inspect line thickness at delivery size.
Manga Painting Tools
Choose a manga brush and adjust its size and colour. Use Screentone in Shadows to add halftone dots to toon shadows.
Manga Brush Presets
Use Screentone Dots for tone, Hatching or Cross Hatching for texture, and Speed Lines to direct attention. Ink Splatter and Sparkle provide other mark shapes.
Live Anime Viewport
Use Look Preset to set a baseline. Adjust Ink Lines, Color Steps, Silhouette Sensitivity and Crease Sensitivity while viewing the whole level.
Viewport Look Presets
Compare Anime Clean, Soft Painterly, Bold Cel, Manga Ink and Night Neon in the same camera view before settling on a look.
Outline
Enable Outline and adjust its thickness and colour. Inspect the silhouette against both light and dark backgrounds.
Flat Color Generation
Enable Flat Color Generation when you need flatter generated colours. Set Palette Colors to control the palette size, or use zero to retain all colours.
Character Profile
Save a character profile to reuse the prompt, negative prompt, LoRAs, style image, model and locked seed between shots. Load the profile before generating another view.
Model Sheet
Select the character and choose Generate Model Sheet for a multi-angle pass. Use Place Cameras Only to review the viewpoints before generating.
Anime Background
Choose a background preset, refine the prompt for your scene and select Generate Background. Compare the palette and horizon against the character shot.
Anime Background Presets
Choose a setting such as a school rooftop, train platform or neon city. Use it as a starting point for the shot’s location and time of day.
Anime Render
Create a shot from the active LensArt camera or a turnaround of selected targets. Set duration, sequence, timing, dimensions and samples, then use Render Anime. The panel uses Movie Render Queue and assembles MP4 when FFmpeg is on PATH and the option is enabled.
Comments
Post a Comment