Using a Stable Diffusion repository in tandem with python and Houdini's PDG, this tool is able to create parameters for the python environment to ingest and retrieve the results for use in UV and heightfield space.
"deatiled photorealistic mixed media collage, high detail, illustrated, fine art" - with input image
"brutalist concrete buildings, fine art style, illustrated, highly detailed, fine texture, dramatic lighting, octane render"
"window with detailed tracery, stained glass, god rays, octane render, photorealistic, high detail, 4k, sharp focus"
Relighting, displacing and remapping the heightfield with the created depth maps in houdini was adding another layer of detail on the generated animations.