r/IsaacSim

​

I have been developing a project called the Ghost Environment to prove that

hardware vendor lock in is a software choice rather than a physical limitation.

Today I reached a significant milestone by successfully initializing NVIDIA

Isaac Sim 5.1.0 on an AMD Radeon RX 7800 XT.

Technical Overview: The system operates as a Rust based hypervisor that

intercepts proprietary API calls at the system level. It utilizes JIT compiled

C++ stubs to spoof the NVIDIA Management Library and a specialized ZLUDA fork to

translate CUDA math kernels into AMD compatible instructions in real time.

Current State and Performance: The engine reached the app ready state in 16

seconds with near zero overhead. It is important to note that the viewport is

currently fully black as OptiX and hardware accelerated Ray Tracing support have

not been implemented yet. However the core physics engine and UI are fully

operational and the hardware gate is officially bypassed.

Release Status: This specific build featuring Isaac Sim and Omniverse support is

currently in private beta and has not been released to the public repository

yet. I am finalizing the internal logic to ensure the system is stable before

the official launch.

If you would like to follow the development or be notified when the full release

drops please star or watch the repository on GitHub at

https://github.com/Void-Compute/AMD-Ghost-Enviroment

I am 15 years old and I engineered this because I wanted to break the walls of a

closed ecosystem. If I can do this anyone can. You have the power to achieve great things.

I’m planning to work on an end-to-end manipulation / VLA project and wanted some opinions on the simulator + training stack.

Previously, I used a Unity-based simulator and trained an ACT policy with LeRobot. It worked reasonably well, but at the time I avoided Isaac Sim because it had too many unresolved bugs and stability issues. Now I’m reconsidering Isaac Sim again, especially for large-scale synthetic data generation.

My rough plan is:

- Use Isaac Sim locally or on cloud GPUs
- Spawn multiple robot arms/manipulators (maybe scaling from 1 up to dozens of environments)
- Run simple manipulation tasks like swipe/pick/place
- Use RL for exploration and task completion
- Collect camera observations + trajectories
- Train a VLA or vision-based policy from the collected data

I’d love feedback on:
- Recommended RL frameworks/models for manipulation
- Recommended VLA / visuomotor models
- Whether this pipeline makes sense overall

I’m also curious what people are currently using in practice for scalable manipulation training.