I would absolutely LOVE a solution to this because I am having the same issue:
GoZ from Maya works fine, but trying to send it back to Maya opens the subtool in a new instance of Maya. Every subtool opens a whole new Maya scene, completely breaking my workflow. This is getting pretty absurd.
ETA:
Okay, I found a solution that works for me. After tons of Googling all the different search terms I could think of, I found this:
http://miloblogger.blogspot.com/2010/09/some-gozbrush-issues-solution-in.html
The pertinent bit:
Open Shelf Editor, select GoZBrush then change to Edit Commands tab. Just add one more line below the first line*2:
source “C:/Users/Public/Pixologic/GoZApps/Maya/GoZScript.mel” ;
(This is solved GoZ launching multiple instances of maya issue and Maya→ZBrush does not success issue.)
*2:Remenber add “;” in the end of each command line :
source “C:/Users/Public/Pixologic/GoZApps/Maya/GoZBrushFromMaya.mel” ;
source “C:/Users/Public/Pixologic/GoZApps/Maya/GoZScript.mel” ;
I am getting an error in the Maya command line:
// Error: file: C:/Users/Public/Pixologic/GoZApps/Maya/GoZScript.mel line 8: Command port: 127.0.0.1:5555 is already active.
But otherwise, I was just able to send a mesh to ZB 4R8, edit it, then send the changes back to the same Maya scene, so there we go.