When I power the 4.1 from USB it is drawing 6 mA, thats reasonable.

Then I put it in the socket I build, where the 3.6 was, I apply 5 v at Vin and Gnd and :
It takes 106mA. I disconnected it fast.

Whats wrong?

There used to be Ground and Analog ground, whats the difference?