Day 9 of making an autonomous G1 Bartender. It appears that when trying to transfer a policy from sim to real, the joints moved too quickly. I thought that this was a simple fix and to just create an adapter to move the joints below a certain threshold but there needed to be a lot more converting than anticipated. I went back to the sim -> behavior cloning -> humanoid movement copies -> astra controlling the G1 and realized that the original ~67 samples that were provided had really bad flicks and that we may need to redo the entire process. I made astra generate a new episode of picking up a can in sim and tested it out on the G1. After changing the limitations that astra set on the joint limits, I finally got the G1 to move acording to the controlled sim (not policy). Now I'll be generating ~30 episodes with astra and restart the entire training process. The majority of the morning was spent redesigning sim to real. I kept asking what the inputs to the policy were and astra constantly told me that it was RGB-D (i thought normal images + depth), joint velocities, accelerations, and their position (the robot knows this in real life too). But there was actually an entire processing step trying to get the hand to can locations and the RGB image was not being fed into the network at all. All gpts do is lie, smh.