Kinja appears to have been modified in this regard. It used to be you would use the embed code, save twice, and everything would be dandy. Not any longer. The embed code produces these weird links that go nowhere and ugly everything up. See below:
It appears the only way to properly embed a tweet now is just to cut and paste its permalink, or individual url, into your post. Then it comes out all pretty and stuff. Plus it is easier.