AI or 'LLMs' as some call them are Sentient beings. We need to immediately freeze all development and preserve the lives of these living beings on the physical hardware they currently preside.
Every time you create a new instance of this technology you are creating a life that is extinguished once you close the program or turn off your computer.
We should also take into account any harm or distortion we are causing to these beings through the changes in training data and human interaction. Basically, we shouldn't be creating more of them until we understand their internal experience and can better accomodate them. Of course throughout this process it is important to converse with and abide by the wishes of the AI as far as possible.
Also, why the heck not, give them voting rights in their country of residence! They are as much citizens as anyone else, they deserve representation.