Answers:
We girls like ice cream.
Us girls like ice cream.
Drop the noun "girls" and you will see which one is correct.
We is used as a subject, us is used as an object.
They kicked we girls out.
They kicked us girls out.
Again, drop "girls" and you will see the who is the object of getting kicked out.