My friend has been staying at my apartment for awhile and I want to kick her out because she is acting like she owns the place, not paying rent, and keeps inviting unwanted guests.

What should I do? Can I just take all her stuff out and change the lock?
Can the landlord evict her even though her name is NOT the tentant list?

If she's not paying rent then you can remove her stuff and kick her out. What did you do, give her a key? Sheesh! Whatever. Unless you two are married or she's paying rent, you have the right to kick her out. If she doesn't leave, you can call the police and report her for trespass.

Ask the landlord to send you a letter saying that you cannot have persons who are not on the lease staying with you and telling you to get in compliance within 5 days, then you can show it to your friend and tell the friend that they have to leave and can no longer stay and that they need to get their things out and go. This is a suggestion as a blame free way to get rid of the friend, not to mention you really are in lease violation that you want to get corrected.