Any Ideas on how to clean headliner in my car?

Use a hand vac. You can remove them altogether, but applying a new one was a little aggravating. We used a spray adhesive and a thin (very) thin piece of plastic to push in the fabric along the sides.

https://www.drbeasleys.com/blog/2012/02/10/cleaning-your-cars-headliner/

For dirty headliners, all you’ll need to clean your car’s headliner is a microfiber towel, interior cleaning product, and possibly some detailing stix. Most interior cleaning products are made to tackle organic messes (food, dirt, etc.), so if your headliner has greasy or oily spots, using an interior degreaser is a better way to go. Knowing the source of the mess is the best way to clean the surface properly. A key thing to remember when cleaning your headliner is to be gentle. In most cars, because nobody is sitting or stepping on the headliner, it will be made of a softer and easily damaged upholstery. No matter, as long as you stay away from using brushes and vacuums on the sensitive surface you’ll be fine. Next comes the fun…

Spray your cleaner or degreaser on the microfiber towel, then gently dab and wipe the headliner clean. Don’t forget to get sun visors, around lights and sensors (be careful not to allow moisture to come in contact with sensors), and any kind of storage system your car may provide. After cleaning, be sure you’ve not over-saturated any particular area – if it looks like you have, just continue to dab the area with the dry side of your microfiber towel and you’ll be good to go!

If your headliner is more smelly than dirty, to neutralize odors, Neutra-Scent (http://goo.gl/A9DJR5) can be sprayed directly on the smelly fabric surface. As smoker's car can be difficult to reverse, you may need to use an Ozone Treatment in addition to Neutra-Scent.

To protect your car's headliner from grease stains, you can use Carpet & Upholstery Protection. You'll want to make sure the headliner is clean before you protect it, which you can do with Opti-Surface Cleanser.

When you are ready to protect the clean headliner, brush all the fibers of the fabric in one direction. Then spray the Carpet & Upholstery Protection. Let it sit and dry. After that, brush the fibers of the fabric in the opposite direction and spray again, letting it sit and dry.

Carpet & Upholstery Protection creates a barrier that makes it harder for stains to set in. If something does come in contact with your headliner, you should be able to wipe it off without anything remaining.

Here are the links to some products mentioned above:

http://goo.gl/f1TpLl

http://goo.gl/wBojcF

http://goo.gl/SQWCXK

By headliner, I wonder if you mean headlights. You can buy headliner cleaner or use some thing you probably have at home. My husband uses toothpaste on the headlights to get film off of them. Apply and wipe it off with a damp rag.