Can I use fast charger on my iPhone Xs

A higher output USB-C charger with lightning [or appropriate] cable

could more quickly charge an iPhone; generally without any harm.

Mine charges a bit faster with Apple 30W power supply from iPad.

Yes you can. Fast charging is supported by the iPhone 8 and up