I'm trying to find accurate counts the Chinese started coming around 1834 with the Emancipation Proclamation in 1863. California's Constitution of 1849 explicitly barred slavery. There's no doubt they weren't treated well but the number of enslaved seems to be low.
Indian (Asian) Slaves appear to have been more common but not as numerous as African slaves in Colonial America, digging into it looks more confined to the pre-Revolutionary period.