White is the natural choice — glass minnows, small pilchards and most of what a yellowtail actually eats are pale and translucent. On a flat calm day over clear water, white is the least suspicious thing you can put in the slick.
At 1/16oz the jig drifts back at chum speed rather than sinking out of the slick, which is the entire technique for line-shy yellowtail snapper.
Light fluorocarbon leader. If the bite dies, go lighter before you change anything else.