fix(core): drop matches that overlap any earlier kept match in tokenize - #1460

fix(core): drop matches that overlap any earlier kept match in tokenize#1460

RaphaelFakhri wants to merge 1 commit into

livekit:mainlivekit/components-js:mainfrom

RaphaelFakhri:fix/tokenize-overlapRaphaelFakhri/components-js:fix/tokenize-overlapCopy head branch name to clipboard