This should just be how it is. Colorado does this my vote is always counted days before Election Day and the results take like < 4 hours after polls close to call a race
Guys, the obvious solution is just to have California count all the mail ballots first and then wait to count the day-of-election ballots til the end.
That sounds dumb but would absolutely address the complaints caused by "red mirage/blue shift"