[BenWu]

Description

Some attempts optimizations for view deploys. The publish_tables_and_views task in bqetl_artifact_deployment currently takes 30-40 minutes.

changes:

• skip unchanged views and use the force option in bqetl deploy
  • the deploy command didn't use force and always published every view for shared-prod, unlike the bqetl view publish command for mozdata
• reuse bigquery client across process
  • a lot of the dry runs and deploys were constructing a new bigquery client to make a call
  • possibly no real improvement in prod since the cost locally is a ~350 ms call to gcloud to get credentials
• get all views from region-us.INFORMATION_SCHEMA.VIEWS instead of querying once per dataset

Another possible change I didn't do is increasing the parallelism from the default 8 since most of the time spent is on the bigquery side. We might need to switch to threads instead of processes for that so keep memory usage low and that might be a large change.

Reviewer, please follow this checklist