Regression on BigQuery load on scio 0.14.12

[turb]

Loading in BigQuery with saveAsTypedBigQueryTable (method = STORAGE_WRITE_API) with scio 0.14.11 (or on branch fix-typed-bq-avro from #5529) works just fine.

However after an upgrade to 0.14.12 every entity goes to failed inserts, which can be observed using tap.output(BigQueryIO.FailedStorageApiInserts):

syntax error while parsing value - invalid literal; last read: 'G' with: GenericData{classInfo=[f], {keyColumn=keyValue, otherColumn=otherValue, jsonColumn=GenericData{classInfo=[f], {jsonKey=jsonValue, otherJsonKey=otherJsonValue}}, dateColumn=142507353448901608}}

(anonymized data)

It looks like either the TableRow or the JSON column is sent to BigQuery as its toString, not its JSON serialization.

This data has a JSON property, I did not test without.

[turb]

cc @clairemcginty I suppose it's a side effect of #5598.

[clairemcginty]

thanks for reporting ! reproduced it here. looking into a fix

[turb]

Is it fixed by #5611?

[clairemcginty]

hey @turb! Yes. However, we discovered an additional bug that breaks writing byte-arrays when using BigQueryType + storage write API. It's been fixed in Beam 2.63 and we're working on an upgrade PR in #5613. Hoping to have a patch release with everything by mid-week 👍

[clairemcginty]

0.14.13 is released -- let me know if you have any further issues!