Convert sharded migration ITs to use Avro

[manitgupta]

No description provided.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 40.94%. Comparing base (bcf01b8) to head (f5299e5).

Additional details and impacted files

@@             Coverage Diff              @@
##               main    #1543      +/-   ##
============================================
+ Coverage     40.93%   40.94%   +0.01%     
- Complexity     2812     2815       +3     
============================================
  Files           740      740              
  Lines         42832    42832              
  Branches       4581     4581              
============================================
+ Hits          17532    17537       +5     
+ Misses        23799    23795       -4     
+ Partials       1501     1500       -1     

Components	Coverage Δ
spanner-templates	59.81% <ø> (+0.01%)	⬆️
spanner-import-export	65.61% <ø> (+0.04%)	⬆️
spanner-live-forward-migration	73.58% <ø> (ø)
spanner-live-reverse-replication	48.51% <ø> (ø)
spanner-bulk-migration	77.69% <ø> (ø)

see 3 files with indirect coverage changes

[manitgupta]

You're right! I will fix this and other tests where I've made the same mistake! Thank you so much!

…

On Fri, May 10, 2024, 17:58 darshan-sj ***@***.***> wrote: ***@***.**** commented on this pull request. ------------------------------ In v2/datastream-to-spanner/src/test/java/com/google/cloud/teleport/v2/templates/DataStreamToSpannerShardedMigrationWithMigrationShardIdColumnIT.java <#1543 (comment)> : > @@ -270,80 +282,80 @@ private void assertUsersTableContents() { row.put("migration_shard_id", "L1"); events.add(row); - row = new HashMap<>(); - row.put("id", 2); - row.put("name", "Tester2"); - row.put("age_spanner", 33); + row.clear(); My guess is the assert structs method iterates over these row objects one by one and checks if it is present in the structs returned from spanner. So, it is checking if the last row hashmap object exists in struct n times. — Reply to this email directly, view it on GitHub <#1543 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABSOX5WYZ6COYOE22W6PUSDZBS4NFAVCNFSM6AAAAABHQMYQ5OVHI2DSMVQWIX3LMV43YUDVNRWFEZLROVSXG5CSMV3GSZLXHMZDANBZHE3TGNJYHA> . You are receiving this because you authored the thread.Message ID: ***@***.*** com>

[darshan-sj]

LGTM