Skip to content

Add extra logging to the Bulk Export Planner #5798

@ab295382

Description

@ab295382

Description / Background

Currently the Bulk Export Planner produces sparse logs. Therefore it is hard to know what is going on and difficult to debug.

Steps to reproduce

  1. Deploy stacks 'BulkExportStack'
  2. Send SQS message to start a bulk export
  3. Check Cloud Watch Logs
  4. See very little detail

Expected behaviour

More logs so that the user can see what is happening.

Technical Notes / Implementation Details

Add more info and debug logs.

Screenshots/Logs

[main] statestore.transactionlog.TransactionLogHead INFO - Updated StateStorePartitions for table graph, read 3 transactions from log in 0.254s, last transaction number is 3
[main] statestore.transactionlog.TransactionLogHead INFO - Updated StateStoreFiles for table graph, read 2 transactions from log in 0.122s, last transaction number is 2
[main] bulkexport.core.BulkExportQuerySplitter INFO - Loaded state for table graph. Found 2047 partitions. Next initialise time: 2025-10-07T15:49:07.035877329Z

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions