[HUDI-7460] Relaxing compaction scheduling when there are pending delta commits

[nsivabalan]

Change Logs

Hudi has a constraint that compaction schedule can happen only if there are no pending delta commits whose instant time < compaction instant being scheduled. We were throwing exception when this condition is not met. Fixing the user behavior here so that we do not throw exception and return an empty plan when this condition is met.

Impact

This will smoothen our experience w/ async table service since the we don't have control over ingestion writer.

Risk level (write none, low medium or high below)

low

Documentation Update

Describe any necessary documentation update if there is any new feature, config, or user-facing change

• The config description must be updated if new configs are added or the default value of the configs are changed
• Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the
  ticket number here and follow the instruction to make
  changes to the website.

Contributor's checklist

• Read through contributor's guide
• Change Logs and Impact were stated clearly
• Adequate tests were added if applicable
• CI passed

[yihua]

LGTM

[hudi-bot]

CI report:

• 8c637d3 Azure: SUCCESS

Bot commands

@hudi-bot supports the following commands:

• @hudi-bot run azure re-run the last Azure build